00010000:00010000:0.0:1746147234.874963:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147234.874988:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54ea00/0xb4b2209fbdacdd22 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eace0 expref: 27 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147234.875012:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147234.875017:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147234.875036:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1959:x1830967465200512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147234.875041:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 730 00000100:00100000:0.0:1746147234.884169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.917770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.923902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.923967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.924711:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465201408 00000100:00100000:0.0:1746147234.924714:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465201408 00010000:00010000:0.0:1746147234.924726:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86ee00/0xb4b2209fbdacd978 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaab7 expref: 29 pid: 6881 timeout: 721 lvb_type: 0 00000100:00100000:0.0:1746147234.924744:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7229 00000100:00100000:0.0:1746147234.924748:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465201408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147234.924755:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147234.924762:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b86ee00/0xb4b2209fbdacd978 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaab7 expref: 29 pid: 6881 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147234.924770:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b86ee00/0xb4b2209fbdacd978 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaab7 expref: 29 pid: 6881 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147234.924781:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b86ee00/0xb4b2209fbdacd978 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaab7 expref: 29 pid: 6881 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147234.924800:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147234.924802:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147234.924807:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e54e200/0xb4b2209fbdacdd30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eace7 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147234.924815:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e54e200/0xb4b2209fbdacdd30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eace7 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147234.924837:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e54e200/0xb4b2209fbdacdd30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eace7 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147234.924846:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466838144:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147234.924887:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147234.929549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.938543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.947472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147234.948571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.002689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.010522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.010564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.010599:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465202560 00000100:00100000:0.0:1746147235.010605:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465202560 00010000:00010000:0.0:1746147235.010636:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb30a00/0xb4b2209fbdacdcf8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaccb expref: 42 pid: 4445 timeout: 721 lvb_type: 0 00000100:00100000:0.0:1746147235.010668:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465202688 00000100:00100000:0.0:1746147235.010679:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465202688 00010000:00010000:0.0:1746147235.010697:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbfd400/0xb4b2209fbdacdcc0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaca1 expref: 21 pid: 8480 timeout: 721 lvb_type: 0 00000100:00100000:0.0:1746147235.010712:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7232 00000100:00100000:0.0:1746147235.010718:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465202560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147235.010728:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147235.010749:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb30a00/0xb4b2209fbdacdcf8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaccb expref: 42 pid: 4445 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147235.010759:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb30a00/0xb4b2209fbdacdcf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaccb expref: 42 pid: 4445 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147235.010779:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147235.010819:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465202560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.010826:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7232 00000100:00100000:0.0:1746147235.010839:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7233 00000100:00100000:0.0:1746147235.010844:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465202688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147235.010850:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147235.010857:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbfd400/0xb4b2209fbdacdcc0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaca1 expref: 21 pid: 8480 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147235.010866:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbfd400/0xb4b2209fbdacdcc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaca1 expref: 21 pid: 8480 timeout: 721 lvb_type: 0 00010000:00010000:0.0:1746147235.010877:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.010883:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.010889:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 41 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.010896:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 41 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.010921:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 41 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.010931:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466838912:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147235.016709:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465202944 00000100:00100000:0.0:1746147235.016716:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465202944 00002000:00100000:0.0:1746147235.016751:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2744320->2748415) req@ffff88012bfe1f80 x1830967465202944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.016760:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1f80 with x1830967465202944 ext(2744320->2748415) 00002000:00010000:0.0:1746147235.016764:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe1f80 00000100:00100000:0.0:1746147235.016781:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6686 00000100:00100000:0.0:1746147235.016787:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465202944:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147235.016917:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465202944:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 129us (279us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147235.016923:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6686 00002000:00100000:0.0:1746147235.016928:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2744320->2748415) req@ffff88012bfe1f80 x1830967465202944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/4536 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.016934:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1f80 with x1830967465202944 ext(2744320->2748415) 00002000:00010000:0.0:1746147235.016962:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe1f80 00000100:00100000:0.0:1746147235.021426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.039429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147235.041001:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147235.042987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.044200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147235.044277:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147235.045339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.049003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.052524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.052812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.053563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.063728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.068129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.070165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.071721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.073515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.073699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.073725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.073767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.073823:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14350 00000100:00100000:0.0:1746147235.073828:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967465206016:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147235.073832:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.073837:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4713000/0xb4b2209fbdacddc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead50 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.073855:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466840192:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147235.073879:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.075863:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466840192:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147235.075884:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4713000/0xb4b2209fbdacddc3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead50 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.075894:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4713000/0xb4b2209fbdacddc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead50 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.075906:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4713000, rc 0) 00000100:00100000:0.0:1746147235.075934:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465206016:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2105us (2166us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147235.075959:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14350 00000100:00100000:0.0:1746147235.078629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.081630:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14353 00000100:00100000:0.0:1746147235.081636:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465206528:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147235.081647:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4713200/0xb4b2209fbdacdded lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081655:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbfde00/0xb4b2209fbdacdcdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaca8 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081661:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbfdc00/0xb4b2209fbdacdd68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead0a expref: 15 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081667:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbfd600/0xb4b2209fbdacdcf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacc4 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081686:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.081687:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.081689:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4713200/0xb4b2209fbdacdded lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081703:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbfd600/0xb4b2209fbdacdcf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacc4 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081709:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbfd600/0xb4b2209fbdacdcf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacc4 expref: 27 pid: 21080 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.081716:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466840960:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.081739:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbfdc00/0xb4b2209fbdacdd68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead0a expref: 15 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081746:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbfdc00/0xb4b2209fbdacdd68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead0a expref: 15 pid: 21080 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.081753:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466841088:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.081772:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbfde00/0xb4b2209fbdacdcdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaca8 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081779:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbfde00/0xb4b2209fbdacdcdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaca8 expref: 35 pid: 8480 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.081795:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466841216:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.081807:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.081837:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465207040 00000100:00100000:0.0:1746147235.081840:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465207040 00000100:00100000:0.0:1746147235.081856:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14356 00000100:00100000:0.0:1746147235.081860:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1957:x1830967465207040:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147235.081873:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081880:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdacdc50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eac5b expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081886:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbfd400/0xb4b2209fbdacdd76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead26 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081891:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009474b000/0xb4b2209fbdacdca4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eac85 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081895:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.081896:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.081898:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.081908:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009474b000/0xb4b2209fbdacdca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eac85 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.081923:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009474b000/0xb4b2209fbdacdca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eac85 expref: 27 pid: 4444 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.081931:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466841472:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.082104:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbfd400/0xb4b2209fbdacdd76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead26 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.082111:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbfd400/0xb4b2209fbdacdd76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead26 expref: 16 pid: 21080 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.082118:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466841600:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.082136:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdacdc50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eac5b expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.082142:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdacdc50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eac5b expref: 35 pid: 21080 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.082147:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466841728:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.082155:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.086601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.086620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.086649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.086669:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465207296 00000100:00100000:0.0:1746147235.086675:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465207296 00002000:00100000:0.0:1746147235.086725:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1605632->2097151) req@ffff88009b209c00 x1830967465207296/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.086733:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209c00 with x1830967465207296 ext(1605632->2097151) 00010000:00010000:0.0:1746147235.086740:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e54e200/0xb4b2209fbdacdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eace7 expref: 28 pid: 8480 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147235.086750:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e54e200/0xb4b2209fbdacdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eace7 expref: 28 pid: 8480 timeout: 722 lvb_type: 0 00002000:00010000:0.0:1746147235.086756:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b209c00 00000100:00100000:0.0:1746147235.086770:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465207424 00000100:00100000:0.0:1746147235.086772:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465207424 00002000:00100000:0.0:1746147235.086783:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2744320->3002367) req@ffff88009b208000 x1830967465207424/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.086789:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967465207424 ext(2744320->3002367) 00010000:00010000:0.0:1746147235.086793:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 40 pid: 8480 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147235.086801:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 40 pid: 8480 timeout: 722 lvb_type: 0 00002000:00010000:0.0:1746147235.086805:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b208000 00000100:00100000:0.0:1746147235.086815:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2354 00000100:00100000:0.0:1746147235.086821:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465207296:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147235.087195:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2355 00000100:00100000:0.0:1746147235.087200:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465207424:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147235.090822:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466841344:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.090833:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.091058:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466841472:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.091065:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466841728:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.097642:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967465207424:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 10434us (10985us total) trans 17179873737 rc 0/0 00000100:00100000:0.0:1746147235.097651:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2355 00002000:00100000:0.0:1746147235.104049:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2744320->3002367) req@ffff88009b208000 x1830967465207424/t17179873737(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/448 e 0 to 0 dl 1746147246 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.104062:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967465207424 ext(2744320->3002367) 00010000:00010000:0.0:1746147235.104073:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 41 pid: 8480 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147235.104085:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 41 pid: 8480 timeout: 722 lvb_type: 0 00002000:00010000:0.0:1746147235.104091:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b208000 00000100:00100000:0.0:1746147235.104195:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466841600:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.104217:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.104247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147235.104677:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104683:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104698:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104703:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104709:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104715:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4712200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147235.104718:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104723:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104731:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.104736:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4712200/0xb4b2209fbdacde02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.104786:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465207040:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 22925us (22957us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.104792:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14356 00000100:00100000:0.0:1746147235.132086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.132144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133315:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209088 00000100:00100000:0.0:1746147235.133317:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209088 00000100:00100000:0.0:1746147235.133336:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14357 00000100:00100000:0.0:1746147235.133341:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465209088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.133347:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.133356:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e9f8800/0xb4b2209fbdacde2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead65 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.133370:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417a2, atime: 0x681417a0, ctime: 0x681417a2, blocks: 0x7b7 00010000:00010000:0.0:1746147235.133378:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.133380:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.133385:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e9f8800/0xb4b2209fbdacde2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead65 expref: 42 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.133395:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e9f8800/0xb4b2209fbdacde2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead65 expref: 42 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.133401:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e9f8800, rc 0) 00000100:00100000:0.0:1746147235.133417:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465209088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.133425:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14357 00000100:00100000:0.0:1746147235.133449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133459:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209344 00000100:00100000:0.0:1746147235.133461:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209344 00000100:00100000:0.0:1746147235.133475:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14358 00000100:00100000:0.0:1746147235.133478:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465209344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.133484:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.133489:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e9f8600/0xb4b2209fbdacde33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead73 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.133510:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e9f8600/0xb4b2209fbdacde33 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead73 expref: 35 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.133517:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e9f8600/0xb4b2209fbdacde33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead73 expref: 35 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.133523:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e9f8600, rc 0) 00000100:00100000:0.0:1746147235.133534:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465209344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (85us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147235.133538:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14358 00000100:00100000:0.0:1746147235.133564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133572:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209600 00000100:00100000:0.0:1746147235.133574:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209600 00000100:00100000:0.0:1746147235.133583:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14359 00000100:00100000:0.0:1746147235.133587:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465209600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.133591:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.133597:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e9f8200/0xb4b2209fbdacde3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead81 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.133619:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466841856:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147235.133657:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.133680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133736:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209216 00000100:00100000:0.0:1746147235.133738:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209216 00000100:00100000:0.0:1746147235.133749:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14360 00000100:00100000:0.0:1746147235.133754:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465209216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.133759:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.133766:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c7ca00/0xb4b2209fbdacde41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead6c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.133775:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417a2, atime: 0x681417a2, ctime: 0x681417a2, blocks: 0x821 00010000:00010000:0.0:1746147235.133781:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.133782:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.133786:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c7ca00/0xb4b2209fbdacde41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead6c expref: 35 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.133794:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c7ca00/0xb4b2209fbdacde41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead6c expref: 35 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.133800:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c7ca00, rc 0) 00000100:00100000:0.0:1746147235.133814:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465209216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 59us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.133822:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14360 00000100:00100000:0.0:1746147235.133845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133854:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209472 00000100:00100000:0.0:1746147235.133857:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209472 00000100:00100000:0.0:1746147235.133867:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14361 00000100:00100000:0.0:1746147235.133871:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465209472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.133875:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.133881:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c7da00/0xb4b2209fbdacde48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead7a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.133898:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466841984:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147235.133913:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.133964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.133980:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209728 00000100:00100000:0.0:1746147235.133982:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209728 00000100:00100000:0.0:1746147235.133993:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14362 00000100:00100000:0.0:1746147235.133996:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465209728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.134001:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.134007:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdacde4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead88 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.134016:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417a2, atime: 0x681417a1, ctime: 0x681417a2, blocks: 0x1029 00010000:00010000:0.0:1746147235.134021:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.134023:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.134026:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdacde4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead88 expref: 36 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.134037:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdacde4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead88 expref: 36 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.134044:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51d4c00, rc 0) 00000100:00100000:0.0:1746147235.134054:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465209728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 57us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.134059:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14362 00010000:00010000:0.0:1746147235.135062:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135069:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135080:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135085:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135089:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135093:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbfc000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147235.135096:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135104:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135112:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.135117:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbfc000/0xb4b2209fbdacddfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.135140:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465206784:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 53420us (53790us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.135144:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14355 00000100:00100000:0.0:1746147235.137924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.137964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.137976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.137989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.138001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.138012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.142440:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209856 00000100:00100000:0.0:1746147235.142449:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209856 00000100:00100000:0.0:1746147235.142479:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465209984 00000100:00100000:0.0:1746147235.142481:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465209984 00000100:00100000:0.0:1746147235.142492:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465210112 00000100:00100000:0.0:1746147235.142494:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465210112 00000100:00100000:0.0:1746147235.142500:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465210240 00000100:00100000:0.0:1746147235.142502:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465210240 00000100:00100000:0.0:1746147235.142508:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465210368 00000100:00100000:0.0:1746147235.142510:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465210368 00000100:00100000:0.0:1746147235.142516:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465210496 00000100:00100000:0.0:1746147235.142517:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465210496 00000100:00100000:0.0:1746147235.142531:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14363 00000100:00100000:0.0:1746147235.142537:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465209856:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.142551:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.142563:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00a000/0xb4b2209fbdacde56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead8f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.142581:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142583:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142589:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00a000/0xb4b2209fbdacde56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead8f expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142602:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00a000/0xb4b2209fbdacde56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead8f expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142611:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00a000, rc 0) 00000100:00100000:0.0:1746147235.142651:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465209856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 115us (4733us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.142657:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14363 00000100:00100000:0.0:1746147235.142671:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14364 00000100:00100000:0.0:1746147235.142675:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465209984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.142682:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.142690:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f00a600/0xb4b2209fbdacde5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead96 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.142699:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142701:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142704:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f00a600/0xb4b2209fbdacde5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead96 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142713:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f00a600/0xb4b2209fbdacde5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead96 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142719:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00a600, rc 0) 00000100:00100000:0.0:1746147235.142733:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465209984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 57us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.142737:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14364 00000100:00100000:0.0:1746147235.142746:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14365 00000100:00100000:0.0:1746147235.142751:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465210112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.142755:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.142762:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f00aa00/0xb4b2209fbdacde64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ead9d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.142778:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417a2, atime: 0x681417a0, ctime: 0x681417a2, blocks: 0x821 00010000:00010000:0.0:1746147235.142786:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142787:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142790:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f00aa00/0xb4b2209fbdacde64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead9d expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142798:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f00aa00/0xb4b2209fbdacde64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead9d expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142804:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00aa00, rc 0) 00000100:00100000:0.0:1746147235.142817:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465210112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 66us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.142822:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14365 00000100:00100000:0.0:1746147235.142831:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14366 00000100:00100000:0.0:1746147235.142835:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465210240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.142840:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.142846:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdacde6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eada4 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.142854:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142855:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142858:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdacde6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eada4 expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142866:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdacde6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eada4 expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142872:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00ae00, rc 0) 00000100:00100000:0.0:1746147235.142884:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465210240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 50us (4895us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.142889:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14366 00000100:00100000:0.0:1746147235.142897:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14367 00000100:00100000:0.0:1746147235.142901:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465210368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.142905:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.142911:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eadab expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.142923:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142925:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.142928:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadab expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142951:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadab expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.142959:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00a400, rc 0) 00000100:00100000:0.0:1746147235.142973:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465210368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 72us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.142978:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14367 00000100:00100000:0.0:1746147235.142987:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14368 00000100:00100000:0.0:1746147235.142992:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465210496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.142997:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.143003:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f00b400/0xb4b2209fbdacde79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eadb2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.143011:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.143012:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.143016:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f00b400/0xb4b2209fbdacde79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadb2 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.143024:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f00b400/0xb4b2209fbdacde79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadb2 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.143035:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00b400, rc 0) 00000100:00100000:0.0:1746147235.143049:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465210496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 57us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.143053:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14368 00010000:00010000:0.0:1746147235.143084:0:8480:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88009b209880 x1830967466841984) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a4faa800/0xb4b2209fbdacdd37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacee expref: 24 pid: 8480 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147235.143103:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4faa800/0xb4b2209fbdacdd37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacee expref: 24 pid: 8480 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.143114:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466841984:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147235.143134:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c7da00/0xb4b2209fbdacde48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead7a expref: 45 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.143142:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c7da00/0xb4b2209fbdacde48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead7a expref: 45 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.143148:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c7da00, rc 0) 00000100:00100000:0.0:1746147235.143162:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465209472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9290us (9316us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147235.143167:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14361 00010000:00010000:0.0:1746147235.143200:0:21080:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88009b20b480 x1830967466841856) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 43 pid: 8480 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147235.143220:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4faae00/0xb4b2209fbdacdd3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3002367) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eacf5 expref: 43 pid: 8480 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.143227:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466841856:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147235.143239:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e9f8200/0xb4b2209fbdacde3a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead81 expref: 42 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.143247:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e9f8200/0xb4b2209fbdacde3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead81 expref: 42 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.143253:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e9f8200, rc 0) 00000100:00100000:0.0:1746147235.143281:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465209600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9692us (9715us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147235.143286:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14359 00000100:00100000:0.0:1746147235.152696:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11170 00000100:00100000:0.0:1746147235.152709:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:31194:x1830967465211008:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:0.0:1746147235.152748:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147235.152758:0:16361:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4faba00/0xb4b2209fbdacdda7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead34 expref: 12 pid: 14048 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147235.152776:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147235.152781:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54f000/0xb4b2209fbdacde87 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147235.152791:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54f000/0xb4b2209fbdacde87 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147235.152795:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147235.152839:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:31194:x1830967465211008:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 135us (4760us total) trans 0 rc -16/-16 00000100:00100000:0.0:1746147235.152844:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11170 00000100:00100000:0.0:1746147235.205688:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465212544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 43383us (45344us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147235.205699:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6692 00002000:00100000:0.0:1746147235.205708:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f84380 x1830967465212544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.205717:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84380 with x1830967465212544 ext(1048576->2097151) 00002000:00010000:0.0:1746147235.205722:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84380 00000100:00100000:0.0:1746147235.212008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.212530:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1959:x1830967465211264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 51925us (52293us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147235.212539:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6688 00002000:00100000:0.0:1746147235.212548:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134f85500 x1830967465211264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.212556:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85500 with x1830967465211264 ext(0->1048575) 00002000:00010000:0.0:1746147235.212560:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f85500 00000100:00100000:0.0:1746147235.252526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.254182:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465211776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 93208us (93862us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147235.254196:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6690 00002000:00100000:0.0:1746147235.254209:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134f87b80 x1830967465211776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.254218:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87b80 with x1830967465211776 ext(1048576->2097151) 00002000:00010000:0.0:1746147235.254223:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87b80 00000100:00100000:0.0:1746147235.277336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.290168:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465213952 00000100:00100000:0.0:1746147235.290176:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465213952 00002000:00100000:0.0:1746147235.290224:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134f87800 x1830967465213952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.290233:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87800 with x1830967465213952 ext(2097152->3145727) 00002000:00010000:0.0:1746147235.290238:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f87800 00000100:00100000:0.0:1746147235.290286:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6694 00000100:00100000:0.0:1746147235.290295:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465213952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.329713:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465214976 00000100:00100000:0.0:1746147235.329723:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465214976 00002000:00100000:0.0:1746147235.329758:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012c85d500 x1830967465214976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.329767:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85d500 with x1830967465214976 ext(1048576->2097151) 00002000:00010000:0.0:1746147235.329771:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85d500 00000100:00100000:0.0:1746147235.329788:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6698 00000100:00100000:0.0:1746147235.329794:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465214976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.412804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.412835:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465215104 00000100:00100000:0.0:1746147235.412842:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465215104 00000100:00100000:0.0:1746147235.431372:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465214464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 136551us (136837us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147235.431384:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6695 00002000:00100000:0.0:1746147235.431396:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f669880 x1830967465214464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.431405:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669880 with x1830967465214464 ext(3145728->4194303) 00002000:00010000:0.0:1746147235.431410:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669880 00000100:00100000:0.0:1746147235.443868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.466415:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465214976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 136612us (165326us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147235.466426:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6698 00002000:00100000:0.0:1746147235.466437:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012c85d500 x1830967465214976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.466446:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85d500 with x1830967465214976 ext(1048576->2097151) 00002000:00010000:0.0:1746147235.466451:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85d500 00000100:00100000:0.0:1746147235.469330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.473571:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465215744 00000100:00100000:0.0:1746147235.473578:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465215744 00000100:00100000:0.0:1746147235.473606:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14372 00000100:00100000:0.0:1746147235.473612:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:31203:x1830967465215744:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147235.473625:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.473637:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094682e00/0xb4b2209fbdacdecd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaddc expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.473660:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc46e00/0xb4b2209fbdacdebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1740800->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadce expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.473666:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147235.473667:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147235.473670:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094682e00/0xb4b2209fbdacdecd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaddc expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.473702:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc46e00/0xb4b2209fbdacdebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1740800->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadce expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.473710:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc46e00/0xb4b2209fbdacdebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1740800->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadce expref: 25 pid: 4444 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.473719:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466842752:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.473787:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137646f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.474539:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465216000 00000100:00100000:0.0:1746147235.474543:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465216000 00002000:00100000:0.0:1746147235.474568:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4943871) req@ffff880134f85c00 x1830967465216000/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.474576:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85c00 with x1830967465216000 ext(4194304->4943871) 00010000:00010000:0.0:1746147235.474581:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadab expref: 26 pid: 4445 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746147235.474589:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadab expref: 26 pid: 4445 timeout: 722 lvb_type: 1 00002000:00010000:0.0:1746147235.474595:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f85c00 00000100:00100000:0.0:1746147235.474617:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2357 00000100:00100000:0.0:1746147235.474622:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465216000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.482511:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465216128 00000100:00100000:0.0:1746147235.482519:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465216128 00000100:00100000:0.0:1746147235.482623:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14373 00000100:00100000:0.0:1746147235.482630:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:31200:x1830967465216128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.482643:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.482661:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094682600/0xb4b2209fbdacded4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eade3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.482682:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147235.482694:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094682e00/0xb4b2209fbdacdecd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaddc expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.482700:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147235.482703:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094682600/0xb4b2209fbdacded4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eade3 expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.482729:0:6881:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094682e00/0xb4b2209fbdacdecd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaddc expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.482740:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094682600/0xb4b2209fbdacded4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eade3 expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.482753:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682600, rc 0) 00000100:00100000:0.0:1746147235.482786:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:31200:x1830967465216128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 157us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.482791:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14373 00000100:00100000:0.0:1746147235.483446:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465216000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8822us (8940us total) trans 0 rc 749568/749568 00000100:00100000:0.0:1746147235.483453:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2357 00002000:00100000:0.0:1746147235.483458:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4943871) req@ffff880134f85c00 x1830967465216000/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:H/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.483465:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85c00 with x1830967465216000 ext(4194304->4943871) 00010000:00010000:0.0:1746147235.483470:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadab expref: 26 pid: 4445 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746147235.483478:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdacde72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadab expref: 26 pid: 4445 timeout: 722 lvb_type: 1 00002000:00010000:0.0:1746147235.483483:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f85c00 00000100:00100000:0.0:1746147235.496817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.496836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.496917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.505096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.505174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.508933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.510183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.510248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.516328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.516425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.523068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.523430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.527714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.535018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.545998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.560690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.577873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.579095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.579130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.579201:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.579241:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465220096 00000100:00100000:0.0:1746147235.579248:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465220096 00002000:00100000:0.0:1746147235.579312:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a5a0f480 x1830967465220096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.579320:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f480 with x1830967465220096 ext(3145728->4194303) 00002000:00010000:0.0:1746147235.579324:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0f480 00000100:00100000:0.0:1746147235.579340:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465219968 00000100:00100000:0.0:1746147235.579342:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465219968 00002000:00100000:0.0:1746147235.579352:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800a5a0f100 x1830967465219968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.579358:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967465219968 ext(2097152->3145727) 00002000:00010000:0.0:1746147235.579360:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:0.0:1746147235.579375:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465220352 00000100:00100000:0.0:1746147235.579377:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465220352 00002000:00100000:0.0:1746147235.579389:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2351104->3399679) req@ffff8800a5a0c700 x1830967465220352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.579394:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c700 with x1830967465220352 ext(2351104->3399679) 00002000:00010000:0.0:1746147235.579397:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c700 00000100:00100000:0.0:1746147235.579405:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465220480 00000100:00100000:0.0:1746147235.579406:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465220480 00002000:00100000:0.0:1746147235.579413:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3399680->4194303) req@ffff8800a5a0ea00 x1830967465220480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.579418:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ea00 with x1830967465220480 ext(3399680->4194303) 00002000:00010000:0.0:1746147235.579420:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ea00 00000100:00100000:0.0:1746147235.579430:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6704 00000100:00100000:0.0:1746147235.579436:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465220096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.579689:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6706 00000100:00100000:0.0:1746147235.579695:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465220352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.579863:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6707 00000100:00100000:0.0:1746147235.579869:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465220480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.610731:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.636760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.642479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.646758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.652138:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.652241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.652451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.652565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.653085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.653117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.653173:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465221888 00000100:00100000:0.0:1746147235.653176:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465221888 00000100:00100000:0.0:1746147235.653191:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465222016 00000100:00100000:0.0:1746147235.653192:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465222016 00000100:00100000:0.0:1746147235.653199:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465222144 00000100:00100000:0.0:1746147235.653201:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465222144 00000100:00100000:0.0:1746147235.653211:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14381 00000100:00100000:0.0:1746147235.653215:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465221888:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147235.653222:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.653228:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094682400/0xb4b2209fbdacdf28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eae22 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.653237:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.653238:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.653242:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094682400/0xb4b2209fbdacdf28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae22 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.653250:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094682400/0xb4b2209fbdacdf28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae22 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.653256:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682400, rc 0) 00000100:00100000:0.0:1746147235.653281:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465221888:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 66us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.653286:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14381 00000100:00100000:0.0:1746147235.653300:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14382 00000100:00100000:0.0:1746147235.653305:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465222016:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147235.653312:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.653317:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094682200/0xb4b2209fbdacdf2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eae29 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.653345:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466844032:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147235.655075:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.657752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.659653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.663315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.667577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.670051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.670077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.670102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.670114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.670127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.670185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.671038:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14389 00000100:00100000:0.0:1746147235.671045:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465223680:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147235.671060:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.671069:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdacde4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead88 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.671075:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdacdf36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae30 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.671085:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f00b400/0xb4b2209fbdacde79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadb2 expref: 7 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.671089:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.671091:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.671093:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.671655:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f00b400/0xb4b2209fbdacde79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadb2 expref: 7 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.671667:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f00b400/0xb4b2209fbdacde79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eadb2 expref: 7 pid: 4445 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.671675:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466845824:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.671697:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdacdf36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae30 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.671703:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdacdf36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae30 expref: 11 pid: 4444 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.671710:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466845952:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.671726:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdacde4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead88 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.671736:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdacde4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ead88 expref: 14 pid: 8481 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746147235.671743:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e976a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466846080:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.671754:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.679558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.679578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.679613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.679735:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466845824:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.679751:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466845952:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.679757:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e976a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466846080:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.679774:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.679791:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7257 00000100:00100000:0.0:1746147235.679795:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465224064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147235.679801:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147235.679810:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094682400/0xb4b2209fbdacdf28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae22 expref: 11 pid: 21080 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746147235.679817:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094682400/0xb4b2209fbdacdf28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae22 expref: 11 pid: 21080 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746147235.679828:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147235.679861:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465224064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.679866:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7257 00000100:00100000:0.0:1746147235.679881:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7258 00000100:00100000:0.0:1746147235.679885:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465223936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147235.679894:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147235.679904:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b1a5e00/0xb4b2209fbdacdf1a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae14 expref: 12 pid: 6881 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746147235.679911:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b1a5e00/0xb4b2209fbdacdf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae14 expref: 12 pid: 6881 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746147235.679920:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147235.680925:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465223936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1037us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.680930:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7258 00000100:00100000:0.0:1746147235.682516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682623:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682647:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.682706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.685573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147235.686790:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686797:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686813:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686820:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686825:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686830:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094682200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147235.686833:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686839:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686848:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.686857:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682200/0xb4b2209fbdacdf91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.686897:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465223680:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15852us (16711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.686902:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14389 00000100:00100000:0.0:1746147235.696569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.699788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.705200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.705308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.705485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.705717:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.705782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.705858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.708010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.735392:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466847360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147235.735414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147235.735435:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466847872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147235.735450:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147235.735462:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.735475:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147235.735486:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.735500:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147235.735512:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147235.735516:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.735528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147235.735536:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.735550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147235.736634:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14393 00000100:00100000:0.0:1746147235.736643:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466847360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147235.736806:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466847360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (1391us total) trans 17179873746 rc 0/0 00000100:00100000:0.0:1746147235.736812:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14393 00000100:00100000:0.0:1746147235.736825:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466848768 00000100:00100000:0.0:1746147235.736827:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466848768 00000100:00100000:0.0:1746147235.736839:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466848128 00000100:00100000:0.0:1746147235.736840:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466848128 00000100:00100000:0.0:1746147235.736846:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466848640 00000100:00100000:0.0:1746147235.736848:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466848640 00000100:00100000:0.0:1746147235.736857:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14394 00000100:00100000:0.0:1746147235.736861:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466847872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147235.736977:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466847872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (1525us total) trans 17179873747 rc 0/0 00000100:00100000:0.0:1746147235.736982:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14394 00000100:00100000:0.0:1746147235.736991:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14395 00000100:00100000:0.0:1746147235.736995:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466848384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.737145:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466848384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (1669us total) trans 21474841132 rc 0/0 00000100:00100000:0.0:1746147235.737150:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14395 00000100:00100000:0.0:1746147235.737160:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14396 00000100:00100000:0.0:1746147235.737165:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466848896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.737248:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466848896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1746us total) trans 21474841133 rc 0/0 00000100:00100000:0.0:1746147235.737253:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14396 00000100:00100000:0.0:1746147235.737281:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14397 00000100:00100000:0.0:1746147235.737286:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466848000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.737382:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466848000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1852us total) trans 21474841134 rc 0/0 00000100:00100000:0.0:1746147235.737386:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14397 00000100:00100000:0.0:1746147235.737395:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14398 00000100:00100000:0.0:1746147235.737399:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466847232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147235.737478:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466847232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1934us total) trans 17179873748 rc 0/0 00000100:00100000:0.0:1746147235.737482:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14398 00000100:00100000:0.0:1746147235.737491:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14399 00000100:00100000:0.0:1746147235.737495:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466848512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.737589:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466848512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (2038us total) trans 21474841135 rc 0/0 00000100:00100000:0.0:1746147235.737594:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14399 00000100:00100000:0.0:1746147235.737604:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14401 00000100:00100000:0.0:1746147235.737608:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466848128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147235.737622:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14402 00000100:00100000:0.0:1746147235.737625:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466848640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147235.738116:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147235.738119:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147235.738121:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147235.738123:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147235.738125:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147235.738147:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466848640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 520us (2492us total) trans 21474841137 rc 0/0 00000100:00100000:0.0:1746147235.738151:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14402 00000100:00100000:0.0:1746147235.738213:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841122 gen 2 00000004:00080000:0.0:1746147235.738217:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e1180, transno 21474841058 00000004:00080000:0.0:1746147235.738223:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5d880, transno 21474841059 00000004:00080000:0.0:1746147235.738226:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c55500, transno 21474841060 00000004:00080000:0.0:1746147235.738228:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5ea00, transno 21474841061 00000004:00080000:0.0:1746147235.738230:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a7100, transno 21474841062 00000004:00080000:0.0:1746147235.738232:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5caa00, transno 21474841063 00000004:00080000:0.0:1746147235.738235:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a4a80, transno 21474841064 00000004:00080000:0.0:1746147235.738236:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5ca680, transno 21474841065 00000004:00080000:0.0:1746147235.738238:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4673b80, transno 21474841069 00000004:00080000:0.0:1746147235.738240:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4672a00, transno 21474841070 00000004:00080000:0.0:1746147235.738242:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e0000, transno 21474841071 00000004:00080000:0.0:1746147235.738244:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4672680, transno 21474841072 00000004:00080000:0.0:1746147235.738247:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4671880, transno 21474841073 00000004:00080000:0.0:1746147235.738249:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4671f80, transno 21474841074 00000004:00080000:0.0:1746147235.738251:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4670a80, transno 21474841075 00000004:00080000:0.0:1746147235.738253:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4673480, transno 21474841076 00000004:00080000:0.0:1746147235.738255:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9ff800, transno 21474841077 00000004:00080000:0.0:1746147235.738292:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fea00, transno 21474841078 00000004:00080000:0.0:1746147235.738295:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fce00, transno 21474841079 00000004:00080000:0.0:1746147235.738297:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9ff100, transno 21474841080 00000004:00080000:0.0:1746147235.738299:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fc700, transno 21474841081 00000004:00080000:0.0:1746147235.738301:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fd500, transno 21474841082 00000004:00080000:0.0:1746147235.738304:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fca80, transno 21474841083 00000004:00080000:0.0:1746147235.738305:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fe680, transno 21474841084 00000004:00080000:0.0:1746147235.738308:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090508380, transno 21474841096 00000004:00080000:0.0:1746147235.738310:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050bb80, transno 21474841097 00000004:00080000:0.0:1746147235.738312:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d499500, transno 21474841098 00000004:00080000:0.0:1746147235.738313:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d499880, transno 21474841099 00000004:00080000:0.0:1746147235.738315:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d49b800, transno 21474841100 00000004:00080000:0.0:1746147235.738317:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134febb80, transno 21474841101 00000004:00080000:0.0:1746147235.738319:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498a80, transno 21474841102 00000004:00080000:0.0:1746147235.738321:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d49aa00, transno 21474841103 00000004:00080000:0.0:1746147235.738322:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edf6680, transno 21474841107 00000004:00080000:0.0:1746147235.738324:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edf5180, transno 21474841108 00000004:00080000:0.0:1746147235.738326:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edf5500, transno 21474841109 00000004:00080000:0.0:1746147235.738327:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498000, transno 21474841110 00000004:00080000:0.0:1746147235.738329:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edf7b80, transno 21474841111 00000004:00080000:0.0:1746147235.738331:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1180, transno 21474841112 00000004:00080000:0.0:1746147235.738332:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c0000, transno 21474841113 00000004:00080000:0.0:1746147235.738334:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edf4380, transno 21474841114 00000004:00080000:0.0:1746147235.738336:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1500, transno 21474841115 00000004:00080000:0.0:1746147235.738338:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e50e00, transno 21474841116 00000004:00080000:0.0:1746147235.738339:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e52d80, transno 21474841117 00000004:00080000:0.0:1746147235.738341:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e53100, transno 21474841118 00000004:00080000:0.0:1746147235.738343:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e51c00, transno 21474841119 00000004:00080000:0.0:1746147235.738345:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e50700, transno 21474841120 00000004:00080000:0.0:1746147235.738347:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e52a00, transno 21474841121 00000004:00080000:0.0:1746147235.738348:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e51180, transno 21474841122 00000100:00100000:0.0:1746147235.738353:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008e974a80 x1830967466848000/t21474841134(21474841134) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147251 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147235.738360:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974a80/2, rc 0, transno 21474841134 00000100:00100000:0.0:1746147235.738364:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147235.738375:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974380/2, rc 0, transno 21474841135 00000100:00100000:0.0:1746147235.738377:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147235.738384:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f66ad80/2, rc 0, transno 17179873746 00000100:00100000:0.0:1746147235.738387:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466847360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147235.738393:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f66bb80/2, rc 0, transno 17179873747 00000100:00100000:0.0:1746147235.738395:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466847872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147235.738402:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974e00/2, rc 0, transno 21474841132 00000100:00100000:0.0:1746147235.738405:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147235.738411:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0ca80/2, rc 0, transno 21474841133 00000100:00100000:0.0:1746147235.738413:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466848896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147235.738624:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 48 done 00000100:00100000:0.0:1746147235.738726:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466848128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1117us (3090us total) trans 21474841139 rc 0/0 00000100:00100000:0.0:1746147235.738732:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14401 00000100:00100000:0.0:1746147235.741483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.751775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.772746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.772835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.778006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.778038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.778070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.779553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.779565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.779576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.779602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.779615:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465228800 00000100:00100000:0.0:1746147235.779617:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465228800 00000100:00100000:0.0:1746147235.779631:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465228928 00000100:00100000:0.0:1746147235.779633:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465228928 00000100:00100000:0.0:1746147235.779640:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465229056 00000100:00100000:0.0:1746147235.779641:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465229056 00000100:00100000:0.0:1746147235.779648:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465229184 00000100:00100000:0.0:1746147235.779649:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465229184 00000100:00100000:0.0:1746147235.779657:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465229312 00000100:00100000:0.0:1746147235.779658:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465229312 00000100:00100000:0.0:1746147235.779666:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14408 00000100:00100000:0.0:1746147235.779671:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1957:x1830967465228800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.779677:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.779685:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130711600/0xb4b2209fbdace016 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eae6f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.779698:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417a2, atime: 0x681417a2, ctime: 0x681417a2, blocks: 0x81d 00010000:00010000:0.0:1746147235.779706:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.779707:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.779712:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130711600/0xb4b2209fbdace016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae6f expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.779721:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130711600/0xb4b2209fbdace016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae6f expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.779727:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130711600, rc 0) 00000100:00100000:0.0:1746147235.779746:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465228800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.779753:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14408 00000100:00100000:0.0:1746147235.779763:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14409 00000100:00100000:0.0:1746147235.779767:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1957:x1830967465228928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.779771:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.779777:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130711000/0xb4b2209fbdace01d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eae76 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.779785:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417a2, atime: 0x681417a0, ctime: 0x681417a2, blocks: 0x81d 00010000:00010000:0.0:1746147235.779791:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.779792:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.779796:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130711000/0xb4b2209fbdace01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae76 expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.779803:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130711000/0xb4b2209fbdace01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae76 expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.779809:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130711000, rc 0) 00000100:00100000:0.0:1746147235.779820:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465228928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 54us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.779824:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14409 00000100:00100000:0.0:1746147235.779831:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14411 00000100:00100000:0.0:1746147235.779835:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465229184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.779839:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.779844:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130710800/0xb4b2209fbdace02b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eae84 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147235.779857:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4939808, mtime: 0x681417a3, atime: 0x681417a3, ctime: 0x681417a3, blocks: 0x15ff 00010000:00010000:0.0:1746147235.779862:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.779863:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.779866:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130710800/0xb4b2209fbdace02b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae84 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.779873:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130710800/0xb4b2209fbdace02b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae84 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.779879:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130710800, rc 0) 00000100:00100000:0.0:1746147235.779889:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465229184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.779892:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14411 00000100:00100000:0.0:1746147235.783753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.783789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.783832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.783893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.783925:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465229824 00000100:00100000:0.0:1746147235.783932:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465229824 00000100:00100000:0.0:1746147235.784606:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11183 00000100:00100000:0.0:1746147235.784613:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31225:x1830967465229824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.784622:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.784628:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace040 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eae99 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.784680:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.784688:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f00a000/0xb4b2209fbdace00f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147235.784694:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.785914:0:16361:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f00a000/0xb4b2209fbdace00f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147235.785928:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.791254:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.791271:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147235.791316:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9134112 00000004:00200000:0.0:1746147235.791320:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147235.791336:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.791366:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace040 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae99 expref: 305 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.791390:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae99 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.791397:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147235.791400:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147235.791403:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130710600, rc 0) 00000100:00100000:0.0:1746147235.791441:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31225:x1830967465229824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6828us (7652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.791448:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11183 00000100:00100000:0.0:1746147235.795821:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465230336 00000100:00100000:0.0:1746147235.795833:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465230336 00000100:00100000:0.0:1746147235.796015:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14413 00000100:00100000:0.0:1746147235.796026:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465230336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.796048:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.796070:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130710400/0xb4b2209fbdace055 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaea7 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.796095:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.796097:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.796108:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130710400/0xb4b2209fbdace055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaea7 expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.796125:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130710400/0xb4b2209fbdace055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaea7 expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.796137:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130710400, rc 0) 00000100:00100000:0.0:1746147235.796195:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465230336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 170us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.796202:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14413 00000100:00100000:0.0:1746147235.805525:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465230720 00000100:00100000:0.0:1746147235.805530:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465230720 00000100:00100000:0.0:1746147235.805572:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14416 00000100:00100000:0.0:1746147235.805578:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465230720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.805591:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.805603:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130710200/0xb4b2209fbdace06a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaebc expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.805621:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.805622:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.805628:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130710200/0xb4b2209fbdace06a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaebc expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.805639:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130710200/0xb4b2209fbdace06a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaebc expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.805647:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130710200, rc 0) 00000100:00100000:0.0:1746147235.805676:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465230720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 98us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.805681:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14416 00000100:00100000:0.0:1746147235.805691:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465230976 00000100:00100000:0.0:1746147235.805694:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465230976 00000100:00100000:0.0:1746147235.805890:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14418 00000100:00100000:0.0:1746147235.805896:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967465230976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147235.805902:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.805910:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130711400/0xb4b2209fbdace078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaeca expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.805927:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.805928:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147235.805932:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130711400/0xb4b2209fbdace078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaeca expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.805960:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130711400/0xb4b2209fbdace078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaeca expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147235.805967:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130711400, rc 0) 00000100:00100000:0.0:1746147235.808107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.810857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.810920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.812311:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465230976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6404us (6648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.812323:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14418 00000100:00100000:0.0:1746147235.815142:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6712 00000100:00100000:0.0:1746147235.815151:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465231744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.829485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.829524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.829569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.830177:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6714 00000100:00100000:0.0:1746147235.830184:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967465232512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.833917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.834877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.834905:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465233280 00000100:00100000:0.0:1746147235.834914:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465233280 00000100:00100000:0.0:1746147235.834973:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11184 00000100:00100000:0.0:1746147235.834980:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31221:x1830967465233280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147235.835003:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147235.835006:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746147235.835031:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130710600/0xb4b2209fbdace047 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae99 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835053:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63de00/0xb4b2209fbdacdffa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae61 expref: 303 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835063:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147235.835067:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147235.835076:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130711a00/0xb4b2209fbdace07f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaed1 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835125:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.835135:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f00ac00/0xb4b2209fbdacdf9f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae4c expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835142:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e400/0xb4b2209fbdace039 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaea0 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835147:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.835172:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e400/0xb4b2209fbdace039 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaea0 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835181:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e400/0xb4b2209fbdace039 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaea0 expref: 8 pid: 23726 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.835196:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466849408:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.835273:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f00ac00/0xb4b2209fbdacdf9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae4c expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.835287:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f00ac00/0xb4b2209fbdacdf9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae4c expref: 8 pid: 14048 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.835294:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f732680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466849536:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147235.835309:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e707e40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147235.845380:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e400/0xb4b2209fbdace039 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaea0 expref: 8 pid: 23726 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.845398:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466849408:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.845407:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f00ac00/0xb4b2209fbdacdf9f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae4c expref: 8 pid: 14048 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746147235.845415:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f732680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466849536:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147235.845434:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.845441:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147235.845446:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000040:00080000:0.0:1746147235.846690:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3222, 88 off269008 00000004:00080000:0.0:1746147235.846699:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622833760925ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.846768:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3241, 88 off270688 00000004:00080000:0.0:1746147235.846773:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622833836045ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.846849:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3242, 88 off270776 00000004:00080000:0.0:1746147235.846854:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622833917140ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.846877:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3223, 88 off269096 00000004:00080000:0.0:1746147235.846881:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622833944085ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.846892:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3224, 88 off269184 00000004:00080000:0.0:1746147235.846895:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622833958150ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.846904:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3243, 88 off270864 00000004:00080000:0.0:1746147235.846907:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622833970160ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.846927:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3244, 88 off270952 00000004:00080000:0.0:1746147235.846932:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622833994253ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.846982:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3245, 88 off271040 00000004:00080000:0.0:1746147235.846987:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622834049626ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.847007:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3225, 88 off269272 00000004:00080000:0.0:1746147235.847011:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622834074033ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.847021:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3246, 88 off271128 00000004:00080000:0.0:1746147235.847024:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622834086703ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.847042:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3226, 88 off269360 00000004:00080000:0.0:1746147235.847046:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622834109040ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.847056:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3247, 88 off271216 00000004:00080000:0.0:1746147235.847061:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622834123286ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147235.847080:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3227, 88 off269448 00000004:00080000:0.0:1746147235.847085:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622834147329ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.847094:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3228, 88 off269536 00000004:00080000:0.0:1746147235.847098:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622834160610ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.853591:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3229, 88 off269624 00000004:00080000:0.0:1746147235.853604:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622840665831ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.853647:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3230, 88 off269712 00000004:00080000:0.0:1746147235.853651:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622840713239ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147235.853670:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3248, 88 off271304 00000004:00080000:0.0:1746147235.853674:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622840736774ns, next at 607576201812ns, rc = 0 00000100:00100000:0.0:1746147235.853884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.886856:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465233024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 51306us (52946us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147235.886866:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6716 00002000:00100000:0.0:1746147235.886875:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009f730e00 x1830967465233024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:611/0 lens 488/440 e 0 to 0 dl 1746147246 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.886883:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967465233024 ext(1048576->2097151) 00002000:00010000:0.0:1746147235.886888:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f730e00 00010000:00010000:0.0:1746147235.901611:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901622:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147235.901625:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147235.901628:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86e400/0xb4b2209fbdace08d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed8 expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901637:0:16361:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86e400/0xb4b2209fbdace08d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed8 expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901642:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86e400/0xb4b2209fbdace08d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed8 expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901653:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63de00/0xb4b2209fbdace094 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaedf expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901658:0:16361:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63de00/0xb4b2209fbdace094 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaedf expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901662:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63de00/0xb4b2209fbdace094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaedf expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.901689:0:16361:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63de00/0xb4b2209fbdace094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaedf expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.901699:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466849792:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147235.901765:0:16361:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86e400/0xb4b2209fbdace08d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed8 expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147235.901770:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466850688:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147235.901783:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147235.901887:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466849920 00000100:00100000:0.0:1746147235.901892:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466849920 00000100:00100000:0.0:1746147235.901919:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466850432 00000100:00100000:0.0:1746147235.901921:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466850432 00000100:00100000:0.0:1746147235.901931:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466851072 00000100:00100000:0.0:1746147235.901933:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466851072 00000100:00100000:0.0:1746147235.901973:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466851584 00000100:00100000:0.0:1746147235.901976:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466851584 00000100:00100000:0.0:1746147235.901991:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14419 00000100:00100000:0.0:1746147235.901997:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3294:x1830967466849920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147235.902132:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147235.902135:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147235 -> 1746147235 00002000:00010000:0.0:1746147235.902137:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147235 -> 1746147235 00002000:00010000:0.0:1746147235.902138:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147235 -> 1746147235 00002000:00010000:0.0:1746147235.902140:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147235.902180:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466849920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (332us total) trans 17179873752 rc 0/0 00000100:00100000:0.0:1746147235.902187:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14419 00000100:00100000:0.0:1746147235.902199:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14421 00000100:00100000:0.0:1746147235.902204:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967466851072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147235.902301:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147235.902303:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902305:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147232 -> 1746147232 00002000:00010000:0.0:1746147235.902307:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902308:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147235.902329:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466851072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (407us total) trans 21474841140 rc 0/0 00000100:00100000:0.0:1746147235.902334:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14421 00000100:00100000:0.0:1746147235.902343:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14423 00000100:00100000:0.0:1746147235.902347:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466849664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147235.902413:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147235.902415:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902417:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147232 -> 1746147232 00002000:00010000:0.0:1746147235.902418:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902420:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1973 -> 1973 00000100:00100000:0.0:1746147235.902441:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466849664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (446us total) trans 17179873754 rc 0/0 00000100:00100000:0.0:1746147235.902446:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14423 00000100:00100000:0.0:1746147235.902457:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14425 00000100:00100000:0.0:1746147235.902462:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967466850944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147235.902530:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147235.902533:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902534:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902536:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147234 -> 1746147234 00002000:00010000:0.0:1746147235.902537:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147235.902558:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466850944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (520us total) trans 21474841142 rc 0/0 00000100:00100000:0.0:1746147235.902562:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14425 00000100:00100000:0.0:1746147235.906819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.906847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.906879:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466849792:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147235.906887:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466850688:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147235.906913:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130711a00/0xb4b2209fbdace07f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 303 pid: 16361 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147235.906928:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 302 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147235.906965:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130710a00, rc 0) 00000100:00100000:0.0:1746147235.906990:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31221:x1830967465233280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 72011us (72114us total) trans 8589945111 rc 0/0 00000100:00100000:0.0:1746147235.906999:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11184 00000100:00100000:0.0:1746147235.917813:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465234176 00000100:00100000:0.0:1746147235.917820:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465234176 00000100:00100000:0.0:1746147235.917865:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4602 00000100:00100000:0.0:1746147235.917872:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31221:x1830967465234176:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:0.0:1746147235.918009:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31221:x1830967465234176:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 136us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147235.918015:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4602 00000100:00100000:0.0:1746147235.918991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.919408:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465234432 00000100:00100000:0.0:1746147235.919411:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465234432 00002000:00100000:0.0:1746147235.919446:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800949c9180 x1830967465234432/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:611/0 lens 488/0 e 0 to 0 dl 1746147246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147235.919455:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949c9180 with x1830967465234432 ext(1048576->2097151) 00002000:00010000:0.0:1746147235.919459:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949c9180 00000100:00100000:0.0:1746147235.919472:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6717 00000100:00100000:0.0:1746147235.919477:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465234432:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147235.934455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.937327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.942460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.947542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.951877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.958452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.960089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.962466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.966059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.984716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.986381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147235.990000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.006205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.011186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.013369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.018390:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465237248:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 11963us (12186us total) trans 17179873761 rc 0/0 00000100:00100000:0.0:1746147236.018401:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2363 00002000:00100000:0.0:1746147236.018412:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2985984->3145727) req@ffff8800949cbb80 x1830967465237248/t17179873761(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/448 e 0 to 0 dl 1746147247 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.018422:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949cbb80 with x1830967465237248 ext(2985984->3145727) 00010000:00010000:0.0:1746147236.018432:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095370400/0xb4b2209fbdace09b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaee6 expref: 28 pid: 4445 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746147236.018446:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095370400/0xb4b2209fbdace09b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaee6 expref: 28 pid: 4445 timeout: 723 lvb_type: 0 00002000:00010000:0.0:1746147236.018453:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949cbb80 00000100:00100000:0.0:1746147236.029055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.029113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.032106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.040844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.040896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.052309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.055440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.056739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.088655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.095204:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466853504:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147236.095332:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465239552 00000100:00100000:0.0:1746147236.095338:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465239552 00002000:00100000:0.0:1746147236.095381:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e977100 x1830967465239552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.095391:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977100 with x1830967465239552 ext(2097152->3145727) 00002000:00010000:0.0:1746147236.095395:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977100 00000100:00100000:0.0:1746147236.099655:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466853632:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147236.099686:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147236.099742:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465239296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10638us (11093us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147236.099758:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7287 00000100:00100000:0.0:1746147236.105380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.105421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.105440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.105470:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465239936 00000100:00100000:0.0:1746147236.105478:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465239936 00002000:00100000:0.0:1746147236.105514:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012d0dca80 x1830967465239936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.105521:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0dca80 with x1830967465239936 ext(2097152->3145727) 00002000:00010000:0.0:1746147236.105526:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0dca80 00000100:00100000:0.0:1746147236.105548:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465240448 00000100:00100000:0.0:1746147236.105550:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465240448 00002000:00100000:0.0:1746147236.105581:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3559424->4194303) req@ffff88012d0dd180 x1830967465240448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.105588:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0dd180 with x1830967465240448 ext(3559424->4194303) 00002000:00010000:0.0:1746147236.105591:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0dd180 00000100:00100000:0.0:1746147236.105600:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6728 00000100:00100000:0.0:1746147236.105606:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465240448:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147236.106752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.124883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.141122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.152137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.157482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.157521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.157549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.157731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.157893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.159379:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6734 00000100:00100000:0.0:1746147236.159387:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465242240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147236.197987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.204147:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.207171:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14447 00000100:00100000:0.0:1746147236.207179:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31224:x1830967465243392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147236.207186:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147236.207193:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d59d800/0xb4b2209fbdace12e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaf41 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.207203:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147236.207208:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59d800/0xb4b2209fbdace12e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf41 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.207215:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d59d800/0xb4b2209fbdace12e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf41 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.207222:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59d800, rc 0) 00000100:00100000:0.0:1746147236.207241:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31224:x1830967465243392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147236.207246:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14447 00000100:00100000:0.0:1746147236.230741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.240070:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.246534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.246613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.256568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.269249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.269439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.269486:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465244928 00000100:00100000:0.0:1746147236.269491:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465244928 00002000:00100000:0.0:1746147236.269521:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008dc04e00 x1830967465244928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.269530:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dc04e00 with x1830967465244928 ext(3145728->4194303) 00002000:00010000:0.0:1746147236.269534:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dc04e00 00000100:00100000:0.0:1746147236.269555:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465245184 00000100:00100000:0.0:1746147236.269557:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465245184 00002000:00100000:0.0:1746147236.269565:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008dc05180 x1830967465245184/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.269576:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dc05180 with x1830967465245184 ext(3145728->4194303) 00002000:00010000:0.0:1746147236.269579:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dc05180 00000100:00100000:0.0:1746147236.269587:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6735 00000100:00100000:0.0:1746147236.269592:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465244928:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147236.299519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.301387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.321048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.330764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.379672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.385263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.390604:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465246976 00000100:00100000:0.0:1746147236.390609:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465246976 00010000:00010000:0.0:1746147236.390635:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72fa00/0xb4b2209fbdace024 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae7d expref: 15 pid: 8481 timeout: 723 lvb_type: 1 00000100:00100000:0.0:1746147236.390658:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7294 00000100:00100000:0.0:1746147236.390663:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465246976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147236.390672:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147236.390689:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72fa00/0xb4b2209fbdace024 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae7d expref: 15 pid: 8481 timeout: 723 lvb_type: 1 00010000:00010000:0.0:1746147236.390697:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72fa00/0xb4b2209fbdace024 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae7d expref: 15 pid: 8481 timeout: 723 lvb_type: 1 00010000:00010000:0.0:1746147236.390713:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72fa00/0xb4b2209fbdace024 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae7d expref: 15 pid: 8481 timeout: 723 lvb_type: 1 00010000:00010000:0.0:1746147236.390725:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147236.390743:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465246976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147236.390750:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7294 00000100:00100000:0.0:1746147236.392068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.398027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.410604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.414539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.423405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.437693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.451049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.458237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.461132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.470316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.470352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.472264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.476106:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465249920 00000100:00100000:0.0:1746147236.476114:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465249920 00002000:00100000:0.0:1746147236.476311:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008e975180 x1830967465249920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.476320:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975180 with x1830967465249920 ext(0->1048575) 00002000:00010000:0.0:1746147236.476324:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975180 00000100:00100000:0.0:1746147236.476353:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6743 00000100:00100000:0.0:1746147236.476359:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465249920:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147236.487444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.487484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.495591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.495633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.495686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.500580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.507783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.507818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.509424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.516224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.521829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.525395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.539631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.546638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.546689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.562697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.571315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.571363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.580242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.593478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.600008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.600045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.600920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.609323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.628000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.630352:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.634287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.650922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.651485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.663592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.668349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.669180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.670438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.670469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.680606:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465256704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9882us (10135us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147236.680614:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6755 00002000:00100000:0.0:1746147236.680620:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8801307ee680 x1830967465256704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/440 e 0 to 0 dl 1746147247 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.680628:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ee680 with x1830967465256704 ext(2097152->3145727) 00002000:00010000:0.0:1746147236.680632:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307ee680 00000100:00100000:0.0:1746147236.680889:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465257984 00000100:00100000:0.0:1746147236.680893:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465257984 00002000:00100000:0.0:1746147236.680912:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1343488->1347583) req@ffff88009b209180 x1830967465257984/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.680919:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209180 with x1830967465257984 ext(1343488->1347583) 00002000:00010000:0.0:1746147236.680922:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b209180 00000100:00100000:0.0:1746147236.680957:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6756 00000100:00100000:0.0:1746147236.680962:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465257984:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147236.681066:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465257984:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 103us (310us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147236.681071:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6756 00002000:00100000:0.0:1746147236.681075:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1343488->1347583) req@ffff88009b209180 x1830967465257984/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:612/0 lens 488/4536 e 0 to 0 dl 1746147247 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.681085:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209180 with x1830967465257984 ext(1343488->1347583) 00002000:00010000:0.0:1746147236.681088:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b209180 00000100:00100000:0.0:1746147236.684202:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465256832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13494us (13761us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147236.684212:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6754 00002000:00100000:0.0:1746147236.684221:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8801307eca80 x1830967465256832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/440 e 0 to 0 dl 1746147247 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.684229:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307eca80 with x1830967465256832 ext(3145728->4194303) 00002000:00010000:0.0:1746147236.684234:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307eca80 00000100:00100000:0.0:1746147236.684556:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465258240 00000100:00100000:0.0:1746147236.684562:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465258240 00000100:00100000:0.0:1746147236.687130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.690606:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465258496 00000100:00100000:0.0:1746147236.690611:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465258496 00000100:00100000:0.0:1746147236.690651:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14464 00000100:00100000:0.0:1746147236.690658:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465258496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147236.690670:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147236.690681:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1200/0xb4b2209fbdace246 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eafdb expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147236.690717:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466858880:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147236.690774:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147236.692276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.695357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.696551:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.709488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.717410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.731196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.800426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.807128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.807161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.810975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.811006:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465260416 00000100:00100000:0.0:1746147236.811011:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465260416 00000100:00100000:0.0:1746147236.811040:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11194 00000100:00100000:0.0:1746147236.811046:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31256:x1830967465260416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147236.811063:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147236.811078:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9200/0xb4b2209fbdace262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eaff7 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.811154:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811164:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811172:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811181:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811186:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811190:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811274:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdace277 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811282:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdace277 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811286:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdace277 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147236.811293:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9134112 00010000:00010000:0.0:1746147236.811345:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811351:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811356:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811360:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ef9c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147236.811362:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811367:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811375:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147236.811377:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147236.811380:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811383:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9c00/0xb4b2209fbdace269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811401:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811405:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811409:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811413:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ef8c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147236.811416:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811420:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811426:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76000) 00010000:00010000:0.0:1746147236.811428:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147236.811430:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811434:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8c00/0xb4b2209fbdace270 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147236.811461:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9200/0xb4b2209fbdace262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaff7 expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.811469:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdace277 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaff7 expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.811475:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147236.811478:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147236.811480:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ca200, rc 0) 00000100:00100000:0.0:1746147236.811513:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31256:x1830967465260416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 468us (544us total) trans 8589945129 rc 0/0 00000100:00100000:0.0:1746147236.811518:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11194 00000100:00100000:0.0:1746147236.814907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.815518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.817592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.826401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.827088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.827331:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6761 00000100:00100000:0.0:1746147236.827338:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465261440:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147236.827450:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465261440:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 112us (362us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147236.827455:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6761 00002000:00100000:0.0:1746147236.827460:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (4169728->4173823) req@ffff8800b52e1180 x1830967465261440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/4536 e 0 to 0 dl 1746147247 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.827467:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1180 with x1830967465261440 ext(4169728->4173823) 00002000:00010000:0.0:1746147236.827469:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1180 00000100:00100000:0.0:1746147236.835674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.851016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.856689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.857370:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465261952 00000100:00100000:0.0:1746147236.857374:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465261952 00002000:00100000:0.0:1746147236.857396:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3276800->4173823) req@ffff88008dc05c00 x1830967465261952/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.857410:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dc05c00 with x1830967465261952 ext(3276800->4173823) 00010000:00010000:0.0:1746147236.857416:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95b000/0xb4b2209fbdace25b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3276800->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaff0 expref: 21 pid: 17530 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746147236.857428:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95b000/0xb4b2209fbdace25b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3276800->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaff0 expref: 21 pid: 17530 timeout: 723 lvb_type: 0 00002000:00010000:0.0:1746147236.857434:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dc05c00 00000100:00100000:0.0:1746147236.857448:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2377 00000100:00100000:0.0:1746147236.857455:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465261952:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147236.866025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.867991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.879854:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465261952:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 22389us (22633us total) trans 21474841151 rc 0/0 00000100:00100000:0.0:1746147236.879865:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2377 00002000:00100000:0.0:1746147236.879875:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3276800->4173823) req@ffff88008dc05c00 x1830967465261952/t21474841151(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:612/0 lens 488/448 e 0 to 0 dl 1746147247 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.879884:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dc05c00 with x1830967465261952 ext(3276800->4173823) 00010000:00010000:0.0:1746147236.879893:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95b000/0xb4b2209fbdace25b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3276800->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaff0 expref: 23 pid: 17530 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746147236.879904:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95b000/0xb4b2209fbdace25b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3276800->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaff0 expref: 23 pid: 17530 timeout: 723 lvb_type: 0 00002000:00010000:0.0:1746147236.879914:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dc05c00 00000100:00100000:0.0:1746147236.881407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.882464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.885474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.900712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.900733:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465263360 00000100:00100000:0.0:1746147236.900739:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465263360 00002000:00100000:0.0:1746147236.900769:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e2a00 x1830967465263360/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:612/0 lens 488/0 e 0 to 0 dl 1746147247 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147236.900778:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2a00 with x1830967465263360 ext(3145728->4194303) 00002000:00010000:0.0:1746147236.900782:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2a00 00000100:00100000:0.0:1746147236.900797:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6763 00000100:00100000:0.0:1746147236.900802:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465263360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147236.922447:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.922489:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465264128 00000100:00100000:0.0:1746147236.922496:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465264128 00010000:00010000:0.0:1746147236.923377:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdace21c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eafcd expref: 20 pid: 17530 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746147236.923393:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7310 00000100:00100000:0.0:1746147236.923399:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465264128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147236.923406:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147236.923417:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdace21c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eafcd expref: 20 pid: 17530 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746147236.923431:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdace21c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eafcd expref: 20 pid: 17530 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746147236.923442:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdace21c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eafcd expref: 20 pid: 17530 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746147236.923465:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147236.923466:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147236.923472:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d56000/0xb4b2209fbdace2c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb021 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.923479:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d56000/0xb4b2209fbdace2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb021 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147236.923500:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d56000/0xb4b2209fbdace2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb021 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147236.923509:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466860416:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147236.923699:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147236.932216:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466860416:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147236.932230:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147236.932260:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465264128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8851us (9804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147236.932268:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7310 00000100:00100000:0.0:1746147236.934706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.934782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.935899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.941926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.945604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.945647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.951495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.955061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.959287:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465266176 00000100:00100000:0.0:1746147236.959292:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465266176 00000100:00100000:0.0:1746147236.959379:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4613 00000100:00100000:0.0:1746147236.959386:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31262:x1830967465266176:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147236.959992:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31262:x1830967465266176:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 605us (784us total) trans 8589945133 rc 0/0 00000100:00100000:0.0:1746147236.959999:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4613 00000100:00100000:0.0:1746147236.960390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.961871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.962509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.962548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.965062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.968001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.972175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.972211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.981061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.988191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147236.994057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.001052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.013285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.019555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.022259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.027856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147237.029139:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147237.029235:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465269632 00000100:00100000:0.0:1746147237.029238:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465269632 00000100:00100000:0.0:1746147237.029987:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465269760 00000100:00100000:0.0:1746147237.029990:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465269760 00000100:00100000:0.0:1746147237.030017:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14481 00000100:00100000:0.0:1746147237.030023:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465269632:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147237.030033:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.030047:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdace365 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb075 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.030062:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.030064:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.030069:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdace365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb075 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.030081:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdace365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb075 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.030089:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551ea00, rc 0) 00000100:00100000:0.0:1746147237.030113:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465269632:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 90us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.030118:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14481 00000100:00100000:0.0:1746147237.030130:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14482 00000100:00100000:0.0:1746147237.030134:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465269760:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147237.030141:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.030146:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a551e800/0xb4b2209fbdace36c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb07c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.030482:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466861824:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147237.030801:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14484 00000100:00100000:0.0:1746147237.030807:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465270016:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147237.030813:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.030821:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4aa6600/0xb4b2209fbdace37a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb08a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.030830:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.030832:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.030836:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4aa6600/0xb4b2209fbdace37a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb08a expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.030844:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4aa6600/0xb4b2209fbdace37a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb08a expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.030850:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aa6600, rc 0) 00000100:00100000:0.0:1746147237.030867:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465270016:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.030872:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14484 00000100:00100000:0.0:1746147237.030889:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.034804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.040524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.043439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.047213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.049531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.049657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.052524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.054672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.054710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.054726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.054745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.054815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.055011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.055027:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465271808 00000100:00100000:0.0:1746147237.055030:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465271808 00000100:00100000:0.0:1746147237.055047:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465272064 00000100:00100000:0.0:1746147237.055049:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465272064 00000100:00100000:0.0:1746147237.055060:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14489 00000100:00100000:0.0:1746147237.055065:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465271680:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147237.055093:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b076e00/0xb4b2209fbdace3ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.055109:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdace2ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb02f expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.055116:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147237.055118:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147237.055120:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b076e00/0xb4b2209fbdace3ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.055150:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdace2ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb02f expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.055162:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdace2ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb02f expref: 7 pid: 17548 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.055174:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466862592:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147237.055489:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.057888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147237.059039:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147237.068177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.068187:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465273088 00000100:00100000:0.0:1746147237.068190:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465273088 00010000:00010000:0.0:1746147237.068203:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95ba00/0xb4b2209fbdace28c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb005 expref: 10 pid: 17530 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.068664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.068674:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465273344 00000100:00100000:0.0:1746147237.068676:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465273344 00010000:00010000:0.0:1746147237.068686:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdace365 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb075 expref: 10 pid: 17548 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746147237.068708:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7324 00000100:00100000:0.0:1746147237.068714:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465273344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.068721:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.068729:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdace365 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb075 expref: 10 pid: 17548 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.068741:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdace365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb075 expref: 10 pid: 17548 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.068752:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.068767:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465273344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.068773:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7324 00000100:00100000:0.0:1746147237.068806:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465273600 00000100:00100000:0.0:1746147237.068809:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465273600 00010000:00010000:0.0:1746147237.068819:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdace1b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf80 expref: 9 pid: 17530 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.068833:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7325 00000100:00100000:0.0:1746147237.068838:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465273600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.068844:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.068851:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdace1b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf80 expref: 9 pid: 17530 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.068858:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdace1b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf80 expref: 9 pid: 17530 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.068868:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.068870:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.068874:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f9ac00/0xb4b2209fbdace3f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.068887:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f9ac00/0xb4b2209fbdace3f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.068902:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.068917:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465273600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.068923:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7325 00000100:00100000:0.0:1746147237.068965:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465273472 00000100:00100000:0.0:1746147237.068968:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465273472 00010000:00010000:0.0:1746147237.068985:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee65a00/0xb4b2209fbdacdfec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae68 expref: 19 pid: 4444 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746147237.068998:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7327 00000100:00100000:0.0:1746147237.069003:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465273472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.069010:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.069016:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee65a00/0xb4b2209fbdacdfec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae68 expref: 20 pid: 4444 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.069023:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee65a00/0xb4b2209fbdacdfec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae68 expref: 20 pid: 4444 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.069034:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee65a00/0xb4b2209fbdacdfec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eae68 expref: 20 pid: 4444 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.069046:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.069048:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.069050:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f9a000/0xb4b2209fbdace3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.069056:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f9a000/0xb4b2209fbdace3d5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.069067:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.069077:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465273472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.069082:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7327 00000100:00080000:0.0:1746147237.069095:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147237.078808:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.081844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.088074:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465274624 00000100:00100000:0.0:1746147237.088079:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465274624 00010000:00010000:0.0:1746147237.088098:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc1ee00/0xb4b2209fbdace16d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf5d expref: 316 pid: 16361 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.088114:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7335 00000100:00100000:0.0:1746147237.088120:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1959:x1830967465274624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.088131:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.088135:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc1ee00/0xb4b2209fbdace16d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf5d expref: 316 pid: 16361 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.088144:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc1ee00/0xb4b2209fbdace16d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf5d expref: 316 pid: 16361 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.088161:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc1ee00/0xb4b2209fbdace16d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaf5d expref: 316 pid: 16361 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.088457:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147237.088462:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace3f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147237.088469:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.088498:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1959:x1830967465274624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 378us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.088504:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7335 00000100:00100000:0.0:1746147237.088712:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465275008 00000100:00100000:0.0:1746147237.088716:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465275008 00010000:00010000:0.0:1746147237.088727:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 315 pid: 16361 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.088772:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7336 00000100:00100000:0.0:1746147237.088778:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1956:x1830967465275008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.088785:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.088789:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 315 pid: 16361 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.088798:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 315 pid: 16361 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.088808:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130710a00/0xb4b2209fbdace086 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eaed1 expref: 315 pid: 16361 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.088816:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880134f48000) 00010000:00010000:0.0:1746147237.088819:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace3f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147237.088827:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace3f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147237.088833:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace3f8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147237.089891:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.114510:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466865280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.114533:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.114543:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466865792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.114562:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.114569:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.114580:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.114587:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.114598:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147237.114646:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147237.114649:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147237.114666:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147237.114670:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.114685:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.114692:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.114703:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147237.114900:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e2300/2, rc 0, transno 21474841158 00000100:00100000:0.0:1746147237.114903:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466865280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147237.114970:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e3100/2, rc 0, transno 21474841159 00000100:00100000:0.0:1746147237.114973:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466865792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147237.115083:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2ba680/2, rc 0, transno 17179873771 00000100:00100000:0.0:1746147237.115089:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.115096:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dc06d80/2, rc 0, transno 17179873772 00000100:00100000:0.0:1746147237.115098:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866816:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.115105:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2b9180/2, rc 0, transno 17179873773 00000100:00100000:0.0:1746147237.115108:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.115154:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2b8700/2, rc 0, transno 17179873774 00000100:00100000:0.0:1746147237.115157:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466866688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.115349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:0.0:1746147237.115476:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c0a80/2, rc 0, transno 17179873776 00000100:00100000:0.0:1746147237.115480:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466867072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.115579:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e2d80/2, rc 0, transno 21474841160 00000100:00100000:0.0:1746147237.115582:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466865664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.124716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.124754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.124780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.124794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.124808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.124873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.133059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.135767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.140511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.147233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.150581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.151231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147237.168005:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.168022:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.168426:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.168435:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f72e400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147237.168439:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.168447:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.168466:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.168472:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e400/0xb4b2209fbdace453 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.168539:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465277056:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 23918us (24038us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147237.168549:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6776 00000100:00100000:0.0:1746147237.187886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.189744:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465278848 00000100:00100000:0.0:1746147237.189747:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465278848 00000100:00100000:0.0:1746147237.189818:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14519 00000100:00100000:0.0:1746147237.189825:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465278976:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147237.189922:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4939808 -> 4939808 00002000:00010000:0.0:1746147237.189925:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.189927:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.189929:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.189931:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5631 -> 5631 00000100:00100000:0.0:1746147237.189978:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465278976:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 154us (321us total) trans 17179873777 rc 0/0 00000100:00100000:0.0:1746147237.189983:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14519 00000100:00100000:0.0:1746147237.192122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.195207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147237.195623:0:16157:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdace47d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147237.195632:0:16157:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdace47d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00000040:00080000:0.0:1746147237.196882:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3241, 88 off270688 00000004:00080000:0.0:1746147237.196890:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624183951985ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.198098:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3257, 88 off272096 00000004:00080000:0.0:1746147237.198112:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185174191ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.198132:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3258, 88 off272184 00000004:00080000:0.0:1746147237.198135:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185197741ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.198147:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3242, 88 off270776 00000004:00080000:0.0:1746147237.198150:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624185212856ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.198156:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3243, 88 off270864 00000004:00080000:0.0:1746147237.198159:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624185221679ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.198165:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3259, 88 off272272 00000004:00080000:0.0:1746147237.198167:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185229899ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.198173:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3260, 88 off272360 00000004:00080000:0.0:1746147237.198175:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185238024ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.198181:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3261, 88 off272448 00000004:00080000:0.0:1746147237.198184:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185246544ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.198671:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3244, 88 off270952 00000004:00080000:0.0:1746147237.198676:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624185738273ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.198685:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3262, 88 off272536 00000004:00080000:0.0:1746147237.198688:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185750516ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.198704:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3245, 88 off271040 00000004:00080000:0.0:1746147237.198707:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624185769781ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.198714:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3263, 88 off272624 00000004:00080000:0.0:1746147237.198716:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624185778823ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147237.199539:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3246, 88 off271128 00000004:00080000:0.0:1746147237.199554:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624186616446ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.199583:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3247, 88 off271216 00000004:00080000:0.0:1746147237.199587:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624186649244ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.199594:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3248, 88 off271304 00000004:00080000:0.0:1746147237.199596:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624186659040ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.199617:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3249, 88 off271392 00000004:00080000:0.0:1746147237.199620:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624186682472ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147237.199630:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3264, 88 off272712 00000004:00080000:0.0:1746147237.199633:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624186695466ns, next at 607576201812ns, rc = 0 00000100:00100000:0.0:1746147237.221514:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466867328 00000100:00100000:0.0:1746147237.221520:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466867328 00000100:00100000:0.0:1746147237.221565:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14523 00000100:00100000:0.0:1746147237.221572:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830967466867328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147237.222925:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147237.222928:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.222930:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.222932:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.222934:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147237.223680:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967466867328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2107us (2643us total) trans 21474841165 rc 0/0 00000100:00100000:0.0:1746147237.223687:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14523 00000100:00100000:0.0:1746147237.223701:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14529 00000100:00100000:0.0:1746147237.223707:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967466868480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147237.223781:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147237.223784:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.223785:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.223787:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.223789:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147237.223808:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3295:x1830967466868480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1402us total) trans 17179873782 rc 0/0 00000100:00100000:0.0:1746147237.223813:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14529 00000100:00100000:0.0:1746147237.223870:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14531 00000100:00100000:0.0:1746147237.223876:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466867584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147237.223962:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147237.223964:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.223966:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.223968:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.223969:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147237.223991:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967466867584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (1529us total) trans 21474841168 rc 0/0 00000100:00100000:0.0:1746147237.223996:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14531 00000100:00100000:0.0:1746147237.224005:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14532 00000100:00100000:0.0:1746147237.224010:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466868096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.224077:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967466868096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1592us total) trans 21474841169 rc 0/0 00000100:00100000:0.0:1746147237.224083:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14532 00000100:00100000:0.0:1746147237.224092:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14533 00000100:00100000:0.0:1746147237.224096:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466868608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147237.224155:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4939808 -> 4939808 00002000:00010000:0.0:1746147237.224157:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.224159:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.224161:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.224163:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5631 -> 5631 00000100:00100000:0.0:1746147237.224178:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3293:x1830967466868608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1677us total) trans 17179873784 rc 0/0 00000100:00100000:0.0:1746147237.224182:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14533 00000100:00100000:0.0:1746147237.224191:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14534 00000100:00100000:0.0:1746147237.224195:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466869120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.224276:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3293:x1830967466869120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1757us total) trans 17179873785 rc 0/0 00000100:00100000:0.0:1746147237.224281:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14534 00000100:00100000:0.0:1746147237.224289:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14535 00000100:00100000:0.0:1746147237.224293:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466867712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.224365:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967466867712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1814us total) trans 21474841170 rc 0/0 00000100:00100000:0.0:1746147237.224369:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14535 00000100:00100000:0.0:1746147237.224377:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14536 00000100:00100000:0.0:1746147237.224382:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466868224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.224447:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967466868224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1151us total) trans 21474841171 rc 0/0 00000100:00100000:0.0:1746147237.224451:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14536 00000100:00100000:0.0:1746147237.224462:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14537 00000100:00100000:0.0:1746147237.224465:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466868736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.224538:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3293:x1830967466868736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1207us total) trans 17179873786 rc 0/0 00000100:00100000:0.0:1746147237.224542:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14537 00000100:00100000:0.0:1746147237.224550:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14538 00000100:00100000:0.0:1746147237.224554:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466869248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.224625:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466869248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1272us total) trans 17179873787 rc 0/0 00000100:00100000:0.0:1746147237.224632:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14538 00000100:00100000:0.0:1746147237.224731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.227437:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465279616 00000100:00100000:0.0:1746147237.227445:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465279616 00000100:00100000:0.0:1746147237.227478:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11206 00000100:00100000:0.0:1746147237.227483:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:31268:x1830967465279616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147237.227499:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.227516:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f800/0xb4b2209fbdace484 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb0f3 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.227561:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f800/0xb4b2209fbdace484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0f3 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.227570:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f800/0xb4b2209fbdace484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0f3 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.227582:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147237.227585:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147237.227587:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86f800, rc 0) 00000100:00100000:0.0:1746147237.227623:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31268:x1830967465279616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 139us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.227628:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11206 00000100:00100000:0.0:1746147237.234267:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465279872 00000100:00100000:0.0:1746147237.234275:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465279872 00000100:00100000:0.0:1746147237.234315:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4619 00000100:00100000:0.0:1746147237.234320:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31268:x1830967465279872:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147237.234818:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31268:x1830967465279872:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 497us (621us total) trans 8589945143 rc 0/0 00000100:00100000:0.0:1746147237.234826:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4619 00000100:00100000:0.0:1746147237.249624:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.254352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.262243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.264902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.274372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.276380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.276584:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465281408 00000100:00100000:0.0:1746147237.276588:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465281408 00000100:00100000:0.0:1746147237.276608:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14541 00000100:00100000:0.0:1746147237.276613:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31280:x1830967465281408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147237.276620:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.276629:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdace510 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb124 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.276643:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.276644:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.276649:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdace510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb124 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.276658:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdace510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb124 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.276665:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e600, rc 0) 00000100:00100000:0.0:1746147237.276878:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31280:x1830967465281408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 263us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.276883:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14541 00000100:00100000:0.0:1746147237.282233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.282265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.282280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.282312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.283223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.283295:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465282048 00000100:00100000:0.0:1746147237.283298:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465282048 00000100:00100000:0.0:1746147237.283319:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11212 00000100:00100000:0.0:1746147237.283323:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31280:x1830967465282048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147237.283340:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.283353:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f600/0xb4b2209fbdace517 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb12b expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.283397:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a000/0xb4b2209fbdace509 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147237.283404:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f600/0xb4b2209fbdace517 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb12b expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.283418:0:14048:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a000/0xb4b2209fbdace509 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147237.283427:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f600/0xb4b2209fbdace517 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb12b expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.283437:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147237.283440:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147237.283442:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b86f600/0xb4b2209fbdace517 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb12b expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.284688:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86f600, rc 0) 00000100:00100000:0.0:1746147237.284874:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31280:x1830967465282048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1549us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.284881:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11212 00000100:00100000:0.0:1746147237.306773:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465282560 00000100:00100000:0.0:1746147237.306780:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465282560 00000100:00100000:0.0:1746147237.306810:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14542 00000100:00100000:0.0:1746147237.306816:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31281:x1830967465282560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147237.306829:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.306842:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943b4400/0xb4b2209fbdace525 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb139 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.306860:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.306861:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.306867:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943b4400/0xb4b2209fbdace525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb139 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.306879:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943b4400/0xb4b2209fbdace525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb139 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.306887:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943b4400, rc 0) 00000100:00100000:0.0:1746147237.306928:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31281:x1830967465282560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 111us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.306933:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14542 00000001:00080000:0.0:1746147237.308393:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945143 is committed 00000001:00080000:0.0:1746147237.308402:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945148 is committed 00000004:00080000:0.0:1746147237.308406:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2400 committed 00000004:00080000:0.0:1746147237.308411:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2382 committed 00000004:00080000:0.0:1746147237.308415:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2381 committed 00000004:00080000:0.0:1746147237.308417:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2380 committed 00000004:00080000:0.0:1746147237.308418:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2379 committed 00000004:00080000:0.0:1746147237.308419:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2399 committed 00000004:00080000:0.0:1746147237.308421:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2378 committed 00000004:00080000:0.0:1746147237.308422:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2398 committed 00000004:00080000:0.0:1746147237.308423:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2377 committed 00000004:00080000:0.0:1746147237.308425:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2397 committed 00000004:00080000:0.0:1746147237.308426:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2396 committed 00000004:00080000:0.0:1746147237.308427:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2395 committed 00000004:00080000:0.0:1746147237.308429:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2376 committed 00000004:00080000:0.0:1746147237.308430:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2375 committed 00000004:00080000:0.0:1746147237.308432:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2394 committed 00000004:00080000:0.0:1746147237.308433:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2393 committed 00000004:00080000:0.0:1746147237.308435:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2374 committed 00000001:00080000:0.0:1746147237.308442:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945146 is committed 00000100:00100000:0.0:1746147237.308767:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134fe9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466870272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.308793:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.308807:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466870784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.308817:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.308829:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.308839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.308860:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.308874:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.308888:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147237.308892:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466870400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.308908:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.308923:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.308950:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.308960:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.308977:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466870400 00000100:00100000:0.0:1746147237.308979:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466870400 00000100:00100000:0.0:1746147237.308986:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466871040 00000100:00100000:0.0:1746147237.308988:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466871040 00000100:00100000:0.0:1746147237.308994:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14543 00000100:00100000:0.0:1746147237.309000:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3293:x1830967466870272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147237.309135:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147237.309138:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.309140:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.309142:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.309144:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147237.309166:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466870272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (371us total) trans 17179873789 rc 0/0 00000100:00100000:0.0:1746147237.309573:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14543 00000100:00100000:0.0:1746147237.309584:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14547 00000100:00100000:0.0:1746147237.309588:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3293:x1830967466871936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147237.309654:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147237.309656:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147237.309658:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147237.309659:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147237.309661:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147237.309678:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466871936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (803us total) trans 21474841173 rc 0/0 00000100:00100000:0.0:1746147237.309683:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14547 00000100:00100000:0.0:1746147237.309690:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14548 00000100:00100000:0.0:1746147237.309694:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967466870656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.309757:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967466870656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (867us total) trans 17179873792 rc 0/0 00000100:00100000:0.0:1746147237.309762:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14548 00000100:00100000:0.0:1746147237.309770:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14550 00000100:00100000:0.0:1746147237.309773:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3295:x1830967466870528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.309842:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3295:x1830967466870528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (914us total) trans 17179873793 rc 0/0 00000100:00100000:0.0:1746147237.309846:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14550 00000100:00100000:0.0:1746147237.309859:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14551 00000100:00100000:0.0:1746147237.309863:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3293:x1830967466871040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147237.309930:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466871040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (993us total) trans 17179873794 rc 0/0 00000100:00100000:0.0:1746147237.309958:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14551 00000100:00100000:0.0:1746147237.310037:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14554 00000100:00100000:0.0:1746147237.310041:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967466871680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.310118:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830967466871680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (1124us total) trans 21474841174 rc 0/0 00000100:00100000:0.0:1746147237.310123:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14554 00000100:00100000:0.0:1746147237.310144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147237.310159:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466872064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.310177:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147237.310197:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fc000/2, rc 0, transno 21474841172 00000100:00100000:0.0:1746147237.310206:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147237.310214:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e983800/2, rc 0, transno 21474841173 00000100:00100000:0.0:1746147237.310216:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147237.310223:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134fe9500/2, rc 0, transno 17179873789 00000100:00100000:0.0:1746147237.310228:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134fe9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466870272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.310382:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134fe9880/2, rc 0, transno 17179873790 00000100:00100000:0.0:1746147237.310386:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466870784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.310398:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134fe8e00/2, rc 0, transno 17179873795 00000100:00100000:0.0:1746147237.310400:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466870400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.310406:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134fe8700/2, rc 0, transno 17179873794 00000100:00100000:0.0:1746147237.310408:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147237.310413:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fdc00/2, rc 0, transno 21474841176 00000100:00100000:0.0:1746147237.310416:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466871552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.310487:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466871296 00000100:00100000:0.0:1746147237.310490:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466871296 00000100:00100000:0.0:1746147237.310503:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14557 00000100:00100000:0.0:1746147237.310507:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967466871296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147237.310570:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147237.310572:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.310573:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.310575:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147236 -> 1746147236 00002000:00010000:0.0:1746147237.310576:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147237.310598:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967466871296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (123us total) trans 21474841178 rc 0/0 00000100:00100000:0.0:1746147237.310603:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14557 00000100:00100000:0.0:1746147237.310610:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466872320 00000100:00100000:0.0:1746147237.310612:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466872320 00000004:00080000:0.0:1746147237.311002:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e980000/2, rc 0, transno 21474841177 00000100:00100000:0.0:1746147237.311005:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466872064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147237.312482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.312561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.313879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.318195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.318230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.318270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.318328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.327303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.330277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.330358:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465283968 00000100:00100000:0.0:1746147237.330364:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465283968 00010000:00010000:0.0:1746147237.330391:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009812b200/0xb4b2209fbdace429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0de expref: 11 pid: 8481 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746147237.330413:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7342 00000100:00100000:0.0:1746147237.330419:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465283968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.330428:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.330444:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009812b200/0xb4b2209fbdace429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0de expref: 11 pid: 8481 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.330457:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009812b200/0xb4b2209fbdace429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0de expref: 11 pid: 8481 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.330478:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009812b200/0xb4b2209fbdace429 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0de expref: 11 pid: 8481 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.330493:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.330495:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.330500:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4841c00/0xb4b2209fbdace533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb147 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.330507:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4841c00/0xb4b2209fbdace533 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb147 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.331173:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4841c00/0xb4b2209fbdace533 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb147 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.331185:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466872576:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147237.331245:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.335971:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466872576:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147237.335985:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.336020:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465283968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5600us (5749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.336029:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7342 00000100:00100000:0.0:1746147237.339901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.346900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.347189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.350113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.352109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.354004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.354083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.355345:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6786 00000100:00100000:0.0:1746147237.355352:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465285248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147237.360084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.360121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.360145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.360165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.360199:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465285760 00000100:00100000:0.0:1746147237.360201:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465285760 00010000:00010000:0.0:1746147237.360211:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a800/0xb4b2209fbdace4fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb116 expref: 22 pid: 8478 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.360221:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7343 00000100:00100000:0.0:1746147237.360226:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465285888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.360235:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.360266:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdace510 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb124 expref: 30 pid: 17548 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.360274:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdace510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb124 expref: 30 pid: 17548 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.360296:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdace510 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb124 expref: 30 pid: 17548 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.360308:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.360323:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465285888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.360329:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7343 00000100:00100000:0.0:1746147237.360340:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7346 00000100:00100000:0.0:1746147237.360344:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465286016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.360350:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.360356:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0c9 expref: 10 pid: 8481 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.360363:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0c9 expref: 10 pid: 8481 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.360373:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0c9 expref: 10 pid: 8481 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746147237.360380:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.360381:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.360384:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.360391:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.360407:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.360415:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4673480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466873344:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147237.360434:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.366090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.373142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.373184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.373922:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465285248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18569us (19919us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147237.373929:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6786 00002000:00100000:0.0:1746147237.373968:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a4673b80 x1830967465285248/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/440 e 0 to 0 dl 1746147248 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.373976:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967465285248 ext(1048576->2097151) 00002000:00010000:0.0:1746147237.373980:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:0.0:1746147237.374753:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.378124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.380767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.380864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.380886:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465287296 00000100:00100000:0.0:1746147237.380893:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465287296 00002000:00100000:0.0:1746147237.380934:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008e91a680 x1830967465287296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:613/0 lens 488/0 e 0 to 0 dl 1746147248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.380965:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a680 with x1830967465287296 ext(1048576->2097151) 00002000:00010000:0.0:1746147237.380970:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e91a680 00000100:00100000:0.0:1746147237.380991:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465287680 00000100:00100000:0.0:1746147237.380993:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465287680 00002000:00100000:0.0:1746147237.381005:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2150400->3145727) req@ffff88008e91b800 x1830967465287680/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/0 e 0 to 0 dl 1746147248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.381010:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b800 with x1830967465287680 ext(2150400->3145727) 00002000:00010000:0.0:1746147237.381013:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91b800 00000100:00100000:0.0:1746147237.381024:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6790 00000100:00100000:0.0:1746147237.381029:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465287296:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147237.394449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.398534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.400211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.403096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.419752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.428741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.435702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.435800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.436545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.447629:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465290880 00000100:00100000:0.0:1746147237.447634:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465290880 00000100:00100000:0.0:1746147237.447681:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14572 00000100:00100000:0.0:1746147237.447688:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465290880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147237.447707:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.447723:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009812a600/0xb4b2209fbdace587 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb1a2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.447747:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.447749:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.447757:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009812a600/0xb4b2209fbdace587 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a2 expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.447776:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009812a600/0xb4b2209fbdace587 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a2 expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.447787:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009812a600, rc 0) 00000100:00100000:0.0:1746147237.447828:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465290880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 140us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.447834:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14572 00000100:00100000:0.0:1746147237.459128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.463234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.463277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.463307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.463378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.463391:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465291520 00000100:00100000:0.0:1746147237.463393:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465291520 00000100:00100000:0.0:1746147237.472560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.475720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.490655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.490675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.490686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.490721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.525407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.534741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.538299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.541915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.543276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.554614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.559746:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.559834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.564715:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465295616 00000100:00100000:0.0:1746147237.564725:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465295616 00000100:00100000:0.0:1746147237.564773:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4627 00000100:00100000:0.0:1746147237.564782:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31286:x1830967465295616:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147237.565847:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:31286:x1830967465295616:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1065us (1249us total) trans 8589945154 rc 0/0 00000100:00100000:0.0:1746147237.565855:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4627 00000100:00100000:0.0:1746147237.611069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.669752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.674549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.692682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.703894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.704394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.707689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.708120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.708152:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.709183:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465297152 00000100:00100000:0.0:1746147237.709187:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465297152 00000100:00100000:0.0:1746147237.709209:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14583 00000100:00100000:0.0:1746147237.709214:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31290:x1830967465297152:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147237.709227:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.709241:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb1fd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.709272:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.709280:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.709287:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.709289:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.709292:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4661247] (req 4194304->4661247) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.709315:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.709326:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.709338:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466876672:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147237.709396:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.709404:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 30 pid: 6881 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.709412:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466876800:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147237.709430:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.718021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.718113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.718162:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466876672:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147237.718174:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466876800:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147237.718207:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4661247] (req 4194304->4661247) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.718226:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b470200, rc 0) 00000100:00100000:0.0:1746147237.718306:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31290:x1830967465297152:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9089us (10151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.718315:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14583 00000100:00100000:0.0:1746147237.718400:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465297280 00000100:00100000:0.0:1746147237.718406:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465297280 00010000:00010000:0.0:1746147237.718430:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.718448:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465297408 00000100:00100000:0.0:1746147237.718450:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465297408 00010000:00010000:0.0:1746147237.718460:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 31 pid: 6881 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.718471:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7358 00000100:00100000:0.0:1746147237.718477:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465297280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.718488:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.718507:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.718517:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.718539:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdace5b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4939776->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1c5 expref: 24 pid: 11147 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.718553:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.718569:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967465297280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.718575:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7358 00000100:00100000:0.0:1746147237.718585:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7359 00000100:00100000:0.0:1746147237.718589:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465297408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.718594:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.718600:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 31 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.718608:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 31 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.718618:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdace595 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1a9 expref: 31 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.718626:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.718628:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.718634:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4661247) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.718642:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4661247) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.718669:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4661247) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.718681:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466876928:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147237.718733:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.725034:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466876928:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147237.725058:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.725831:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465297408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7237us (7714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.725842:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7359 00000100:00100000:0.0:1746147237.726372:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465297664 00000100:00100000:0.0:1746147237.726379:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465297664 00002000:00100000:0.0:1746147237.726413:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4657152->4661247) req@ffff88008e91a300 x1830967465297664/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/0 e 0 to 0 dl 1746147248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.726423:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a300 with x1830967465297664 ext(4657152->4661247) 00002000:00010000:0.0:1746147237.726427:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91a300 00000100:00100000:0.0:1746147237.726452:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6807 00000100:00100000:0.0:1746147237.726457:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465297664:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147237.728657:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465297664:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 2190us (2618us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147237.728668:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6807 00002000:00100000:0.0:1746147237.728679:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4657152->4661247) req@ffff88008e91a300 x1830967465297664/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/4536 e 0 to 0 dl 1746147248 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.728694:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a300 with x1830967465297664 ext(4657152->4661247) 00002000:00010000:0.0:1746147237.728699:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91a300 00000100:00100000:0.0:1746147237.739196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.742145:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.751673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.760166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.768380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.768410:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465298688 00000100:00100000:0.0:1746147237.768418:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465298688 00002000:00100000:0.0:1746147237.768459:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (1007616->1048575) req@ffff88009ee5f100 x1830967465298688/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:613/0 lens 488/0 e 0 to 0 dl 1746147248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.768469:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967465298688 ext(1007616->1048575) 00010000:00010000:0.0:1746147237.768478:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 30 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.768493:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 30 pid: 6881 timeout: 724 lvb_type: 0 00002000:00010000:0.0:1746147237.768500:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee5f100 00000100:00100000:0.0:1746147237.768535:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2384 00000100:00100000:0.0:1746147237.768542:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465298688:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147237.784860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.784893:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465298816 00000100:00100000:0.0:1746147237.784902:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465298816 00010000:00010000:0.0:1746147237.784972:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 32 pid: 6881 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.785007:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7360 00000100:00100000:0.0:1746147237.785016:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465298816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147237.785031:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147237.785052:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 32 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.785065:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 32 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.785088:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdace54f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb163 expref: 32 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.785106:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.785108:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.785116:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdace667 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb219 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.785124:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdace667 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb219 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.785157:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdace667 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb219 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.785170:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466877440:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147237.785934:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.790361:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466877440:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147237.790380:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147237.790435:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465298816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5421us (5586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.790444:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7360 00000100:00100000:0.0:1746147237.822599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.829499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.836322:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466877696:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147237.836366:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e54e000/0xb4b2209fbdace69f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb235 expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.836378:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e54e000/0xb4b2209fbdace69f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb235 expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147237.836393:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e54e000, rc 0) 00000100:00100000:0.0:1746147237.839496:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967465299712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5909us (6235us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147237.839502:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14589 00000100:00100000:0.0:1746147237.861033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.875835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.885505:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465300992 00000100:00100000:0.0:1746147237.885518:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465300992 00000100:00100000:0.0:1746147237.885579:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14591 00000100:00100000:0.0:1746147237.885587:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31300:x1830967465300992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147237.885604:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.885623:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f446a00/0xb4b2209fbdace6ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb243 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.885647:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.885649:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147237.885656:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f446a00/0xb4b2209fbdace6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb243 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.885670:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f446a00/0xb4b2209fbdace6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb243 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.885681:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f446a00, rc 0) 00000100:00100000:0.0:1746147237.885729:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31300:x1830967465300992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 139us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.885735:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14591 00000100:00100000:0.0:1746147237.903469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.922462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.924678:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14592 00000100:00100000:0.0:1746147237.924690:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31292:x1830967465301376:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147237.924710:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.924728:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdace6b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb24a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.924757:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800945e7600/0xb4b2209fbdace613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1ef expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.924765:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147237.924766:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147237.924770:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdace6b4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3321856->4194303] (req 3321856->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb24a expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.924802:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800945e7600/0xb4b2209fbdace613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1ef expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.924813:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800945e7600/0xb4b2209fbdace613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1ef expref: 9 pid: 6881 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746147237.924825:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466878080:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147237.925290:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147237.928982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.929031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.939217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.939255:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465302528 00000100:00100000:0.0:1746147237.939262:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465302528 00002000:00100000:0.0:1746147237.939297:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008d5dfb80 x1830967465302528/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/0 e 0 to 0 dl 1746147248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.939306:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967465302528 ext(2097152->3145727) 00010000:00010000:0.0:1746147237.939316:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800945e7600/0xb4b2209fbdace613 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1ef expref: 12 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.939329:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800945e7600/0xb4b2209fbdace613 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1ef expref: 12 pid: 6881 timeout: 724 lvb_type: 0 00002000:00010000:0.0:1746147237.939336:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dfb80 00000100:00100000:0.0:1746147237.939356:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2387 00000100:00100000:0.0:1746147237.939362:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465302528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147237.949546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.959168:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465303040 00000100:00100000:0.0:1746147237.959182:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465303040 00000100:00100000:0.0:1746147237.959728:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14596 00000100:00100000:0.0:1746147237.959738:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31296:x1830967465303040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147237.959758:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.959774:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdace6d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb266 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.959801:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147237.959803:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147237.959807:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdace6d0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb266 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.959819:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdace6d0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb266 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147237.959828:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0cc00, rc 0) 00000100:00100000:0.0:1746147237.959882:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31296:x1830967465303040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147237.959888:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14596 00000100:00100000:0.0:1746147237.962068:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465302272:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23713us (28502us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147237.962079:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6814 00002000:00100000:0.0:1746147237.962088:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e585500 x1830967465302272/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/440 e 0 to 0 dl 1746147248 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.962104:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585500 with x1830967465302272 ext(3145728->4194303) 00010000:00010000:0.0:1746147237.962112:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4661247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 24 pid: 6881 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746147237.962123:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace62f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4661247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb1fd expref: 24 pid: 6881 timeout: 724 lvb_type: 0 00002000:00010000:0.0:1746147237.962129:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e585500 00000100:00100000:0.0:1746147237.972225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.978749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.978772:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465303424 00000100:00100000:0.0:1746147237.978778:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465303424 00000100:00100000:0.0:1746147237.978826:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11220 00000100:00100000:0.0:1746147237.978833:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31303:x1830967465303424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147237.978853:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147237.978869:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdace6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb26d expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147237.993298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.993402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.995194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147237.999141:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465304320 00000100:00100000:0.0:1746147237.999145:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465304320 00002000:00100000:0.0:1746147237.999250:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880099f68000 x1830967465304320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:613/0 lens 488/0 e 0 to 0 dl 1746147248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147237.999257:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967465304320 ext(2097152->3145727) 00002000:00010000:0.0:1746147237.999261:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:0.0:1746147237.999271:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6816 00000100:00100000:0.0:1746147237.999276:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465304320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147238.007519:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465304576 00000100:00100000:0.0:1746147238.007526:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465304576 00002000:00100000:0.0:1746147238.007581:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5a0e680 x1830967465304576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:614/0 lens 488/0 e 0 to 0 dl 1746147249 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147238.007590:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e680 with x1830967465304576 ext(2097152->3145727) 00002000:00010000:0.0:1746147238.007594:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0e680 00000100:00100000:0.0:1746147238.007622:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6817 00000100:00100000:0.0:1746147238.007628:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465304576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147238.029823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.041997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.042067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147238.044569:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147238.065052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.065082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.065133:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465305344 00000100:00100000:0.0:1746147238.065141:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465305344 00010000:00010000:0.0:1746147238.065177:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66c800/0xb4b2209fbdace6c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb25f expref: 35 pid: 8481 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746147238.065205:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7364 00000100:00100000:0.0:1746147238.065213:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465305344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147238.065227:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147238.065260:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66c800/0xb4b2209fbdace6c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb25f expref: 35 pid: 8481 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.065271:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66c800/0xb4b2209fbdace6c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb25f expref: 35 pid: 8481 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.065296:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147238.065337:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465305344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.065343:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7364 00000100:00100000:0.0:1746147238.099725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.099834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.103871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.109816:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466879232:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.109857:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f63e400/0xb4b2209fbdace70f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb289 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.109878:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e400, rc 0) 00000100:00100000:0.0:1746147238.110001:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31296:x1830967465305728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9862us (10282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.110011:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14600 00000100:00100000:0.0:1746147238.130470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.133513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.133619:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465306752 00000100:00100000:0.0:1746147238.133627:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465306752 00010000:00010000:0.0:1746147238.133659:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdace6b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3321856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb24a expref: 30 pid: 8478 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746147238.133692:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7366 00000100:00100000:0.0:1746147238.133697:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465306752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147238.133709:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147238.133728:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdace6b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3321856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb24a expref: 30 pid: 8478 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.133738:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdace6b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3321856->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb24a expref: 30 pid: 8478 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.133759:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdace6b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3321856->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb24a expref: 30 pid: 8478 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.133777:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.133779:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.133785:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e400/0xb4b2209fbdace70f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb289 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.133793:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e400/0xb4b2209fbdace70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb289 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.133821:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63e400/0xb4b2209fbdace70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb289 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147238.133831:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466879616:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147238.133898:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147238.137853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.139652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.144673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.161495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.166990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.168115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.192357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.193648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.199599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.203147:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465308416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9271us (10793us total) trans 0 rc 749568/749568 00000100:00100000:0.0:1746147238.203159:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6824 00002000:00100000:0.0:1746147238.203170:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4943871) req@ffff8800936dea00 x1830967465308416/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:614/0 lens 488/440 e 0 to 0 dl 1746147249 ref 1 fl Complete:/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147238.203180:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dea00 with x1830967465308416 ext(4194304->4943871) 00002000:00010000:0.0:1746147238.203185:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dea00 00000100:00100000:0.0:1746147238.207920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.214552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.214602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.217821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.219158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.227191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147238.227393:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147238.228412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.244451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.260885:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465310464 00000100:00100000:0.0:1746147238.260893:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465310464 00002000:00100000:0.0:1746147238.260967:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2224128->2228223) req@ffff88009e584380 x1830967465310464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:614/0 lens 488/0 e 0 to 0 dl 1746147249 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147238.260976:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584380 with x1830967465310464 ext(2224128->2228223) 00002000:00010000:0.0:1746147238.260980:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584380 00000100:00100000:0.0:1746147238.260995:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6826 00000100:00100000:0.0:1746147238.261001:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465310464:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147238.261208:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465310464:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 207us (749us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147238.261213:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6826 00002000:00100000:0.0:1746147238.261231:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2224128->2228223) req@ffff88009e584380 x1830967465310464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:614/0 lens 488/4536 e 0 to 0 dl 1746147249 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147238.261238:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584380 with x1830967465310464 ext(2224128->2228223) 00002000:00010000:0.0:1746147238.261256:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584380 00000100:00100000:0.0:1746147238.264519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.280875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.289285:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466880768:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.289311:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147238.298590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147238.299559:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299566:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147238.299611:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9134112 00000004:00200000:0.0:1746147238.299616:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147238.299634:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299645:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299654:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299660:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299666:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299672:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b470200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147238.299675:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299683:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299691:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147238.299693:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147238.299697:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299701:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470200/0xb4b2209fbdace74e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299727:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299732:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299737:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299742:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b470e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147238.299744:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299748:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299755:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f5da100) 00010000:00010000:0.0:1746147238.299757:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147238.299759:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299764:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b470e00/0xb4b2209fbdace755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147238.299798:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b471400/0xb4b2209fbdace747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2c1 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.299811:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace75c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2c1 expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.299817:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147238.299818:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147238.299820:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1200, rc 0) 00000100:00100000:0.0:1746147238.299996:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31308:x1830967465310848:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 16708us (19131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.300002:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11221 00000100:00100000:0.0:1746147238.310391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.311060:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465311488 00000100:00100000:0.0:1746147238.311064:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465311488 00000100:00100000:0.0:1746147238.311095:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14609 00000100:00100000:0.0:1746147238.311100:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465311488:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147238.311108:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147238.311118:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095370600/0xb4b2209fbdace76a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb2cf expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.311130:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.311132:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.311137:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095370600/0xb4b2209fbdace76a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2cf expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.311147:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095370600/0xb4b2209fbdace76a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2cf expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.311155:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370600, rc 0) 00000100:00100000:0.0:1746147238.311175:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465311488:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.311180:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14609 00000100:00100000:0.0:1746147238.311301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.311311:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465311744 00000100:00100000:0.0:1746147238.311313:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465311744 00000100:00100000:0.0:1746147238.311329:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14610 00000100:00100000:0.0:1746147238.311333:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465311744:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147238.311339:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147238.311347:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095370a00/0xb4b2209fbdace771 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb2dd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147238.311383:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466880896:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147238.311453:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147238.312092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.313087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.316133:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466881024:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147238.316153:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdace778 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2d6 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.316161:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdace778 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2d6 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.316472:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a1fa00, rc 0) 00000100:00100000:0.0:1746147238.316562:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465311616:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3279us (4469us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147238.316567:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14611 00000100:00100000:0.0:1746147238.318363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.320410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.322923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.326139:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.333065:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465312768 00000100:00100000:0.0:1746147238.333076:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465312768 00000100:00100000:0.0:1746147238.333122:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465313024 00000100:00100000:0.0:1746147238.333125:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465313024 00000100:00100000:0.0:1746147238.333144:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465313280 00000100:00100000:0.0:1746147238.333146:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465313280 00000100:00100000:0.0:1746147238.333163:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14613 00000100:00100000:0.0:1746147238.333170:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465312768:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147238.333211:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace7b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333228:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdace667 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb219 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333235:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945e7800/0xb4b2209fbdace763 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2c8 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.333250:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e54f000/0xb4b2209fbdace698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb22e expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.333256:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.333258:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.333261:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b470200/0xb4b2209fbdace7b7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333289:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e54f000/0xb4b2209fbdace698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb22e expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.333300:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e54f000/0xb4b2209fbdace698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb22e expref: 32 pid: 6881 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1746147238.333313:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e683100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466881280:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.333392:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800945e7800/0xb4b2209fbdace763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2c8 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.333401:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800945e7800/0xb4b2209fbdace763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2c8 expref: 10 pid: 6881 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1746147238.333409:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466881408:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.333431:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdace667 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb219 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333439:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdace667 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb219 expref: 25 pid: 11147 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746147238.333446:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e680380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466881536:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147238.333457:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147238.333471:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14614 00000100:00100000:0.0:1746147238.333476:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465313024:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147238.333492:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333501:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace41b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0d7 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.333508:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdace556 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb16a expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333513:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4840400/0xb4b2209fbdace53a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb14e expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333519:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.333520:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.333522:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333534:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4840400/0xb4b2209fbdace53a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb14e expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333540:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4840400/0xb4b2209fbdace53a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb14e expref: 12 pid: 21080 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746147238.333547:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e683480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466881664:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.333565:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdace556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb16a expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.333572:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdace556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb16a expref: 29 pid: 6881 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746147238.333578:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466881792:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.333593:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace41b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0d7 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147238.333598:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009812aa00/0xb4b2209fbdace41b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb0d7 expref: 12 pid: 8481 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1746147238.333609:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466881920:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147238.333619:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147238.348725:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e683480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466881664:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147238.348734:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466881792:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147238.348741:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e682680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466881920:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147238.348757:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353474:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353492:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353524:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353531:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353538:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353545:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a1200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147238.353550:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353558:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353574:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.353580:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdace7be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147238.353670:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465313024:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 20189us (21214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.353680:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14614 00000100:00100000:0.0:1746147238.371299:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465314304:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 20159us (20364us total) trans 17179873803 rc 0/0 00000100:00100000:0.0:1746147238.371309:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2393 00002000:00100000:0.0:1746147238.371321:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2228223) req@ffff88012c9f0a80 x1830967465314304/t17179873803(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:614/0 lens 488/448 e 0 to 0 dl 1746147249 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147238.371330:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0a80 with x1830967465314304 ext(2097152->2228223) 00010000:00010000:0.0:1746147238.371338:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdace740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2ba expref: 29 pid: 6881 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.371349:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdace740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2ba expref: 29 pid: 6881 timeout: 725 lvb_type: 0 00002000:00010000:0.0:1746147238.371360:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f0a80 00000100:00100000:0.0:1746147238.376274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.383316:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465315712 00000100:00100000:0.0:1746147238.383325:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465315712 00010000:00010000:0.0:1746147238.383358:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace72b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2a5 expref: 28 pid: 6881 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746147238.383383:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7389 00000100:00100000:0.0:1746147238.383390:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465315712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147238.383404:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147238.383424:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace72b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2a5 expref: 28 pid: 6881 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.383435:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace72b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2a5 expref: 28 pid: 6881 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.383455:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a39800/0xb4b2209fbdace72b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2a5 expref: 28 pid: 6881 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.383471:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.383473:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147238.383477:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdace7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.383485:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdace7d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147238.383510:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147238.383550:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465315712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 161us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.383556:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7389 00000100:00100000:0.0:1746147238.385612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.391871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.392572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.392600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.392616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.392692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.393156:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7392 00000100:00100000:0.0:1746147238.393163:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465316352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147238.393170:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147238.393174:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdace51e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb132 expref: 16 pid: 14047 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.393181:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdace51e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb132 expref: 16 pid: 14047 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.393191:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147238.393194:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4840e00/0xb4b2209fbdace7e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147238.393199:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147238.393212:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465316352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.393221:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7392 00000100:00100000:0.0:1746147238.393233:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7394 00000100:00100000:0.0:1746147238.393237:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1957:x1830967465316608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147238.393255:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147238.393259:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a000/0xb4b2209fbdace509 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb11d expref: 312 pid: 16361 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.393266:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a000/0xb4b2209fbdace509 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb11d expref: 311 pid: 16361 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746147238.393274:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147238.393277:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4840e00/0xb4b2209fbdace7e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147238.393284:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4840e00/0xb4b2209fbdace7e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147238.393290:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4840e00/0xb4b2209fbdace7e1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147238.393304:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147238.393317:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+311:1957:x1830967465316608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147238.393322:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7394 00000004:00080000:0.0:1746147238.433263:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b209500/2, rc 0, transno 17179873813 00000100:00100000:0.0:1746147238.433273:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466886016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147238.447255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.451776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.453728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.454831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.454853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.454880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147238.454955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.477143:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.477192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.483049:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6830 00000100:00100000:0.0:1746147239.483066:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465318656:12345-192.168.203.36@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147239.483110:0:21471:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d50ce00/0xb4b2209fbdace83c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.483124:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.483125:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.483399:0:21471:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d50ce00/0xb4b2209fbdace83c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.483419:0:21471:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d50ce00/0xb4b2209fbdace83c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147239.497757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147239.524865:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.524885:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.524893:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.524901:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f361800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147239.524905:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.524913:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.524932:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.524983:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f361800/0xb4b2209fbdace835 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147239.528830:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465318400:12345-192.168.203.36@tcp:3:mirror_io.0 Request processed in 48860us (49940us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147239.528844:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6829 00000100:00100000:0.0:1746147239.569777:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465319808 00000100:00100000:0.0:1746147239.569789:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465319808 00000100:00100000:0.0:1746147239.569856:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 742 00000100:00100000:0.0:1746147239.569864:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31308:x1830967465319808:12345-192.168.203.36@tcp:103:mirror_io.0 00010000:00010000:0.0:1746147239.569878:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147239.569904:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945e7600/0xb4b2209fbdace7a2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb2f2 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.569950:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147239.569955:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147239.569992:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31308:x1830967465319808:12345-192.168.203.36@tcp:103:mirror_io.0 Request processed in 129us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.569998:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 742 00000100:00100000:0.0:1746147239.572878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.602852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.606387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.615078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.615758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.615786:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465320960 00000100:00100000:0.0:1746147239.615794:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465320960 00000100:00100000:0.0:1746147239.615852:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14642 00000100:00100000:0.0:1746147239.615861:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465320960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147239.615880:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147239.615900:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e0cc00/0xb4b2209fbdace8a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb346 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.615922:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.615924:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.615933:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0cc00/0xb4b2209fbdace8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb346 expref: 33 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147239.615978:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e0cc00/0xb4b2209fbdace8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb346 expref: 33 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147239.615989:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0cc00, rc 0) 00000100:00100000:0.0:1746147239.616029:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465320960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 170us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.616034:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14642 00000100:00100000:0.0:1746147239.616081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.636168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.641908:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465322880 00000100:00100000:0.0:1746147239.641915:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465322880 00002000:00100000:0.0:1746147239.641974:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134c57480 x1830967465322880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:615/0 lens 488/0 e 0 to 0 dl 1746147250 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.641984:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57480 with x1830967465322880 ext(0->1048575) 00002000:00010000:0.0:1746147239.641989:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c57480 00000100:00100000:0.0:1746147239.642003:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465323136 00000100:00100000:0.0:1746147239.642005:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465323136 00002000:00100000:0.0:1746147239.642015:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134c54000 x1830967465323136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:615/0 lens 488/0 e 0 to 0 dl 1746147250 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.642022:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967465323136 ext(1048576->2097151) 00002000:00010000:0.0:1746147239.642025:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:0.0:1746147239.642032:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465323392 00000100:00100000:0.0:1746147239.642033:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465323392 00002000:00100000:0.0:1746147239.642040:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012c9f2680 x1830967465323392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:615/0 lens 488/0 e 0 to 0 dl 1746147250 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.642047:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967465323392 ext(1048576->2097151) 00002000:00010000:0.0:1746147239.642049:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:0.0:1746147239.642058:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6835 00000100:00100000:0.0:1746147239.642065:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465322880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147239.643629:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6836 00000100:00100000:0.0:1746147239.643641:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465323136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147239.644989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.645020:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465323648 00000100:00100000:0.0:1746147239.645026:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465323648 00002000:00100000:0.0:1746147239.645062:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e681500 x1830967465323648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:615/0 lens 488/0 e 0 to 0 dl 1746147250 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.645072:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967465323648 ext(1048576->2097151) 00002000:00010000:0.0:1746147239.645077:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681500 00000100:00100000:0.0:1746147239.645097:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6837 00000100:00100000:0.0:1746147239.645105:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465323392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147239.668544:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465322880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26474us (26678us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147239.668555:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6835 00002000:00100000:0.0:1746147239.668567:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134c57480 x1830967465322880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:615/0 lens 488/440 e 0 to 0 dl 1746147250 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.668576:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57480 with x1830967465322880 ext(0->1048575) 00002000:00010000:0.0:1746147239.668581:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c57480 00000100:00100000:0.0:1746147239.683104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.697015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.697043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.697344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.700820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147239.701029:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147239.701034:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147239.701080:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.701103:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465324672 00000100:00100000:0.0:1746147239.701106:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465324672 00000100:00100000:0.0:1746147239.701136:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11234 00000100:00100000:0.0:1746147239.701141:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31318:x1830967465324672:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147239.701152:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147239.701154:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746147239.703477:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a855de00/0xb4b2209fbdace900 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb37e expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.703520:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a824400/0xb4b2209fbdace8e4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb377 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.703582:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147239.703587:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147239.703600:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54f400/0xb4b2209fbdace92a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb3a8 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.703658:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54e800/0xb4b2209fbdace931 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147239.703669:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f447400/0xb4b2209fbdace7e8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb300 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.703676:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361800/0xb4b2209fbdace907 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb385 expref: 302 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.703681:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54e800/0xb4b2209fbdace931 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147239.703715:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361800/0xb4b2209fbdace907 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb385 expref: 302 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.703726:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361800/0xb4b2209fbdace907 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb385 expref: 302 pid: 16361 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746147239.703740:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466887552:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147239.706786:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f447400/0xb4b2209fbdace7e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb300 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.706806:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f447400/0xb4b2209fbdace7e8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb300 expref: 8 pid: 16361 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746147239.706821:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466887680:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147239.706892:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147239.706966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.707084:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.707114:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465324800 00000100:00100000:0.0:1746147239.707121:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465324800 00000100:00100000:0.0:1746147239.707150:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465324928 00000100:00100000:0.0:1746147239.707152:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465324928 00000100:00100000:0.0:1746147239.707164:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14652 00000100:00100000:0.0:1746147239.707170:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465324800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147239.707184:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147239.707199:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e54fe00/0xb4b2209fbdace938 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb3af expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.707222:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.707224:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.707242:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e54fe00/0xb4b2209fbdace938 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3af expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147239.707255:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e54fe00/0xb4b2209fbdace938 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3af expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147239.707265:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e54fe00, rc 0) 00000100:00100000:0.0:1746147239.707288:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465324800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.707294:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14652 00000100:00100000:0.0:1746147239.707313:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14653 00000100:00100000:0.0:1746147239.707317:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465324928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147239.707322:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147239.707330:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb3b6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.707339:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.707341:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.707344:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3b6 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147239.707352:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3b6 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147239.707362:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e54f600, rc 0) 00000100:00100000:0.0:1746147239.707371:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465324928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.707375:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14653 00000100:00100000:0.0:1746147239.711253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.712298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.712321:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.713319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.754037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.754096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.754114:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465325696 00000100:00100000:0.0:1746147239.754118:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465325696 00000100:00100000:0.0:1746147239.754140:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11237 00000100:00100000:0.0:1746147239.754145:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+301:31316:x1830967465325696:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147239.754156:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147239.754171:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54f000/0xb4b2209fbdace954 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb3cb expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.754217:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54f000/0xb4b2209fbdace954 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3cb expref: 302 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.754241:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e54f000/0xb4b2209fbdace954 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3cb expref: 302 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.754258:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147239.754260:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147239.754264:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e54f000, rc 0) 00000100:00100000:0.0:1746147239.754293:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31316:x1830967465325696:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 149us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.754298:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11237 00000100:00100000:0.0:1746147239.754683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.754724:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465325568 00000100:00100000:0.0:1746147239.754727:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465325568 00000100:00100000:0.0:1746147239.754744:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465325824 00000100:00100000:0.0:1746147239.754745:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465325824 00000100:00100000:0.0:1746147239.754760:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4635 00000100:00100000:0.0:1746147239.754764:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31320:x1830967465325568:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147239.754817:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31320:x1830967465325568:12345-192.168.203.36@tcp:49:cat.0 Request processed in 52us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.754822:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4635 00000100:00100000:0.0:1746147239.754831:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4636 00000100:00100000:0.0:1746147239.754835:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31321:x1830967465325824:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147239.754862:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31321:x1830967465325824:12345-192.168.203.36@tcp:49:cat.0 Request processed in 27us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.754867:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4636 00000100:00100000:0.0:1746147239.756639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.756713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.758110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.761412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.768819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.768924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.773302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.780715:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6841 00000100:00100000:0.0:1746147239.780724:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465327616:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147239.791785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.795158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.804243:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465327616:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 23519us (26095us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147239.804250:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6841 00002000:00100000:0.0:1746147239.804255:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009edf5c00 x1830967465327616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:615/0 lens 488/440 e 0 to 0 dl 1746147250 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.804263:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edf5c00 with x1830967465327616 ext(1048576->2097151) 00002000:00010000:0.0:1746147239.804267:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edf5c00 00000100:00100000:0.0:1746147239.804289:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465328128 00000100:00100000:0.0:1746147239.804296:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465328128 00010000:00010000:0.0:1746147239.804320:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360400/0xb4b2209fbdace7fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb30e expref: 11 pid: 6881 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1746147239.804341:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7405 00000100:00100000:0.0:1746147239.804347:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465328128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147239.804358:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147239.804374:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f360400/0xb4b2209fbdace7fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb30e expref: 11 pid: 6881 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746147239.804384:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f360400/0xb4b2209fbdace7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb30e expref: 11 pid: 6881 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746147239.804406:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f360400/0xb4b2209fbdace7fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb30e expref: 11 pid: 6881 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746147239.804426:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147239.804440:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465328128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147239.804445:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7405 00000100:00100000:0.0:1746147239.819458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.829127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.829164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.829187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.837549:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465329792 00000100:00100000:0.0:1746147239.837556:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465329792 00010000:00010000:0.0:1746147239.837587:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdace90e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb38c expref: 32 pid: 11147 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1746147239.837613:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7406 00000100:00100000:0.0:1746147239.837620:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465329792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147239.837635:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147239.837650:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdace90e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb38c expref: 32 pid: 11147 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746147239.837662:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdace90e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb38c expref: 32 pid: 11147 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746147239.837679:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdace90e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb38c expref: 32 pid: 11147 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746147239.837850:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.837853:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147239.837863:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 34 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.837872:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 34 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147239.837906:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 34 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147239.837969:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466891264:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147239.838407:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147239.843958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.852525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.852568:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.853245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.862779:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6854 00000100:00100000:0.0:1746147239.862787:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465331840:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147239.863986:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465332096 00000100:00100000:0.0:1746147239.863991:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465332096 00002000:00100000:0.0:1746147239.864013:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8801307ef100 x1830967465332096/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:615/0 lens 488/0 e 0 to 0 dl 1746147250 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.864021:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ef100 with x1830967465332096 ext(2097152->3145727) 00002000:00010000:0.0:1746147239.864025:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ef100 00000100:00100000:0.0:1746147239.864048:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6855 00000100:00100000:0.0:1746147239.864053:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465332096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147239.867127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.885696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.909161:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465331840:12345-192.168.203.36@tcp:3:cat.0 Request processed in 46369us (46707us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147239.909170:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6854 00002000:00100000:0.0:1746147239.909179:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012d49b800 x1830967465331840/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:615/0 lens 488/440 e 0 to 0 dl 1746147250 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147239.909186:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b800 with x1830967465331840 ext(3145728->4194303) 00002000:00010000:0.0:1746147239.909301:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b800 00000100:00100000:0.0:1746147239.919522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.934032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.948777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.950483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.963398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.970657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147239.977505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.059074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147240.060334:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147240.062024:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.076062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.077788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.077808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.077829:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465335168 00000100:00100000:0.0:1746147240.077837:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465335168 00010000:00010000:0.0:1746147240.077875:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdace8c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb369 expref: 37 pid: 8478 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.077902:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465335296 00000100:00100000:0.0:1746147240.077904:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465335296 00010000:00010000:0.0:1746147240.077915:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdace812 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb32a expref: 10 pid: 6881 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.077933:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7407 00000100:00100000:0.0:1746147240.077958:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465335168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.077972:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.077996:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdace8c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb369 expref: 37 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.078008:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdace8c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb369 expref: 37 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.078035:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.078077:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465335168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.078084:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7407 00000100:00100000:0.0:1746147240.078134:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7408 00000100:00100000:0.0:1746147240.078140:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465335296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.078146:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.078153:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdace812 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb32a expref: 10 pid: 6881 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.078167:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdace812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb32a expref: 10 pid: 6881 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.078178:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.078193:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465335296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 54us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.078198:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7408 00000100:00100000:0.0:1746147240.078288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.078303:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465335424 00000100:00100000:0.0:1746147240.078307:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465335424 00010000:00010000:0.0:1746147240.078335:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e54fe00/0xb4b2209fbdace938 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3af expref: 29 pid: 8478 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.078352:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7409 00000100:00100000:0.0:1746147240.078357:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465335424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.078363:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.078371:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e54fe00/0xb4b2209fbdace938 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3af expref: 29 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.078380:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e54fe00/0xb4b2209fbdace938 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3af expref: 29 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.078393:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.078395:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.078403:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f515000/0xb4b2209fbdace9c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2416640->2449407) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb41f expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.078416:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f515000/0xb4b2209fbdace9c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2416640->2449407) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb41f expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.078448:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f515000/0xb4b2209fbdace9c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2416640->2449407) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb41f expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147240.078461:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466892544:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147240.078514:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e0f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147240.086895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.134916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.134964:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465335936 00000100:00100000:0.0:1746147240.134974:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465335936 00000100:00100000:0.0:1746147240.135032:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11240 00000100:00100000:0.0:1746147240.135041:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31333:x1830967465335936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147240.135067:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.135086:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f37ce00/0xb4b2209fbdace9ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb42d expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.135181:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f37cc00/0xb4b2209fbdace9f5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.135194:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f37cc00/0xb4b2209fbdace9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.135205:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f37cc00/0xb4b2209fbdace9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147240.135220:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9134112 00010000:00010000:0.0:1746147240.135342:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f37ce00/0xb4b2209fbdace9ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb42d expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.135356:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f37cc00/0xb4b2209fbdace9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb42d expref: 14 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.135363:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147240.135365:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147240.135367:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f37cc00, rc 0) 00000100:00100000:0.0:1746147240.135412:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31333:x1830967465335936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 373us (504us total) trans 8589945181 rc 0/0 00000100:00100000:0.0:1746147240.135419:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11240 00000100:00100000:0.0:1746147240.152015:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466892800:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147240.152031:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc45c00/0xb4b2209fbdacea03 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb434 expref: 30 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.152040:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc45c00/0xb4b2209fbdacea03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb434 expref: 30 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.152047:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc45c00, rc 0) 00000100:00100000:0.0:1746147240.152064:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465336320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6328us (6426us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147240.152071:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14683 00000100:00100000:0.0:1746147240.159194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.179251:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466893056:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147240.179263:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466893184:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147240.179270:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466893312:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147240.179293:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2469888->2887679] (req 2469888->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.179307:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc45200, rc 0) 00000100:00100000:0.0:1746147240.179347:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31329:x1830967465336960:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9138us (9923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.179354:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14685 00000100:00100000:0.0:1746147240.180323:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465337344 00000100:00100000:0.0:1746147240.180329:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465337344 00010000:00010000:0.0:1746147240.180350:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3b6 expref: 13 pid: 8478 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.180369:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7410 00000100:00100000:0.0:1746147240.180374:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465337344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.180384:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.180399:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3b6 expref: 13 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.180408:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3b6 expref: 13 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.180424:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e54f600/0xb4b2209fbdace93f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3b6 expref: 13 pid: 8478 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.180444:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.180467:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465337344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.180472:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7410 00000100:00100000:0.0:1746147240.180510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.180560:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465337216 00000100:00100000:0.0:1746147240.180563:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465337216 00010000:00010000:0.0:1746147240.180582:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdace8c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb370 expref: 28 pid: 17530 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.180596:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7411 00000100:00100000:0.0:1746147240.180600:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465337216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.180606:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.180612:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdace8c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb370 expref: 28 pid: 17530 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.180619:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdace8c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb370 expref: 28 pid: 17530 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.180629:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdace8c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb370 expref: 28 pid: 17530 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.180637:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.180653:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465337216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.180661:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7411 00000100:00080000:0.0:1746147240.180673:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147240.210474:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465337472 00000100:00100000:0.0:1746147240.210482:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465337472 00010000:00010000:0.0:1746147240.210512:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdace820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb331 expref: 11 pid: 6881 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.210536:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7412 00000100:00100000:0.0:1746147240.210542:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465337472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.210553:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.210571:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdace820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb331 expref: 11 pid: 6881 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.210582:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdace820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb331 expref: 11 pid: 6881 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.210599:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdace820 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb331 expref: 11 pid: 6881 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746147240.210612:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.210613:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.210619:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.210626:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.210657:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147240.210667:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466893440:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147240.211251:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147240.215795:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466893440:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147240.215808:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.215837:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465337472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5295us (6576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.215844:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7412 00000100:00100000:0.0:1746147240.225099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.225135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.225162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.225180:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465338240 00000100:00100000:0.0:1746147240.225186:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465338240 00002000:00100000:0.0:1746147240.225218:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2883584->2887679) req@ffff88009e587b80 x1830967465338240/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.225239:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587b80 with x1830967465338240 ext(2883584->2887679) 00002000:00010000:0.0:1746147240.225244:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587b80 00000100:00100000:0.0:1746147240.225260:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6862 00000100:00100000:0.0:1746147240.225266:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465338240:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147240.225386:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465338240:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 120us (250us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147240.225395:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6862 00002000:00100000:0.0:1746147240.225401:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2883584->2887679) req@ffff88009e587b80 x1830967465338240/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/4536 e 0 to 0 dl 1746147251 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.225407:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587b80 with x1830967465338240 ext(2883584->2887679) 00002000:00010000:0.0:1746147240.225410:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587b80 00000100:00100000:0.0:1746147240.225428:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465338368 00000100:00100000:0.0:1746147240.225430:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465338368 00010000:00010000:0.0:1746147240.225445:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 37 pid: 8478 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746147240.225462:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7413 00000100:00100000:0.0:1746147240.225466:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465338368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.225475:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.225488:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 37 pid: 8478 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.225498:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 37 pid: 8478 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.225514:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdace962 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->667647) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d9 expref: 37 pid: 8478 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.225527:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.225529:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.225535:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a99e00/0xb4b2209fbdacea11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb442 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.225546:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a99e00/0xb4b2209fbdacea11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb442 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.225571:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a99e00/0xb4b2209fbdacea11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb442 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147240.225580:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466893568:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147240.225625:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147240.232296:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466893568:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147240.232310:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.232335:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465338368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6868us (7172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.232343:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7413 00000100:00100000:0.0:1746147240.257204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.257253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.257451:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6864 00000100:00100000:0.0:1746147240.257458:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465339520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147240.259632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.270509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.274103:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465339520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16644us (16906us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147240.274110:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6864 00002000:00100000:0.0:1746147240.274116:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b208a80 x1830967465339520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:616/0 lens 488/440 e 0 to 0 dl 1746147251 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.274128:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967465339520 ext(0->1048575) 00002000:00010000:0.0:1746147240.274131:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:0.0:1746147240.285020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.288909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.291532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.292856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.292872:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465340800 00000100:00100000:0.0:1746147240.292878:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465340800 00010000:00010000:0.0:1746147240.292902:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f000/0xb4b2209fbdace9e0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb426 expref: 15 pid: 14049 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746147240.292924:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7415 00000100:00100000:0.0:1746147240.292930:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465340800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.292964:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.292969:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f000/0xb4b2209fbdace9e0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb426 expref: 15 pid: 14049 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.292978:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f000/0xb4b2209fbdace9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb426 expref: 15 pid: 14049 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.292995:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147240.292999:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacea5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.293006:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacea5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.293011:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.293051:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465340800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 121us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.293057:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7415 00000100:00100000:0.0:1746147240.295336:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465340928 00000100:00100000:0.0:1746147240.295342:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465340928 00010000:00010000:0.0:1746147240.295365:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f515600/0xb4b2209fbdace9b6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb418 expref: 310 pid: 14048 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746147240.296206:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7416 00000100:00100000:0.0:1746147240.296215:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1957:x1830967465340928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.296240:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.296247:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f515600/0xb4b2209fbdace9b6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb418 expref: 310 pid: 14048 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.296257:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f515600/0xb4b2209fbdace9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb418 expref: 310 pid: 14048 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.296277:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f515600/0xb4b2209fbdace9b6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb418 expref: 310 pid: 14048 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.296293:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147240.296298:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacea5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.296305:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacea5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.296311:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacea5e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147240.296340:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.298733:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1957:x1830967465340928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2510us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.298744:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7416 00000100:00100000:0.0:1746147240.313092:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465340672:12345-192.168.203.36@tcp:4:cat.0 Request processed in 19742us (19928us total) trans 21474841200 rc 0/0 00000100:00100000:0.0:1746147240.313106:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2397 00002000:00100000:0.0:1746147240.313117:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1404928->1970175) req@ffff88008e5cad80 x1830967465340672/t21474841200(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/448 e 0 to 0 dl 1746147251 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.313126:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cad80 with x1830967465340672 ext(1404928->1970175) 00010000:00010000:0.0:1746147240.313136:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72e400/0xb4b2209fbdace95b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->1970175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d2 expref: 10 pid: 8478 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.313151:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72e400/0xb4b2209fbdace95b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->1970175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3d2 expref: 10 pid: 8478 timeout: 727 lvb_type: 0 00002000:00010000:0.0:1746147240.313157:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5cad80 00000100:00100000:0.0:1746147240.342967:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465341824 00000100:00100000:0.0:1746147240.342980:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465341824 00002000:00100000:0.0:1746147240.343023:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3563520->4194303) req@ffff8800a4fadc00 x1830967465341824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.343033:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967465341824 ext(3563520->4194303) 00002000:00010000:0.0:1746147240.343039:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fadc00 00000100:00100000:0.0:1746147240.343066:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6868 00000100:00100000:0.0:1746147240.343072:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465341824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147240.386955:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465341696:12345-192.168.203.36@tcp:3:cat.0 Request processed in 38639us (51879us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147240.386968:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6869 00002000:00100000:0.0:1746147240.386982:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3563519) req@ffff8800a4fadf80 x1830967465341696/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 504/440 e 0 to 0 dl 1746147251 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.386991:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadf80 with x1830967465341696 ext(2097152->3563519) 00002000:00010000:0.0:1746147240.386999:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fadf80 00000100:00100000:0.0:1746147240.387533:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465341824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 44460us (49913us total) trans 0 rc 630784/630784 00000100:00100000:0.0:1746147240.387538:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6868 00002000:00100000:0.0:1746147240.387543:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3563520->4194303) req@ffff8800a4fadc00 x1830967465341824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/440 e 0 to 0 dl 1746147251 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.387549:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967465341824 ext(3563520->4194303) 00002000:00010000:0.0:1746147240.387551:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fadc00 00000100:00100000:0.0:1746147240.471604:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465343360 00000100:00100000:0.0:1746147240.471616:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465343360 00000100:00100000:0.0:1746147240.471679:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14694 00000100:00100000:0.0:1746147240.471687:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:31341:x1830967465343360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147240.471707:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.471725:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c52e200/0xb4b2209fbdacea81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb496 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.471754:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f361e00/0xb4b2209fbdace804 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb315 expref: 6 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.471768:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b470200/0xb4b2209fbdace915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb393 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.471776:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdace8ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb354 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.471782:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.471784:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.471788:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52e200/0xb4b2209fbdacea81 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1093632->1933311] (req 1093632->1933311) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb496 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.471820:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdace8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb354 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.471832:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdace8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb354 expref: 15 pid: 8478 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.471845:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466894848:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147240.471965:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b470200/0xb4b2209fbdace915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb393 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.471973:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b470200/0xb4b2209fbdace915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb393 expref: 9 pid: 8481 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.471982:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466894976:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147240.472021:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f361e00/0xb4b2209fbdace804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb315 expref: 6 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.472029:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f361e00/0xb4b2209fbdace804 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb315 expref: 6 pid: 6881 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.472037:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466895104:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147240.472054:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147240.477955:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466894848:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147240.477968:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466894976:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147240.477976:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466895104:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147240.478003:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c52e200/0xb4b2209fbdacea81 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1093632->1933311] (req 1093632->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb496 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.478018:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c52e200, rc 0) 00000100:00100000:0.0:1746147240.478053:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:31341:x1830967465343360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6368us (7275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.478060:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14694 00000100:00100000:0.0:1746147240.485820:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465344128 00000100:00100000:0.0:1746147240.485824:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465344128 00000100:00100000:0.0:1746147240.485848:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14695 00000100:00100000:0.0:1746147240.485853:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:31338:x1830967465344128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147240.485862:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.485878:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb4a4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.485902:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.485909:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147240.485911:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147240.485913:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4a4 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.485956:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.485968:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 9 pid: 17548 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746147240.485980:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466895360:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147240.486391:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147240.492357:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466895360:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147240.492392:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4a4 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.492414:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064200, rc 0) 00000100:00100000:0.0:1746147240.492475:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:31338:x1830967465344128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6617us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.492484:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14695 00000100:00100000:0.0:1746147240.509374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.510294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.510326:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465344896 00000100:00100000:0.0:1746147240.510331:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465344896 00010000:00010000:0.0:1746147240.510359:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746147240.510388:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7421 00000100:00100000:0.0:1746147240.510396:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465344896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.510409:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.510434:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.510447:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.510472:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc45200/0xb4b2209fbdacea18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->2887679) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb449 expref: 11 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.510489:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.510491:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.510500:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4a4 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.510509:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4a4 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.510547:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4a4 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147240.510567:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466895488:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147240.510652:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147240.521286:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465345152 00000100:00100000:0.0:1746147240.521298:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465345152 00002000:00100000:0.0:1746147240.521344:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009edcad80 x1830967465345152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.521354:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967465345152 ext(2097152->3145727) 00002000:00010000:0.0:1746147240.521359:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:0.0:1746147240.521380:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6875 00000100:00100000:0.0:1746147240.521387:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967465345152:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147240.539496:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465345664 00000100:00100000:0.0:1746147240.539505:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465345664 00002000:00100000:0.0:1746147240.539539:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009edc8a80 x1830967465345664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.539548:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830967465345664 ext(3145728->4194303) 00002000:00010000:0.0:1746147240.539554:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc8a80 00000100:00100000:0.0:1746147240.539580:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6877 00000100:00100000:0.0:1746147240.539586:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465345664:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147240.552859:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465345152:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 31457us (31632us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147240.552874:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6875 00002000:00100000:0.0:1746147240.552889:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009edcad80 x1830967465345152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:616/0 lens 488/440 e 0 to 0 dl 1746147251 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.552900:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967465345152 ext(2097152->3145727) 00002000:00010000:0.0:1746147240.552906:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:0.0:1746147240.589450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.592211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.609982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.610045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.613296:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465346688 00000100:00100000:0.0:1746147240.613308:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465346688 00000100:00100000:0.0:1746147240.613370:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 744 00000100:00100000:0.0:1746147240.613377:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465346688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.613389:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.613413:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdaceac7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ab expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.613430:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147240.613434:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.613474:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967465346688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (3429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.613480:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 744 00000100:00100000:0.0:1746147240.617468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.617520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.633053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.641496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.663795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.663866:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465347328 00000100:00100000:0.0:1746147240.663877:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465347328 00000100:00100000:0.0:1746147240.663921:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14699 00000100:00100000:0.0:1746147240.663928:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31344:x1830967465347328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147240.663980:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.663999:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdaceaea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb4c7 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.664030:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdaceaab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4a4 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.664041:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdaceadc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4b9 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.664047:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.664049:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.664053:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdaceaea lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3584000->4194303] (req 3584000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4c7 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147240.671893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.673785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.681823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.688584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.690395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.703978:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465348608 00000100:00100000:0.0:1746147240.703986:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465348608 00010000:00010000:0.0:1746147240.704015:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdacea73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb488 expref: 21 pid: 17548 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746147240.704047:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465348480 00000100:00100000:0.0:1746147240.704049:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465348480 00010000:00010000:0.0:1746147240.704058:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdacea49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb46c expref: 9 pid: 17548 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746147240.704082:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7426 00000100:00100000:0.0:1746147240.704087:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465348480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147240.704095:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147240.704103:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdacea49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb46c expref: 9 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.704165:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdacea49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb46c expref: 9 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.704182:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdacea49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb46c expref: 9 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.704198:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147240.704293:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1958:x1830967465348480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 205us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.704299:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7426 00000100:00100000:0.0:1746147240.709879:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465348096:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 19994us (21301us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147240.709887:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6879 00002000:00100000:0.0:1746147240.709895:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012b0c1880 x1830967465348096/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/440 e 0 to 0 dl 1746147251 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.709903:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1880 with x1830967465348096 ext(1048576->2097151) 00002000:00010000:0.0:1746147240.709908:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c1880 00000100:00100000:0.0:1746147240.710302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.717220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.724765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.725022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.725044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.725067:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465349504 00000100:00100000:0.0:1746147240.725075:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465349504 00002000:00100000:0.0:1746147240.725124:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012b0c0e00 x1830967465349504/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.725135:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0e00 with x1830967465349504 ext(2097152->3145727) 00002000:00010000:0.0:1746147240.725141:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0e00 00000100:00100000:0.0:1746147240.725173:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465349632 00000100:00100000:0.0:1746147240.725176:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465349632 00002000:00100000:0.0:1746147240.725188:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012b0c1180 x1830967465349632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.725194:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1180 with x1830967465349632 ext(3145728->4194303) 00002000:00010000:0.0:1746147240.725197:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c1180 00000100:00100000:0.0:1746147240.725685:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465350016 00000100:00100000:0.0:1746147240.725688:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465350016 00002000:00100000:0.0:1746147240.725703:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3583999) req@ffff88012b0c0000 x1830967465350016/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.725709:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0000 with x1830967465350016 ext(3145728->3583999) 00002000:00010000:0.0:1746147240.725712:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0000 00000100:00100000:0.0:1746147240.725727:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6883 00000100:00100000:0.0:1746147240.725732:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465349632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147240.769124:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465350400 00000100:00100000:0.0:1746147240.769135:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465350400 00000100:00100000:0.0:1746147240.769197:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11245 00000100:00100000:0.0:1746147240.769206:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:31352:x1830967465350400:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147240.769245:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.769265:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdaceaf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb4d5 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.769381:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769395:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769406:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769419:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769430:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769436:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769543:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769552:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769558:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147240.769568:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9134112 00010000:00010000:0.0:1746147240.769662:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769668:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769674:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769679:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a9000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147240.769683:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769689:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769699:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147240.769702:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147240.769705:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769709:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceaff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769724:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769729:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769734:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769742:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a8400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147240.769744:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769749:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769755:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98fb00) 00010000:00010000:0.0:1746147240.769757:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147240.769759:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769763:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.769800:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdaceaf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4d5 expref: 312 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.769812:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4d5 expref: 311 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.769819:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147240.769821:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147240.769823:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9800, rc 0) 00000100:00100000:0.0:1746147240.769870:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+311:31352:x1830967465350400:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 665us (997us total) trans 8589945190 rc 0/0 00000100:00100000:0.0:1746147240.769876:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11245 00000100:00100000:0.0:1746147240.774705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.780208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.843826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.845434:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11246 00000100:00100000:0.0:1746147240.845448:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:31358:x1830967465351168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147240.845476:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.845500:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb4dc expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.845631:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845646:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845658:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845673:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845679:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845685:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845806:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdaceb30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845817:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdaceb30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845824:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdaceb30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147240.845839:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9134112 00010000:00010000:0.0:1746147240.845974:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845981:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845987:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.845993:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a9000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147240.845997:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846003:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846016:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147240.846018:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147240.846023:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846028:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9000/0xb4b2209fbdaceb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846066:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846072:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846077:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846084:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a8400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147240.846086:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846091:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846099:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f300) 00010000:00010000:0.0:1746147240.846101:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147240.846103:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846108:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdaceb29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147240.846154:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4dc expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.846170:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdaceb30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4dc expref: 314 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.846177:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147240.846178:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147240.846181:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9400, rc 0) 00000100:00100000:0.0:1746147240.846268:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:31358:x1830967465351168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 822us (2452us total) trans 8589945192 rc 0/0 00000100:00100000:0.0:1746147240.846276:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11246 00000100:00100000:0.0:1746147240.847860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.853666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.853713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.861106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.861685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.861703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.861737:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.865618:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14701 00000100:00100000:0.0:1746147240.865634:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967465352064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147240.865655:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147240.865674:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb4ea expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147240.865700:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.865701:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147240.865709:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ea expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.865726:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ea expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147240.865737:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8600, rc 0) 00000100:00100000:0.0:1746147240.865788:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967465352064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 162us (4103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147240.866852:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14701 00000100:00100000:0.0:1746147240.870818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.888564:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465353472 00000100:00100000:0.0:1746147240.888569:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465353472 00002000:00100000:0.0:1746147240.888597:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1990656->1994751) req@ffff88009f047480 x1830967465353472/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 488/0 e 0 to 0 dl 1746147251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.888612:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047480 with x1830967465353472 ext(1990656->1994751) 00002000:00010000:0.0:1746147240.888616:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f047480 00000100:00100000:0.0:1746147240.890685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.896511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.896632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.899785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.905131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.907020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.914267:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.921048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.945768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.945823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.951217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.955656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.965566:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465355648:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9681us (9903us total) trans 17179873826 rc 0/0 00000100:00100000:0.0:1746147240.965578:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2401 00002000:00100000:0.0:1746147240.965589:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->4468735) req@ffff8800a0449500 x1830967465355648/t17179873826(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:616/0 lens 504/448 e 0 to 0 dl 1746147251 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147240.965595:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449500 with x1830967465355648 ext(2097152->4468735) 00010000:00010000:0.0:1746147240.965605:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5291a00/0xb4b2209fbdaceaf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ce expref: 10 pid: 17548 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746147240.965621:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5291a00/0xb4b2209fbdaceaf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ce expref: 10 pid: 17548 timeout: 727 lvb_type: 0 00002000:00010000:0.0:1746147240.965633:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0449500 00000100:00100000:0.0:1746147240.973304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.978965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.992608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147240.998100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.030336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147241.036191:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147241.041235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147241.042243:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147241.043765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.070586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.070643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.070660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.070674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.070693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147241.071406:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147241.082533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.097465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.097505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.101170:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.103318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.114898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.115029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.115052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.115081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.115120:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465359872 00000100:00100000:0.0:1746147241.115128:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465359872 00002000:00100000:0.0:1746147241.115169:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4943871) req@ffff88008f9ffb80 x1830967465359872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.115177:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ffb80 with x1830967465359872 ext(4194304->4943871) 00002000:00010000:0.0:1746147241.115181:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ffb80 00000100:00100000:0.0:1746147241.115203:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465360000 00000100:00100000:0.0:1746147241.115205:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465360000 00002000:00100000:0.0:1746147241.115215:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (266240->962559) req@ffff88008f9fea00 x1830967465360000/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.115231:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fea00 with x1830967465360000 ext(266240->962559) 00010000:00010000:0.0:1746147241.115237:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee65200/0xb4b2209fbdaceb7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 266240->962559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb506 expref: 22 pid: 17530 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746147241.115247:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee65200/0xb4b2209fbdaceb7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 266240->962559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb506 expref: 22 pid: 17530 timeout: 728 lvb_type: 0 00002000:00010000:0.0:1746147241.115253:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fea00 00000100:00100000:0.0:1746147241.115274:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2403 00000100:00100000:0.0:1746147241.115281:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967465360000:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147241.129877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.129966:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465360512 00000100:00100000:0.0:1746147241.129975:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465360512 00002000:00100000:0.0:1746147241.130020:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1208320->1212415) req@ffff88008f9fc700 x1830967465360512/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.130031:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc700 with x1830967465360512 ext(1208320->1212415) 00002000:00010000:0.0:1746147241.130037:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fc700 00000100:00100000:0.0:1746147241.130060:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6897 00000100:00100000:0.0:1746147241.130067:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465360512:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147241.130243:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465360512:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 175us (376us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147241.130250:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6897 00002000:00100000:0.0:1746147241.130256:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1208320->1212415) req@ffff88008f9fc700 x1830967465360512/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/4536 e 0 to 0 dl 1746147252 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.130262:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc700 with x1830967465360512 ext(1208320->1212415) 00002000:00010000:0.0:1746147241.130265:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fc700 00000100:00100000:0.0:1746147241.138259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.140404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.140427:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465361024 00000100:00100000:0.0:1746147241.140433:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465361024 00000100:00100000:0.0:1746147241.140486:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14718 00000100:00100000:0.0:1746147241.140493:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465361024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147241.140506:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147241.140519:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c7dc00/0xb4b2209fbdacec41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb576 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147241.140562:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466899712:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147241.140614:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147241.140712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.140730:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465361280 00000100:00100000:0.0:1746147241.140733:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465361280 00000100:00100000:0.0:1746147241.140755:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4652 00000100:00100000:0.0:1746147241.140759:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31362:x1830967465361280:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147241.140928:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31362:x1830967465361280:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 166us (214us total) trans 8589945201 rc 0/0 00000100:00100000:0.0:1746147241.140935:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4652 00000100:00100000:0.0:1746147241.148607:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967465361024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8111us (8205us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147241.148614:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14718 00000100:00100000:0.0:1746147241.149578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.151619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.151683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.167598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.167655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.226011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.226049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.226083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.226193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.226237:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465362432 00000100:00100000:0.0:1746147241.226249:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465362432 00002000:00100000:0.0:1746147241.226306:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012ecec380 x1830967465362432/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.226316:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec380 with x1830967465362432 ext(2097152->3145727) 00002000:00010000:0.0:1746147241.226323:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecec380 00000100:00100000:0.0:1746147241.277048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.301306:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11251 00000100:00100000:0.0:1746147241.303543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.303619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.307002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.311643:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465364352 00000100:00100000:0.0:1746147241.311652:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465364352 00000100:00100000:0.0:1746147241.311691:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14722 00000100:00100000:0.0:1746147241.311698:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:31366:x1830967465364352:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147241.311716:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147241.311732:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdacec80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb599 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.311761:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdaceae3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4c0 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.311768:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ea expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147241.311773:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.311775:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.311778:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdacec80 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb599 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.311806:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ea expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147241.311816:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdaceb61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4ea expref: 18 pid: 6881 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746147241.311827:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466900224:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147241.312318:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdaceae3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4c0 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.312326:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdaceae3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4c0 expref: 13 pid: 17548 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746147241.312334:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466900352:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147241.313828:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147241.313854:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466900224:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147241.318118:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466900352:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147241.318154:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdacec80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb599 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.318172:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e600, rc 0) 00000100:00100000:0.0:1746147241.318211:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:31366:x1830967465364352:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6514us (6919us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147241.318227:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14722 00000100:00100000:0.0:1746147241.319167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.322415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.330387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.341028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.344141:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.351343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.351437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.366998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.373044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.382319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.386998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.401424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.405277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.423611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.434517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.534548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.543384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.543440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.544017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.544052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.544075:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4655 00000100:00100000:0.0:1746147241.544083:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+320:31380:x1830967465368448:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147241.544513:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+321:31380:x1830967465368448:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 430us (1071us total) trans 8589945208 rc 0/0 00000100:00100000:0.0:1746147241.544519:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4655 00000100:00100000:0.0:1746147241.548465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.548497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.548525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.548550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.561739:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465369216 00000100:00100000:0.0:1746147241.561751:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465369216 00010000:00010000:0.0:1746147241.561786:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee64200/0xb4b2209fbdaceb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb522 expref: 23 pid: 17530 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746147241.561808:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465369344 00000100:00100000:0.0:1746147241.561811:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465369344 00010000:00010000:0.0:1746147241.561822:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e32400/0xb4b2209fbdacebfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb54c expref: 15 pid: 8481 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746147241.561836:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7443 00000100:00100000:0.0:1746147241.561842:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465369216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147241.561856:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147241.561875:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee64200/0xb4b2209fbdaceb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb522 expref: 23 pid: 17530 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746147241.561885:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee64200/0xb4b2209fbdaceb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb522 expref: 23 pid: 17530 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746147241.561908:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee64200/0xb4b2209fbdaceb99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb522 expref: 23 pid: 17530 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746147241.563591:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147241.570889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.572752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.586579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.603808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.603869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.604505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.605000:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465370240 00000100:00100000:0.0:1746147241.605009:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465370240 00010000:00010000:0.0:1746147241.605047:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e33800/0xb4b2209fbdacec02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb553 expref: 15 pid: 8481 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746147241.605074:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465370368 00000100:00100000:0.0:1746147241.605077:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465370368 00010000:00010000:0.0:1746147241.605087:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee65800/0xb4b2209fbdaceba0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb529 expref: 20 pid: 17530 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746147241.605119:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7445 00000100:00100000:0.0:1746147241.605127:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465370240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147241.605143:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147241.605166:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e33800/0xb4b2209fbdacec02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb553 expref: 15 pid: 8481 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746147241.605177:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e33800/0xb4b2209fbdacec02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb553 expref: 15 pid: 8481 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746147241.605245:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.605248:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.605255:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdaced21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb5e6 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.605264:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdaced21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb5e6 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.605295:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdaced21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb5e6 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147241.605308:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466902272:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147241.605359:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147241.610909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.611011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.611058:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465370752 00000100:00100000:0.0:1746147241.611070:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465370752 00002000:00100000:0.0:1746147241.611122:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3497984->3502079) req@ffff88009e6f3800 x1830967465370752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.611132:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3800 with x1830967465370752 ext(3497984->3502079) 00002000:00010000:0.0:1746147241.611137:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3800 00000100:00100000:0.0:1746147241.611159:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465370624 00000100:00100000:0.0:1746147241.611163:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465370624 00002000:00100000:0.0:1746147241.611180:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009e6f3b80 x1830967465370624/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.611187:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3b80 with x1830967465370624 ext(1048576->2097151) 00002000:00010000:0.0:1746147241.611190:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3b80 00000100:00100000:0.0:1746147241.611208:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6913 00000100:00100000:0.0:1746147241.611241:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465370752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147241.611438:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465370752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 220us (539us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147241.611445:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6913 00002000:00100000:0.0:1746147241.611452:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3497984->3502079) req@ffff88009e6f3800 x1830967465370752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/4536 e 0 to 0 dl 1746147252 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.611458:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3800 with x1830967465370752 ext(3497984->3502079) 00002000:00010000:0.0:1746147241.611461:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3800 00000100:00100000:0.0:1746147241.618447:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.632375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.636655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.665346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.676460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.676511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.694412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.700129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.711043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.717394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.719434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.720338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.720368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.720392:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465373056 00000100:00100000:0.0:1746147241.720400:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465373056 00002000:00100000:0.0:1746147241.720437:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4186112->4190207) req@ffff88012df79500 x1830967465373056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.720447:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967465373056 ext(4186112->4190207) 00002000:00010000:0.0:1746147241.721531:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79500 00000100:00100000:0.0:1746147241.721585:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6919 00000100:00100000:0.0:1746147241.721593:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465373056:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147241.721740:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465373056:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 147us (2311us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147241.721746:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6919 00002000:00100000:0.0:1746147241.721751:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4186112->4190207) req@ffff88012df79500 x1830967465373056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:617/0 lens 488/4536 e 0 to 0 dl 1746147252 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.721763:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967465373056 ext(4186112->4190207) 00002000:00010000:0.0:1746147241.721766:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79500 00000100:00100000:0.0:1746147241.734017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.734390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.734412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.734426:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465374208 00000100:00100000:0.0:1746147241.734429:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465374208 00000100:00100000:0.0:1746147241.734445:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465374336 00000100:00100000:0.0:1746147241.734446:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465374336 00000100:00100000:0.0:1746147241.735388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.735415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.737894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.740967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.747203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.747254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.747273:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465375104 00000100:00100000:0.0:1746147241.747281:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465375104 00002000:00100000:0.0:1746147241.747318:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df7b800 x1830967465375104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.747327:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b800 with x1830967465375104 ext(1048576->2097151) 00002000:00010000:0.0:1746147241.747332:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7b800 00000100:00100000:0.0:1746147241.747362:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6920 00000100:00100000:0.0:1746147241.747372:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465375104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147241.754390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.791199:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465376512 00000100:00100000:0.0:1746147241.791211:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465376512 00000100:00100000:0.0:1746147241.791265:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14740 00000100:00100000:0.0:1746147241.791272:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31387:x1830967465376512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147241.791286:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147241.791300:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935dd000/0xb4b2209fbdacedad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb63a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.791319:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.791321:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.791327:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935dd000/0xb4b2209fbdacedad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb63a expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.791338:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935dd000/0xb4b2209fbdacedad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb63a expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.791347:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dd000, rc 0) 00000100:00100000:0.0:1746147241.791382:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31387:x1830967465376512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147241.791387:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14740 00000100:00100000:0.0:1746147241.792778:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465376384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9963us (10128us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147241.792786:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6923 00002000:00100000:0.0:1746147241.792794:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800a4673800 x1830967465376384/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/440 e 0 to 0 dl 1746147252 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.792802:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673800 with x1830967465376384 ext(2097152->3145727) 00002000:00010000:0.0:1746147241.792807:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673800 00000100:00100000:0.0:1746147241.794709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.797893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.805765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.819026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.823877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.824592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.835608:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465377792 00000100:00100000:0.0:1746147241.835618:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465377792 00002000:00100000:0.0:1746147241.835660:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012b0c1500 x1830967465377792/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.835670:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1500 with x1830967465377792 ext(3145728->4194303) 00002000:00010000:0.0:1746147241.835676:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c1500 00000100:00100000:0.0:1746147241.835705:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6926 00000100:00100000:0.0:1746147241.835711:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1958:x1830967465377792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147241.867799:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465378048 00000100:00100000:0.0:1746147241.867809:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465378048 00000100:00100000:0.0:1746147241.867854:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14744 00000100:00100000:0.0:1746147241.867861:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31387:x1830967465378048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147241.867877:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147241.867892:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4e200/0xb4b2209fbdacedc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb656 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.867914:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.867916:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147241.867923:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4e200/0xb4b2209fbdacedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb656 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.867950:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4e200/0xb4b2209fbdacedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb656 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147241.867961:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4e200, rc 0) 00000100:00100000:0.0:1746147241.868005:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31387:x1830967465378048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 143us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147241.868012:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14744 00000100:00100000:0.0:1746147241.870726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.875797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.892230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.899417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.906203:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949cb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466904448:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147241.906242:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147241.906288:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465378688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6103us (6874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147241.906299:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7452 00000100:00100000:0.0:1746147241.907115:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465378944 00000100:00100000:0.0:1746147241.907123:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465378944 00010000:00010000:0.0:1746147241.907153:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1515600/0xb4b2209fbdacecb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb5ae expref: 26 pid: 17530 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746147241.908715:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465379328 00000100:00100000:0.0:1746147241.908719:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465379328 00002000:00100000:0.0:1746147241.908746:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a0449c00 x1830967465379328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.908755:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449c00 with x1830967465379328 ext(3145728->4194303) 00002000:00010000:0.0:1746147241.908759:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0449c00 00000100:00100000:0.0:1746147241.908770:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6928 00000100:00100000:0.0:1746147241.908775:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1959:x1830967465379328:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147241.913724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.917262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.919203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.922375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.928711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.928754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.931336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.953502:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465381376 00000100:00100000:0.0:1746147241.953510:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465381376 00002000:00100000:0.0:1746147241.953597:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4939776->4943871) req@ffff88012b0c3800 x1830967465381376/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/0 e 0 to 0 dl 1746147252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.953608:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3800 with x1830967465381376 ext(4939776->4943871) 00002000:00010000:0.0:1746147241.953612:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c3800 00000100:00100000:0.0:1746147241.953636:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6931 00000100:00100000:0.0:1746147241.953643:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465381376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147241.953872:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465381376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 229us (709us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147241.953881:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6931 00002000:00100000:0.0:1746147241.953887:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4939776->4943871) req@ffff88012b0c3800 x1830967465381376/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:617/0 lens 488/4536 e 0 to 0 dl 1746147252 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147241.953894:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3800 with x1830967465381376 ext(4939776->4943871) 00002000:00010000:0.0:1746147241.953896:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c3800 00000100:00100000:0.0:1746147241.955502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.960236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.966845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.967379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.978429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.982892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147241.999390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.006134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147242.006877:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147242.022895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147242.025974:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147242.028896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.029035:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.144160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.150023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.150538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.150556:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465384192 00000100:00100000:0.0:1746147242.150560:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465384192 00000100:00100000:0.0:1746147242.150594:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 757 00000100:00100000:0.0:1746147242.150600:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+327:1957:x1830967465384192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.150609:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.150631:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacee47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6a3 expref: 327 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.150647:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.150650:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.150664:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1957:x1830967465384192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.150670:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 757 00000100:00100000:0.0:1746147242.155708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.162128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.166361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.177503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.182954:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.183000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.197203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.197251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.197278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.197313:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465385600 00000100:00100000:0.0:1746147242.197316:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465385600 00010000:00010000:0.0:1746147242.197349:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801309edc00/0xb4b2209fbdacedd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb65d expref: 20 pid: 8478 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.197369:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7460 00000100:00100000:0.0:1746147242.197376:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465385600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.197388:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.197408:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801309edc00/0xb4b2209fbdacedd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb65d expref: 21 pid: 8478 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.197419:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801309edc00/0xb4b2209fbdacedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb65d expref: 22 pid: 8478 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.197436:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309edc00/0xb4b2209fbdacedd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb65d expref: 22 pid: 8478 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.197451:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.197452:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.197457:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d395200/0xb4b2209fbdacee5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6b1 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.197463:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d395200/0xb4b2209fbdacee5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6b1 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.197492:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d395200/0xb4b2209fbdacee5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6b1 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.197502:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466906240:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147242.197556:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.217023:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466906240:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147242.217043:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.217089:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465385600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 19713us (19808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.217099:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7460 00000100:00100000:0.0:1746147242.217547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.217557:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465386496 00000100:00100000:0.0:1746147242.217560:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465386496 00000100:00100000:0.0:1746147242.217580:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 759 00000100:00100000:0.0:1746147242.217584:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1958:x1830967465386496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.217592:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.217613:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d2c00/0xb4b2209fbdaceea9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6cd expref: 35 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.217627:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.217630:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.217644:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1958:x1830967465386496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.217648:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 759 00000100:00100000:0.0:1746147242.217731:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6934 00000100:00100000:0.0:1746147242.217737:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465386368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.235281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.243259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.243293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.243320:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465386752 00000100:00100000:0.0:1746147242.243328:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465386752 00010000:00010000:0.0:1746147242.243363:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013074f200/0xb4b2209fbdacec48 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb57d expref: 29 pid: 4444 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.243390:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465386880 00000100:00100000:0.0:1746147242.243392:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465386880 00010000:00010000:0.0:1746147242.243401:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013074fa00/0xb4b2209fbdacec2c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb561 expref: 20 pid: 8478 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.243432:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7461 00000100:00100000:0.0:1746147242.243440:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465386752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.243455:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.243476:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013074f200/0xb4b2209fbdacec48 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb57d expref: 29 pid: 4444 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.243486:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013074f200/0xb4b2209fbdacec48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb57d expref: 29 pid: 4444 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.243961:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.243983:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967465386752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 543us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.243992:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7461 00000100:00100000:0.0:1746147242.246661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.254438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.254515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.262752:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6939 00000100:00100000:0.0:1746147242.262760:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465387904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.278069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.279898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.288998:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465388032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26489us (26926us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147242.289007:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6938 00002000:00100000:0.0:1746147242.289017:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012d0dc700 x1830967465388032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:618/0 lens 488/440 e 0 to 0 dl 1746147253 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.289026:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0dc700 with x1830967465388032 ext(3145728->4194303) 00002000:00010000:0.0:1746147242.289030:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0dc700 00000100:00100000:0.0:1746147242.294154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.295366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.295381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.295396:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465389312 00000100:00100000:0.0:1746147242.295399:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465389312 00010000:00010000:0.0:1746147242.295415:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee65800/0xb4b2209fbdaced6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb617 expref: 24 pid: 6881 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.295438:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465389440 00000100:00100000:0.0:1746147242.295440:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465389440 00010000:00010000:0.0:1746147242.295450:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1514200/0xb4b2209fbdaced28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb5ed expref: 18 pid: 17548 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.295463:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7465 00000100:00100000:0.0:1746147242.295829:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465389312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.295838:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.295846:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee65800/0xb4b2209fbdaced6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb617 expref: 24 pid: 6881 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.295856:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee65800/0xb4b2209fbdaced6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb617 expref: 24 pid: 6881 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.295867:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee65800/0xb4b2209fbdaced6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb617 expref: 24 pid: 6881 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.295882:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.295884:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.295891:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f803000/0xb4b2209fbdaceed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6f0 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.295899:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f803000/0xb4b2209fbdaceed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6f0 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.295926:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f803000/0xb4b2209fbdaceed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6f0 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.295955:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466907648:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147242.296004:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.304911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.318862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.322686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.322725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.322749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.322774:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465390720 00000100:00100000:0.0:1746147242.322782:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465390720 00000100:00100000:0.0:1746147242.322821:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465390848 00000100:00100000:0.0:1746147242.322823:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465390848 00000100:00100000:0.0:1746147242.322847:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465390976 00000100:00100000:0.0:1746147242.322849:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465390976 00000100:00100000:0.0:1746147242.322863:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14766 00000100:00100000:0.0:1746147242.322869:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465390720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.322886:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.322904:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba30800/0xb4b2209fbdaceeef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb70c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.322986:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466908288:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147242.323053:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.323072:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14767 00000100:00100000:0.0:1746147242.323077:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967465390848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.323084:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.323093:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba30c00/0xb4b2209fbdaceef6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb713 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.323115:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466908416:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147242.323132:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.323154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.323171:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465390592 00000100:00100000:0.0:1746147242.323173:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465390592 00010000:00010000:0.0:1746147242.323184:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132d0ac00/0xb4b2209fbdacee8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6bf expref: 23 pid: 17548 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.323201:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7468 00000100:00100000:0.0:1746147242.323205:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465390592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.323224:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.323241:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132d0ac00/0xb4b2209fbdacee8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6bf expref: 23 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.323252:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132d0ac00/0xb4b2209fbdacee8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6bf expref: 23 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.323269:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132d0ac00/0xb4b2209fbdacee8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6bf expref: 23 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.323283:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.323285:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.323291:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e94600/0xb4b2209fbdaceee8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb705 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.323298:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e94600/0xb4b2209fbdaceee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb705 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.323321:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e94600/0xb4b2209fbdaceee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb705 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.323329:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466908544:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147242.323345:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.323385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.323414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.325593:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466908288:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147242.325623:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30800/0xb4b2209fbdaceeef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb70c expref: 22 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.325636:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba30800/0xb4b2209fbdaceeef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb70c expref: 22 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.325646:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30800, rc 0) 00000100:00100000:0.0:1746147242.325683:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465390720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2814us (3005us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147242.325691:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14766 00000100:00100000:0.0:1746147242.325719:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465391104 00000100:00100000:0.0:1746147242.325724:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465391104 00000100:00100000:0.0:1746147242.325746:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465391232 00000100:00100000:0.0:1746147242.325749:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465391232 00000100:00100000:0.0:1746147242.325761:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14768 00000100:00100000:0.0:1746147242.325767:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465390976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.325779:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.325791:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdaceefd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb71a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.326382:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466908672:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147242.326515:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.326589:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466908416:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147242.326606:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba30c00/0xb4b2209fbdaceef6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb713 expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.326616:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba30c00/0xb4b2209fbdaceef6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb713 expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.326623:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30c00, rc 0) 00000100:00100000:0.0:1746147242.327009:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967465390848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3931us (4282us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147242.327016:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14767 00000100:00100000:0.0:1746147242.327032:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14769 00000100:00100000:0.0:1746147242.327038:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465391104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.327045:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.327053:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacef04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb721 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.327079:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466908800:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147242.327109:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.328040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.333917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.339362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.339415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.358293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147242.358409:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147242.362185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.365094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.371407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147242.371816:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147242.373469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.373507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.373634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.374496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.374704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.385590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.389781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.393651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.398447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.401246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.401341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.401921:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14780 00000100:00100000:0.0:1746147242.401928:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465394432:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147242.401969:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba30e00/0xb4b2209fbdacef9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.401979:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f803000/0xb4b2209fbdaceed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6f0 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.401983:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147242.401985:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147242.401987:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba30e00/0xb4b2209fbdacef9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.402002:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f803000/0xb4b2209fbdaceed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6f0 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.402009:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f803000/0xb4b2209fbdaceed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6f0 expref: 15 pid: 8481 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.402017:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466910208:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.402082:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.412471:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.412525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.412537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.412548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.412579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.412603:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465395072 00000100:00100000:0.0:1746147242.412610:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465395072 00010000:00010000:0.0:1746147242.412648:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f802400/0xb4b2209fbdacef51 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb760 expref: 9 pid: 8480 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.412672:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465395328 00000100:00100000:0.0:1746147242.412675:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465395328 00010000:00010000:0.0:1746147242.412686:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdacedfa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4943871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb687 expref: 24 pid: 8481 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.412696:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465395456 00000100:00100000:0.0:1746147242.412698:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465395456 00010000:00010000:0.0:1746147242.412707:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132d0ae00/0xb4b2209fbdacee86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6c6 expref: 19 pid: 17548 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.412720:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7471 00000100:00100000:0.0:1746147242.412727:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465395072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.412741:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.412764:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f802400/0xb4b2209fbdacef51 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb760 expref: 9 pid: 8480 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.412775:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f802400/0xb4b2209fbdacef51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb760 expref: 9 pid: 8480 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.412799:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.412839:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465395072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.412845:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7471 00000100:00100000:0.0:1746147242.412859:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7472 00000100:00100000:0.0:1746147242.412863:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465395328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.412869:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.412875:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdacedfa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4943871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb687 expref: 24 pid: 8481 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.412882:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a1fa00/0xb4b2209fbdacedfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4943871) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb687 expref: 24 pid: 8481 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.412893:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.412904:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465395328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.412910:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7472 00000100:00100000:0.0:1746147242.412917:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7473 00000100:00100000:0.0:1746147242.412922:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465395456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.412927:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.412932:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132d0ae00/0xb4b2209fbdacee86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6c6 expref: 19 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.412969:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132d0ae00/0xb4b2209fbdacee86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb6c6 expref: 19 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.412980:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.412981:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.412986:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f802c00/0xb4b2209fbdacefa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.412994:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f802c00/0xb4b2209fbdacefa5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.413010:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.413021:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465395456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.413026:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7473 00000100:00100000:0.0:1746147242.413056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.413181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.429672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.433729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.439005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.442034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.448081:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466911616:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.448093:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466911744:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.448103:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466911872:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.448109:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466912000:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.448115:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466912128:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.448121:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466912384:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.449773:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465397888 00000100:00100000:0.0:1746147242.449778:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465397888 00000100:00100000:0.0:1746147242.449801:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4665 00000100:00100000:0.0:1746147242.449805:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bb1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+35:7642:x1830967465397888:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147242.449903:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bb1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+36:7642:x1830967465397888:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 97us (209us total) trans 8589945226 rc 0/0 00000100:00100000:0.0:1746147242.449909:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4665 00000100:00100000:0.0:1746147242.452166:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465397376 00000100:00100000:0.0:1746147242.452175:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465397376 00010000:00010000:0.0:1746147242.452206:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdacea9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb49d expref: 36 pid: 14048 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.452242:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465398016 00000100:00100000:0.0:1746147242.452245:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465398016 00010000:00010000:0.0:1746147242.452255:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdace94d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3c4 expref: 37 pid: 23726 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.452269:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465398272 00000100:00100000:0.0:1746147242.452271:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465398272 00010000:00010000:0.0:1746147242.452281:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdace946 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3bd expref: 327 pid: 14048 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.452289:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465397248 00000100:00100000:0.0:1746147242.452291:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465397248 00010000:00010000:0.0:1746147242.452299:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4d5 expref: 328 pid: 14049 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.452308:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7483 00000100:00100000:0.0:1746147242.452314:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1958:x1830967465397376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.452327:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.452332:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdacea9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb49d expref: 37 pid: 14048 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452342:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdacea9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb49d expref: 37 pid: 14048 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452363:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdacea9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb49d expref: 37 pid: 14048 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452377:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.452382:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.452390:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.452444:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1958:x1830967465397376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 129us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.452451:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7483 00000100:00100000:0.0:1746147242.452466:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7484 00000100:00100000:0.0:1746147242.452471:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967465398016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.452479:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.452483:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdace94d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3c4 expref: 35 pid: 23726 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452491:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdace94d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3c4 expref: 35 pid: 23726 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452500:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdace94d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3c4 expref: 35 pid: 23726 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452507:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.452511:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.452515:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.452530:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1956:x1830967465398016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.452536:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7484 00000100:00100000:0.0:1746147242.452545:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7485 00000100:00100000:0.0:1746147242.452550:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:1956:x1830967465398272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.452557:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.452560:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdace946 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3bd expref: 328 pid: 14048 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452573:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdace946 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3bd expref: 328 pid: 14048 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452584:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdace946 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb3bd expref: 328 pid: 14048 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452592:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.452595:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.452599:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.452612:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+327:1956:x1830967465398272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.452617:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7485 00000100:00100000:0.0:1746147242.452627:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7486 00000100:00100000:0.0:1746147242.452631:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1956:x1830967465397248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.452638:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.452641:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4d5 expref: 326 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452648:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4d5 expref: 326 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452658:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdaceb0d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb4d5 expref: 326 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.452665:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.452669:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.452674:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.452687:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1956:x1830967465397248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.452692:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7486 00000100:00100000:0.0:1746147242.454647:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147242.491692:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945226 is committed 00000001:00080000:0.0:1746147242.491705:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945208 is committed 00000001:00080000:0.0:1746147242.491726:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945227 is committed 00000004:00080000:0.0:1746147242.491731:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2424 committed 00000004:00080000:0.0:1746147242.491737:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2409 committed 00000004:00080000:0.0:1746147242.491741:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2408 committed 00000004:00080000:0.0:1746147242.491743:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2407 committed 00000004:00080000:0.0:1746147242.491744:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2406 committed 00000004:00080000:0.0:1746147242.491745:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2423 committed 00000004:00080000:0.0:1746147242.491747:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2405 committed 00000004:00080000:0.0:1746147242.491748:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2422 committed 00000004:00080000:0.0:1746147242.491750:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2404 committed 00000004:00080000:0.0:1746147242.491751:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2421 committed 00000004:00080000:0.0:1746147242.491753:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2420 committed 00000004:00080000:0.0:1746147242.491754:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2419 committed 00000004:00080000:0.0:1746147242.491756:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2403 committed 00000004:00080000:0.0:1746147242.491757:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2402 committed 00000004:00080000:0.0:1746147242.491759:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2418 committed 00000004:00080000:0.0:1746147242.491761:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2417 committed 00000004:00080000:0.0:1746147242.491763:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2401 committed 00000001:00080000:0.0:1746147242.491781:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945217 is committed 00000001:00080000:0.0:1746147242.491817:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945225 is committed 00010000:00010000:0.0:1746147242.491883:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.491891:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.491898:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.491904:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c891c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147242.491908:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.491915:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.491930:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.491933:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147242.491959:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147242.491965:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c891c00/0xb4b2209fbdacefc1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147242.492095:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466912896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147242.492141:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147242.492190:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466913408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147242.492206:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147242.492237:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147242.492243:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466912512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147242.492264:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147242.492275:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466913024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147242.492289:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147242.492307:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466912896 00000100:00100000:0.0:1746147242.492314:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466912896 00000100:00100000:0.0:1746147242.495067:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14799 00000100:00100000:0.0:1746147242.495071:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466912896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147242.495248:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466912896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (3107us total) trans 17179873841 rc 0/0 00000100:00100000:0.0:1746147242.495253:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14799 00000100:00100000:0.0:1746147242.498036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.521885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.543849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.543902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557610:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.557737:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465399936 00000100:00100000:0.0:1746147242.557746:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465399936 00000100:00100000:0.0:1746147242.557785:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465400192 00000100:00100000:0.0:1746147242.557787:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465400192 00000100:00100000:0.0:1746147242.557798:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465400448 00000100:00100000:0.0:1746147242.557799:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465400448 00000100:00100000:0.0:1746147242.557808:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465400064 00000100:00100000:0.0:1746147242.557809:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465400064 00000100:00100000:0.0:1746147242.557816:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465400320 00000100:00100000:0.0:1746147242.557818:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465400320 00000100:00100000:0.0:1746147242.557825:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465400576 00000100:00100000:0.0:1746147242.557827:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465400576 00000100:00100000:0.0:1746147242.557838:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14802 00000100:00100000:0.0:1746147242.557844:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465399936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.557863:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.557884:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb798 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147242.557908:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417aa, atime: 0x681417a8, ctime: 0x681417aa, blocks: 0x7c9 00010000:00010000:0.0:1746147242.557927:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.557928:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.557963:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb798 expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.557979:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb798 expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.557991:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b1a5200, rc 0) 00000100:00100000:0.0:1746147242.558036:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465399936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 192us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.558043:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14802 00000100:00100000:0.0:1746147242.558059:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14803 00000100:00100000:0.0:1746147242.558064:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465400192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.558070:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.558081:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdacf01c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7a6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147242.558095:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417aa, atime: 0x681417a9, ctime: 0x681417aa, blocks: 0x821 00010000:00010000:0.0:1746147242.558104:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558105:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558109:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdacf01c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7a6 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558119:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b1a4a00/0xb4b2209fbdacf01c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7a6 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558125:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b1a4a00, rc 0) 00000100:00100000:0.0:1746147242.558140:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465400192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.558146:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14803 00000100:00100000:0.0:1746147242.558155:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14804 00000100:00100000:0.0:1746147242.558159:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465400448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.558165:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.558172:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba30800/0xb4b2209fbdacf023 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7b4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147242.558182:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4939808, mtime: 0x681417a9, atime: 0x681417a9, ctime: 0x681417a9, blocks: 0x1601 00010000:00010000:0.0:1746147242.558189:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558190:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558194:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30800/0xb4b2209fbdacf023 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7b4 expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558203:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30800/0xb4b2209fbdacf023 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7b4 expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558228:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30800, rc 0) 00000100:00100000:0.0:1746147242.558243:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465400448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 84us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.558248:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14804 00000100:00100000:0.0:1746147242.558258:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14805 00000100:00100000:0.0:1746147242.558262:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465400064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.558267:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.558273:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb79f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147242.558283:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417aa, atime: 0x681417a9, ctime: 0x681417aa, blocks: 0x821 00010000:00010000:0.0:1746147242.558290:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558291:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558294:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb79f expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558302:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb79f expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558308:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba31a00, rc 0) 00000100:00100000:0.0:1746147242.558319:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465400064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.558323:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14805 00000100:00100000:0.0:1746147242.558331:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14806 00000100:00100000:0.0:1746147242.558335:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465400320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.558339:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.558345:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdacf031 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7ad expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147242.558354:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417aa, atime: 0x681417aa, ctime: 0x681417aa, blocks: 0x821 00010000:00010000:0.0:1746147242.558360:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558361:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558365:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdacf031 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ad expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558372:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdacf031 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ad expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558378:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30a00, rc 0) 00000100:00100000:0.0:1746147242.558391:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465400320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 56us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.558395:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14806 00000100:00100000:0.0:1746147242.558404:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14807 00000100:00100000:0.0:1746147242.558408:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465400576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.558413:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.558418:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba31e00/0xb4b2209fbdacf038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7bb expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147242.558429:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417a9, atime: 0x681417a9, ctime: 0x681417a9, blocks: 0x1029 00010000:00010000:0.0:1746147242.558435:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558436:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.558440:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba31e00/0xb4b2209fbdacf038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7bb expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558448:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba31e00/0xb4b2209fbdacf038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7bb expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.558454:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba31e00, rc 0) 00000100:00100000:0.0:1746147242.558466:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465400576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.558471:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14807 00000100:00100000:0.0:1746147242.574695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.594862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.594895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.594909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.594920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.594930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.594976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.595000:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465402240 00000100:00100000:0.0:1746147242.595005:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465402240 00000100:00100000:0.0:1746147242.595032:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465402368 00000100:00100000:0.0:1746147242.595033:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465402368 00000100:00100000:0.0:1746147242.595048:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465402624 00000100:00100000:0.0:1746147242.595049:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465402624 00000100:00100000:0.0:1746147242.595057:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465402880 00000100:00100000:0.0:1746147242.595058:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465402880 00000100:00100000:0.0:1746147242.595065:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465402496 00000100:00100000:0.0:1746147242.595066:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465402496 00000100:00100000:0.0:1746147242.595071:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465402752 00000100:00100000:0.0:1746147242.595073:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465402752 00000100:00100000:0.0:1746147242.595079:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14808 00000100:00100000:0.0:1746147242.595084:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465402240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.595097:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.595109:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7d0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.595126:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595128:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595136:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d0 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595148:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d0 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595157:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a825a00, rc 0) 00000100:00100000:0.0:1746147242.595181:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465402240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.595186:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14808 00000100:00100000:0.0:1746147242.595199:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14809 00000100:00100000:0.0:1746147242.595203:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465402368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.595220:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.595228:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a825e00/0xb4b2209fbdacf069 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7d7 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.595237:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595238:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595241:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a825e00/0xb4b2209fbdacf069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d7 expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595254:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a825e00/0xb4b2209fbdacf069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d7 expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595259:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a825e00, rc 0) 00000100:00100000:0.0:1746147242.595270:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465402368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 67us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.595274:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14809 00000100:00100000:0.0:1746147242.595281:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14810 00000100:00100000:0.0:1746147242.595284:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465402624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.595288:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.595293:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf070 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7e5 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.595299:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595300:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595303:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf070 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7e5 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595309:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf070 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7e5 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595314:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a825c00, rc 0) 00000100:00100000:0.0:1746147242.595322:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465402624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 38us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.595325:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14810 00000100:00100000:0.0:1746147242.595331:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14811 00000100:00100000:0.0:1746147242.595334:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465402880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.595337:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.595341:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a825600/0xb4b2209fbdacf077 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7f3 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.595347:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595348:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595351:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a825600/0xb4b2209fbdacf077 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7f3 expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595357:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a825600/0xb4b2209fbdacf077 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7f3 expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595363:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a825600, rc 0) 00000100:00100000:0.0:1746147242.595370:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465402880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.595373:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14811 00000100:00100000:0.0:1746147242.595378:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14812 00000100:00100000:0.0:1746147242.595382:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465402496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.595385:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.595388:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a824a00/0xb4b2209fbdacf07e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7de expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.595395:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595396:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595399:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a824a00/0xb4b2209fbdacf07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7de expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595407:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a824a00/0xb4b2209fbdacf07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7de expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595414:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a824a00, rc 0) 00000100:00100000:0.0:1746147242.595425:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465402496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.595430:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14812 00000100:00100000:0.0:1746147242.595438:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14813 00000100:00100000:0.0:1746147242.595442:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465402752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.595446:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.595451:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a824200/0xb4b2209fbdacf085 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7ec expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.595459:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595460:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.595464:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a824200/0xb4b2209fbdacf085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ec expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595471:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a824200/0xb4b2209fbdacf085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ec expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147242.595476:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a824200, rc 0) 00000100:00100000:0.0:1746147242.595483:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465402752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 42us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.595486:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14813 00000100:00100000:0.0:1746147242.628484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.628531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.628572:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465403008 00000100:00100000:0.0:1746147242.628582:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465403008 00010000:00010000:0.0:1746147242.628620:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132d0ac00/0xb4b2209fbdacf007 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb791 expref: 10 pid: 14049 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.628647:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465403136 00000100:00100000:0.0:1746147242.628650:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465403136 00010000:00010000:0.0:1746147242.628660:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacefe4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb78a expref: 304 pid: 14049 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.628685:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7490 00000100:00100000:0.0:1746147242.628693:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465403008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.628706:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.628711:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132d0ac00/0xb4b2209fbdacf007 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb791 expref: 10 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.628722:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132d0ac00/0xb4b2209fbdacf007 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb791 expref: 10 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.628744:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.628749:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.628756:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.628761:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.628803:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465403008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 112us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.628810:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7490 00000100:00100000:0.0:1746147242.628826:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7491 00000100:00100000:0.0:1746147242.628830:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967465403136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.628837:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.628841:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacefe4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb78a expref: 304 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.628849:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdacefe4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb78a expref: 304 pid: 14049 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.628860:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.628863:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.628869:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.628874:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.628889:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.628903:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967465403136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.628908:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7491 00000100:00100000:0.0:1746147242.655193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.676612:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6951 00000100:00100000:0.0:1746147242.676627:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465404160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.688834:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465404416 00000100:00100000:0.0:1746147242.688846:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465404416 00000100:00100000:0.0:1746147242.703488:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11271 00000100:00100000:0.0:1746147242.703506:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31412:x1830967465404416:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147242.703535:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.703538:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147242.703567:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132d0ba00/0xb4b2209fbdacf046 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7c2 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.703604:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.703609:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147242.703622:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a824800/0xb4b2209fbdacf093 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb7fa expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.703676:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132d0b800/0xb4b2209fbdacf09a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.703687:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b05e000/0xb4b2209fbdacefc8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb783 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.703693:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132d0b800/0xb4b2209fbdacf09a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.703725:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b05e000/0xb4b2209fbdacefc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb783 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.703736:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b05e000/0xb4b2209fbdacefc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb783 expref: 8 pid: 14048 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.703752:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466914944:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.703866:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.714241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.762746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.773119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.773799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.773874:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465405056 00000100:00100000:0.0:1746147242.773878:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465405056 00000100:00100000:0.0:1746147242.773896:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4669 00000100:00100000:0.0:1746147242.773901:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31420:x1830967465405056:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147242.773964:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31420:x1830967465405056:12345-192.168.203.36@tcp:49:cat.0 Request processed in 62us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.773969:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4669 00000100:00100000:0.0:1746147242.800730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.800791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.804042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.806008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.813913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.825705:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465407232 00000100:00100000:0.0:1746147242.825710:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465407232 00002000:00100000:0.0:1746147242.825728:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a56b4a80 x1830967465407232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:618/0 lens 488/0 e 0 to 0 dl 1746147253 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.825736:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4a80 with x1830967465407232 ext(1048576->2097151) 00002000:00010000:0.0:1746147242.825739:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b4a80 00000100:00100000:0.0:1746147242.825753:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6956 00000100:00100000:0.0:1746147242.825759:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465406848:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147242.826020:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465406848:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 260us (747us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147242.826027:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6956 00002000:00100000:0.0:1746147242.826430:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2818048->2822143) req@ffff8800a56b5c00 x1830967465406848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:618/0 lens 488/4536 e 0 to 0 dl 1746147253 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.826438:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5c00 with x1830967465406848 ext(2818048->2822143) 00002000:00010000:0.0:1746147242.826441:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b5c00 00000100:00100000:0.0:1746147242.826457:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6957 00000100:00100000:0.0:1746147242.826537:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465407360:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147242.843686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.847689:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465407232:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 20710us (22394us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147242.847699:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6958 00002000:00100000:0.0:1746147242.847708:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a56b4a80 x1830967465407232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:618/0 lens 488/440 e 0 to 0 dl 1746147253 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.847716:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4a80 with x1830967465407232 ext(1048576->2097151) 00002000:00010000:0.0:1746147242.847722:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b4a80 00000100:00100000:0.0:1746147242.856263:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465407872 00000100:00100000:0.0:1746147242.856274:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465407872 00010000:00010000:0.0:1746147242.856304:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7c9 expref: 8 pid: 16361 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.856325:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7495 00000100:00100000:0.0:1746147242.856332:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1958:x1830967465407872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.856345:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.856350:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7c9 expref: 8 pid: 16361 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.856361:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7c9 expref: 8 pid: 16361 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.856382:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdacf05b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7c9 expref: 8 pid: 16361 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.856409:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.856416:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.856425:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.856431:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.856454:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.856480:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1958:x1830967465407872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 148us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.856485:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7495 00000100:00100000:0.0:1746147242.862664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.868054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.868082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.868096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.868107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.868119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.869116:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465408640 00000100:00100000:0.0:1746147242.869119:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465408640 00000100:00100000:0.0:1746147242.870099:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465409152 00000100:00100000:0.0:1746147242.870103:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465409152 00002000:00100000:0.0:1746147242.870124:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3665919) req@ffff88009b50ea00 x1830967465409152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:618/0 lens 504/0 e 0 to 0 dl 1746147253 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.870131:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50ea00 with x1830967465409152 ext(2097152->3665919) 00002000:00010000:0.0:1746147242.870134:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50ea00 00000100:00100000:0.0:1746147242.870145:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6960 00000100:00100000:0.0:1746147242.870150:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465409152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.872671:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465409664 00000100:00100000:0.0:1746147242.872675:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465409664 00002000:00100000:0.0:1746147242.872688:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008f9ff480 x1830967465409664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:618/0 lens 488/0 e 0 to 0 dl 1746147253 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.872694:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff480 with x1830967465409664 ext(2097152->3145727) 00002000:00010000:0.0:1746147242.872697:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ff480 00000100:00100000:0.0:1746147242.872706:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6961 00000100:00100000:0.0:1746147242.872712:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465409408:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.882333:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465410176 00000100:00100000:0.0:1746147242.882343:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465410176 00000100:00100000:0.0:1746147242.882765:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11275 00000100:00100000:0.0:1746147242.882773:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31422:x1830967465410176:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147242.882794:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.882812:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdacf0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb847 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.882901:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.882914:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.882920:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.882970:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.882980:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 8 pid: 16361 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.882991:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466918144:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.883063:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.902725:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465410432 00000100:00100000:0.0:1746147242.902734:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465410432 00010000:00010000:0.0:1746147242.902764:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 9 pid: 16361 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.902794:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7496 00000100:00100000:0.0:1746147242.902800:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465410432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.902813:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.902818:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 9 pid: 16361 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.902834:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 9 pid: 16361 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.902856:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.902860:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.902868:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.902874:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.902888:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.902900:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465410432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.902905:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7496 00010000:00010000:0.0:1746147242.902932:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3600/0xb4b2209fbdacf0cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb816 expref: 8 pid: 16361 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.902965:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466918144:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147242.902975:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.902983:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147242.902987:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147242.903009:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147242.903155:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdacf0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb847 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.903164:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdacf103 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb847 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.903169:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147242.903172:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147242.903174:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568000, rc 0) 00000100:00100000:0.0:1746147242.903189:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31422:x1830967465410176:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 20417us (20994us total) trans 8589945236 rc 0/0 00000100:00100000:0.0:1746147242.903195:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11275 00000100:00100000:0.0:1746147242.911660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.911708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.911737:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465410688 00000100:00100000:0.0:1746147242.911744:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465410688 00010000:00010000:0.0:1746147242.911777:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf0e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb832 expref: 7 pid: 21080 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.911805:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7497 00000100:00100000:0.0:1746147242.911812:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465410688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.911825:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.911845:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf0e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb832 expref: 7 pid: 21080 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.911861:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf0e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb832 expref: 7 pid: 21080 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.911885:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.911924:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465410688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.911930:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7497 00000100:00100000:0.0:1746147242.911980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.911998:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465410816 00000100:00100000:0.0:1746147242.912001:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465410816 00000100:00100000:0.0:1746147242.912019:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14840 00000100:00100000:0.0:1746147242.912024:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31415:x1830967465410816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.912038:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.912050:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f569400/0xb4b2209fbdacf11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb85c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.912067:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf0af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb80f expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.912073:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147242.912075:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147242.912078:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f569400/0xb4b2209fbdacf11f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb85c expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.912105:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf0af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2822143) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb80f expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.912121:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf0af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2822143) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb80f expref: 26 pid: 21080 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746147242.912133:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466918784:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147242.912198:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.912296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.912306:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465411072 00000100:00100000:0.0:1746147242.912308:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465411072 00010000:00010000:0.0:1746147242.912319:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf070 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7e5 expref: 27 pid: 4444 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.912333:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7498 00000100:00100000:0.0:1746147242.912338:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465411072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.912345:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.912352:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf070 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7e5 expref: 27 pid: 4444 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.912359:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf070 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7e5 expref: 27 pid: 4444 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.912370:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.912384:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465411072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.912389:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7498 00000100:00100000:0.0:1746147242.912415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.912425:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465410944 00000100:00100000:0.0:1746147242.912427:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465410944 00010000:00010000:0.0:1746147242.912435:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdacf031 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ad expref: 25 pid: 17548 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746147242.912446:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7499 00000100:00100000:0.0:1746147242.912449:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465410944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147242.912455:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147242.912460:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdacf031 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ad expref: 25 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.912468:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0xb4b2209fbdacf031 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7ad expref: 25 pid: 17548 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746147242.912475:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.912476:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147242.912482:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb855 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.912489:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb855 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.912508:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb855 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.912517:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466918912:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147242.912534:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147242.912570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.916400:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466918912:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147242.916412:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147242.916433:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465410944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3982us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.916440:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7499 00000100:00100000:0.0:1746147242.919734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.932845:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465412096 00000100:00100000:0.0:1746147242.932854:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465412096 00000100:00100000:0.0:1746147242.932888:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14843 00000100:00100000:0.0:1746147242.932895:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31419:x1830967465412096:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147242.932908:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.932922:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f569800/0xb4b2209fbdacf142 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb878 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.932966:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147242.932971:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f569400/0xb4b2209fbdacf11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb85c expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.932977:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147242.932980:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f569800/0xb4b2209fbdacf142 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->2285567] (req 2097152->2285567) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb878 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.933019:0:17530:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f569400/0xb4b2209fbdacf11f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb85c expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.933030:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f569800/0xb4b2209fbdacf142 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->2285567] (req 2097152->2285567) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb878 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147242.933045:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569800, rc 0) 00000100:00100000:0.0:1746147242.933063:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31419:x1830967465412096:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 169us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147242.933068:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14843 00000100:00100000:0.0:1746147242.936918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.945378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.953372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.953409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.953438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.953452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.954993:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6965 00000100:00100000:0.0:1746147242.955001:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134feaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465413248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.957538:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6966 00000100:00100000:0.0:1746147242.957552:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134fe9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465413376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147242.977005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.978917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147242.985700:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465412992:12345-192.168.203.36@tcp:3:cat.0 Request processed in 31045us (32331us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147242.985711:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2420 00002000:00100000:0.0:1746147242.985723:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012b0c1c00 x1830967465412992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:618/0 lens 488/440 e 0 to 0 dl 1746147253 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147242.985732:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1c00 with x1830967465412992 ext(3145728->4194303) 00010000:00010000:0.0:1746147242.985741:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f569400/0xb4b2209fbdacf11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb85c expref: 23 pid: 17530 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746147242.985755:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f569400/0xb4b2209fbdacf11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb85c expref: 23 pid: 17530 timeout: 729 lvb_type: 0 00002000:00010000:0.0:1746147242.985762:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b0c1c00 00000100:00100000:0.0:1746147242.996849:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465414016 00000100:00100000:0.0:1746147242.996858:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465414016 00000100:00100000:0.0:1746147242.997158:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14846 00000100:00100000:0.0:1746147242.997166:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465413888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147242.997183:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147242.997196:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9dc000/0xb4b2209fbdacf165 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb88d expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147242.997254:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134fe9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466919808:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147242.997302:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.005463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.005511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.006312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.032520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.044168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.057628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.081772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.088907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.094756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.102873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.114332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.119823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.119869:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466919936:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147243.119892:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdacf1a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8be expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.119905:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094683a00, rc 0) 00000100:00100000:0.0:1746147243.120755:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31428:x1830967465416576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5237us (6429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.120763:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14852 00000100:00100000:0.0:1746147243.120823:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465416704 00000100:00100000:0.0:1746147243.120829:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465416704 00002000:00100000:0.0:1746147243.120852:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1241088->2097151) req@ffff88009107b480 x1830967465416704/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:619/0 lens 488/0 e 0 to 0 dl 1746147254 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.120858:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107b480 with x1830967465416704 ext(1241088->2097151) 00010000:00010000:0.0:1746147243.120862:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb855 expref: 23 pid: 21080 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.120870:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb855 expref: 23 pid: 21080 timeout: 730 lvb_type: 0 00002000:00010000:0.0:1746147243.120874:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009107b480 00000100:00100000:0.0:1746147243.120892:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2422 00000100:00100000:0.0:1746147243.120898:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465416704:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147243.142418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.146545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.153297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.154187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.160430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.164272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.164320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.165179:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6971 00000100:00100000:0.0:1746147243.165186:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465417984:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147243.178016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.178319:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465417984:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13132us (13997us total) trans 0 rc 765952/765952 00000100:00100000:0.0:1746147243.178328:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6971 00002000:00100000:0.0:1746147243.178337:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1814527) req@ffff88012df7a300 x1830967465417984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:619/0 lens 488/440 e 0 to 0 dl 1746147254 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.178346:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7a300 with x1830967465417984 ext(1048576->1814527) 00002000:00010000:0.0:1746147243.178350:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7a300 00000100:00100000:0.0:1746147243.183286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.197871:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465418624 00000100:00100000:0.0:1746147243.197879:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465418624 00000100:00100000:0.0:1746147243.197912:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4676 00000100:00100000:0.0:1746147243.197918:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094363450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31428:x1830967465418624:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147243.198119:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094363450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:31428:x1830967465418624:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 200us (581us total) trans 8589945243 rc 0/0 00000100:00100000:0.0:1746147243.198125:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4676 00000100:00100000:0.0:1746147243.203618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.209581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.218999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.219040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.268903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.330332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.342731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.342778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.346269:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14857 00000100:00100000:0.0:1746147243.346279:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465420288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147243.346288:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.346302:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb8f6 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.346320:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.346321:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.346327:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8f6 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.346339:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8f6 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.346347:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077400, rc 0) 00000100:00100000:0.0:1746147243.346389:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465420288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 112us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.346395:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14857 00000100:00100000:0.0:1746147243.361477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.393508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.398794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.398822:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465420800 00000100:00100000:0.0:1746147243.398829:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465420800 00002000:00100000:0.0:1746147243.398862:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1814528->2097151) req@ffff8801307ed500 x1830967465420800/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:619/0 lens 488/0 e 0 to 0 dl 1746147254 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.398870:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ed500 with x1830967465420800 ext(1814528->2097151) 00010000:00010000:0.0:1746147243.398876:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdacf1a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8be expref: 32 pid: 21080 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.398887:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdacf1a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8be expref: 32 pid: 21080 timeout: 730 lvb_type: 0 00002000:00010000:0.0:1746147243.398892:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801307ed500 00000100:00100000:0.0:1746147243.398917:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2425 00000100:00100000:0.0:1746147243.398924:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465420800:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147243.415041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.431615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.434868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.448324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.457776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.457812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.457836:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465421824 00000100:00100000:0.0:1746147243.457841:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465421824 00010000:00010000:0.0:1746147243.457861:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3800/0xb4b2209fbdacf0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb81d expref: 6 pid: 21080 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.457878:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465421952 00000100:00100000:0.0:1746147243.457880:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465421952 00010000:00010000:0.0:1746147243.457888:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf015 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb798 expref: 31 pid: 17548 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.457900:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7506 00000100:00100000:0.0:1746147243.457906:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465421824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.457915:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.457933:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3800/0xb4b2209fbdacf0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb81d expref: 6 pid: 21080 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.457957:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3800/0xb4b2209fbdacf0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb81d expref: 6 pid: 21080 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.457973:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3800/0xb4b2209fbdacf0d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb81d expref: 6 pid: 21080 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.457988:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.458009:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1959:x1830967465421824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.458015:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7506 00000100:00100000:0.0:1746147243.458027:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7507 00000100:00100000:0.0:1746147243.458031:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465421952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.458037:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.458043:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf015 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb798 expref: 31 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.458051:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb798 expref: 31 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.458065:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.458075:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465421952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.458080:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7507 00000100:00100000:0.0:1746147243.461372:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465421696 00000100:00100000:0.0:1746147243.461379:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465421696 00010000:00010000:0.0:1746147243.461404:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d0 expref: 33 pid: 4444 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.461433:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7508 00000100:00100000:0.0:1746147243.461438:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465421696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.461447:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.461463:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d0 expref: 33 pid: 4444 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.461472:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d0 expref: 33 pid: 4444 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.461489:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a825a00/0xb4b2209fbdacf062 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7d0 expref: 33 pid: 4444 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.461498:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.461500:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.461505:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132d0b200/0xb4b2209fbdacf222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb904 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.461516:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132d0b200/0xb4b2209fbdacf222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb904 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.461539:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132d0b200/0xb4b2209fbdacf222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb904 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147243.461548:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466921728:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147243.462029:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.462502:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465421184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30735us (30893us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147243.462509:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6976 00002000:00100000:0.0:1746147243.462516:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8801307ef480 x1830967465421184/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:619/0 lens 488/440 e 0 to 0 dl 1746147254 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.462524:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ef480 with x1830967465421184 ext(1048576->2097151) 00002000:00010000:0.0:1746147243.462528:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307ef480 00000100:00100000:0.0:1746147243.463032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.463063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.480371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.480418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.481753:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.482731:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465422976 00000100:00100000:0.0:1746147243.482736:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465422976 00000100:00100000:0.0:1746147243.482770:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14861 00000100:00100000:0.0:1746147243.482776:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31441:x1830967465422976:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147243.482787:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.482798:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f568e00/0xb4b2209fbdacf245 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb920 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.482816:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.482820:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d560a00/0xb4b2209fbdacf23e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->1351679] (req 1048576->1351679) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb912 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.482825:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147243.482827:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568e00/0xb4b2209fbdacf245 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1167360->1441791] (req 1167360->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb920 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.482850:0:11147:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d560a00/0xb4b2209fbdacf23e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->1351679] (req 1048576->1351679) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb912 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.482859:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f568e00/0xb4b2209fbdacf245 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1167360->1441791] (req 1167360->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb920 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.482867:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568e00, rc 0) 00000100:00100000:0.0:1746147243.482894:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31441:x1830967465422976:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.482900:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14861 00000100:00100000:0.0:1746147243.490649:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.490670:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465423616 00000100:00100000:0.0:1746147243.490677:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465423616 00010000:00010000:0.0:1746147243.490702:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb79f expref: 19 pid: 17548 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.490730:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7513 00000100:00100000:0.0:1746147243.490736:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465423616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.490746:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.490762:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb79f expref: 19 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.490771:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb79f expref: 19 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.490787:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0xb4b2209fbdacf02a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb79f expref: 19 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.490801:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.490802:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.490807:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d560a00/0xb4b2209fbdacf23e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb912 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.490813:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d560a00/0xb4b2209fbdacf23e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb912 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.490838:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d560a00/0xb4b2209fbdacf23e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb912 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.490847:0:7119:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d560a00/0xb4b2209fbdacf23e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb912 expref: 18 pid: 21080 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746147243.490860:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466922368:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147243.490904:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.497542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.497574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.497602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.498695:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466922368:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147243.498706:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.498738:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465423616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8002us (8093us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.498746:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7513 00000100:00100000:0.0:1746147243.507404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.507454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.516311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.516368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.516393:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465424896 00000100:00100000:0.0:1746147243.516400:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465424896 00000100:00100000:0.0:1746147243.516453:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465425024 00000100:00100000:0.0:1746147243.516456:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465425024 00000100:00100000:0.0:1746147243.516472:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14865 00000100:00100000:0.0:1746147243.516478:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31444:x1830967465424896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147243.516491:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.516504:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f569200/0xb4b2209fbdacf284 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb93c expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.516528:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132d0b200/0xb4b2209fbdacf222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb904 expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.516535:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147243.516536:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147243.516539:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f569200/0xb4b2209fbdacf284 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb93c expref: 34 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.516563:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132d0b200/0xb4b2209fbdacf222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb904 expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.516572:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132d0b200/0xb4b2209fbdacf222 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb904 expref: 26 pid: 21080 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746147243.516582:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466922752:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147243.516962:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.520788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.535047:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465425920 00000100:00100000:0.0:1746147243.535053:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465425920 00002000:00100000:0.0:1746147243.535078:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1167360->1171455) req@ffff88008f9fdc00 x1830967465425920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:619/0 lens 488/0 e 0 to 0 dl 1746147254 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.535086:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdc00 with x1830967465425920 ext(1167360->1171455) 00002000:00010000:0.0:1746147243.535089:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fdc00 00000100:00100000:0.0:1746147243.535102:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6978 00000100:00100000:0.0:1746147243.535107:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465425920:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147243.535191:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465425920:12345-192.168.203.36@tcp:3:cat.0 Request processed in 83us (525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147243.535198:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6978 00002000:00100000:0.0:1746147243.535214:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1167360->1171455) req@ffff88008f9fdc00 x1830967465425920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:619/0 lens 488/4536 e 0 to 0 dl 1746147254 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.535221:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdc00 with x1830967465425920 ext(1167360->1171455) 00002000:00010000:0.0:1746147243.535224:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fdc00 00000100:00100000:0.0:1746147243.539387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.539418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.540188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.545271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.554491:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.554528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.554560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.555566:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6982 00000100:00100000:0.0:1746147243.555572:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465427200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147243.586967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.704281:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465427840 00000100:00100000:0.0:1746147243.704290:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465427840 00000100:00100000:0.0:1746147243.704340:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11283 00000100:00100000:0.0:1746147243.704347:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31451:x1830967465427840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147243.704366:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.704379:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e800/0xb4b2209fbdacf2ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb966 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.704462:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704475:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704484:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704493:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704498:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704502:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704585:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704592:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704598:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147243.704604:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147243.704667:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704672:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704677:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704684:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009812aa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147243.704688:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704693:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704701:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147243.704704:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147243.704707:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704711:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009812aa00/0xb4b2209fbdacf2b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704719:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704723:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704728:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704732:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009812b200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147243.704734:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704738:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704743:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f700) 00010000:00010000:0.0:1746147243.704744:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147243.704747:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704751:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009812b200/0xb4b2209fbdacf2bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147243.704778:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e800/0xb4b2209fbdacf2ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb966 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.704787:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb966 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.704792:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147243.704793:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147243.704795:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009812a600, rc 0) 00000100:00100000:0.0:1746147243.704847:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31451:x1830967465427840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 500us (1256us total) trans 8589945250 rc 0/0 00000100:00100000:0.0:1746147243.704853:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11283 00000100:00100000:0.0:1746147243.707011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.711895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.714810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.727414:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465428608 00000100:00100000:0.0:1746147243.727422:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465428608 00002000:00100000:0.0:1746147243.727454:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800b52e0e00 x1830967465428608/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:619/0 lens 488/0 e 0 to 0 dl 1746147254 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147243.727463:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0e00 with x1830967465428608 ext(0->1048575) 00002000:00010000:0.0:1746147243.727468:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0e00 00000100:00100000:0.0:1746147243.727493:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6984 00000100:00100000:0.0:1746147243.727498:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465428608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147243.745501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.752246:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.755501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.764284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.766737:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.775159:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.775194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.775230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.775260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.775285:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465429888 00000100:00100000:0.0:1746147243.775288:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465429888 00000100:00100000:0.0:1746147243.775304:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465430016 00000100:00100000:0.0:1746147243.775312:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465430016 00000100:00100000:0.0:1746147243.775321:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465430144 00000100:00100000:0.0:1746147243.775323:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465430144 00000100:00100000:0.0:1746147243.775333:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14873 00000100:00100000:0.0:1746147243.775337:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465429888:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147243.775343:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.775353:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f37cc00/0xb4b2209fbdacf325 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb990 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.775364:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.775365:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.775371:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f37cc00/0xb4b2209fbdacf325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb990 expref: 7 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.775382:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f37cc00/0xb4b2209fbdacf325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb990 expref: 7 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.775394:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f37cc00, rc 0) 00000100:00100000:0.0:1746147243.775424:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465429888:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.775429:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14873 00000100:00100000:0.0:1746147243.775442:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14874 00000100:00100000:0.0:1746147243.775446:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465430016:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147243.775451:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.775459:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdacf33a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb997 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147243.775489:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466924032:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147243.775536:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.775551:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14875 00000100:00100000:0.0:1746147243.775555:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465430144:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147243.775560:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.775566:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f803600/0xb4b2209fbdacf34f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb99e expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.775574:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.775575:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.775579:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f803600/0xb4b2209fbdacf34f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb99e expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.775586:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f803600/0xb4b2209fbdacf34f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb99e expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.775597:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f803600, rc 0) 00000100:00100000:0.0:1746147243.775608:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465430144:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.775613:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14875 00000100:00100000:0.0:1746147243.780409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.780543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.783685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.784423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.790638:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465430912 00000100:00100000:0.0:1746147243.790645:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465430912 00010000:00010000:0.0:1746147243.790673:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3a00/0xb4b2209fbdacf341 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb989 expref: 315 pid: 16361 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746147243.790691:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465431040 00000100:00100000:0.0:1746147243.790692:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465431040 00010000:00010000:0.0:1746147243.790699:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3400/0xb4b2209fbdacf2f4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb97b expref: 11 pid: 16361 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746147243.790712:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7516 00000100:00100000:0.0:1746147243.790718:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1956:x1830967465430912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.790728:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.790732:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3a00/0xb4b2209fbdacf341 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb989 expref: 315 pid: 16361 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.790741:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3a00/0xb4b2209fbdacf341 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb989 expref: 315 pid: 16361 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.790761:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147243.790765:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf36b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147243.790774:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf36b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147243.790779:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.790811:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1956:x1830967465430912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.790817:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7516 00000100:00100000:0.0:1746147243.790831:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7517 00000100:00100000:0.0:1746147243.790836:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465431040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.790842:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.790846:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3400/0xb4b2209fbdacf2f4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb97b expref: 11 pid: 16361 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.790852:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3400/0xb4b2209fbdacf2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb97b expref: 11 pid: 16361 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.790861:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147243.790863:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf36b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147243.790869:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf36b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147243.790874:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3000/0xb4b2209fbdacf36b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147243.790885:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.790896:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465431040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.790900:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7517 00000100:00100000:0.0:1746147243.797326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.797370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.804819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.804856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.840056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.852121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.852208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.852230:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465432448 00000100:00100000:0.0:1746147243.852237:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465432448 00000100:00100000:0.0:1746147243.852283:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14879 00000100:00100000:0.0:1746147243.852290:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465432448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147243.852305:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147243.852319:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f802000/0xb4b2209fbdacf39c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eb9cf expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.852339:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.852341:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.852348:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f802000/0xb4b2209fbdacf39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9cf expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.852360:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f802000/0xb4b2209fbdacf39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9cf expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147243.852374:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f802000, rc 0) 00000100:00100000:0.0:1746147243.852408:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465432448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.852412:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14879 00000100:00100000:0.0:1746147243.868877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.906087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.914781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.915913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.918394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.921400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.931420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.931683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.938407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.938422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.938447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.938460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.938479:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465433856 00000100:00100000:0.0:1746147243.938486:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465433856 00010000:00010000:0.0:1746147243.938513:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094763a00/0xb4b2209fbdacf0f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb840 expref: 9 pid: 11147 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.938534:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465434240 00000100:00100000:0.0:1746147243.938536:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465434240 00010000:00010000:0.0:1746147243.938543:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba31e00/0xb4b2209fbdacf038 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7bb expref: 22 pid: 17548 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.938559:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465433984 00000100:00100000:0.0:1746147243.938560:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465433984 00010000:00010000:0.0:1746147243.938567:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092885600/0xb4b2209fbdacf387 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9c1 expref: 10 pid: 6881 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.938574:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465434368 00000100:00100000:0.0:1746147243.938575:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465434368 00010000:00010000:0.0:1746147243.938582:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f802000/0xb4b2209fbdacf39c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9cf expref: 29 pid: 8481 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.938591:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7523 00000100:00100000:0.0:1746147243.938597:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465433856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.938609:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.938626:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094763a00/0xb4b2209fbdacf0f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb840 expref: 10 pid: 11147 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938635:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094763a00/0xb4b2209fbdacf0f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb840 expref: 10 pid: 11147 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938654:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.938683:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465433856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.938688:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7523 00000100:00100000:0.0:1746147243.938702:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7524 00000100:00100000:0.0:1746147243.938706:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465434240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.938714:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.938720:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba31e00/0xb4b2209fbdacf038 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7bb expref: 22 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938727:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba31e00/0xb4b2209fbdacf038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7bb expref: 22 pid: 17548 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938736:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.938747:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465434240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.938752:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7524 00000100:00100000:0.0:1746147243.938760:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7525 00000100:00100000:0.0:1746147243.938764:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465433984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.938769:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.938778:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092885600/0xb4b2209fbdacf387 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9c1 expref: 9 pid: 6881 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938784:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092885600/0xb4b2209fbdacf387 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9c1 expref: 9 pid: 6881 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938793:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.938805:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465433984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.938809:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7525 00000100:00100000:0.0:1746147243.938817:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7526 00000100:00100000:0.0:1746147243.938821:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465434368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.938826:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.938832:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f802000/0xb4b2209fbdacf39c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9cf expref: 29 pid: 8481 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938839:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f802000/0xb4b2209fbdacf39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9cf expref: 29 pid: 8481 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938846:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.938857:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465434368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.938861:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7526 00000100:00100000:0.0:1746147243.938887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.938898:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465434112 00000100:00100000:0.0:1746147243.938901:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465434112 00010000:00010000:0.0:1746147243.938909:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a825600/0xb4b2209fbdacf077 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7f3 expref: 29 pid: 4444 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.938920:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7527 00000100:00100000:0.0:1746147243.938924:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465434112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.938929:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.938959:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a825600/0xb4b2209fbdacf077 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7f3 expref: 29 pid: 4444 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938967:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a825600/0xb4b2209fbdacf077 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb7f3 expref: 29 pid: 4444 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.938975:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.938978:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.938983:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131ba1600/0xb4b2209fbdacf3aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9dd expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.938989:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131ba1600/0xb4b2209fbdacf3aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9dd expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.939013:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131ba1600/0xb4b2209fbdacf3aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9dd expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147243.939022:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466926080:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147243.939071:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.939127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.939138:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465434496 00000100:00100000:0.0:1746147243.939140:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465434496 00010000:00010000:0.0:1746147243.939149:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091234800/0xb4b2209fbdacf35d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9ac expref: 22 pid: 6881 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746147243.939159:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7528 00000100:00100000:0.0:1746147243.939163:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465434496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.939168:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.939175:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091234800/0xb4b2209fbdacf35d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9ac expref: 22 pid: 6881 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.939182:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091234800/0xb4b2209fbdacf35d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9ac expref: 22 pid: 6881 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746147243.939194:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.939195:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147243.939198:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e9d3400/0xb4b2209fbdacf3b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9e4 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.939223:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9d3400/0xb4b2209fbdacf3b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9e4 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147243.939239:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e9d3400/0xb4b2209fbdacf3b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9e4 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147243.939247:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466926208:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147243.939264:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147243.945130:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466926208:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147243.945144:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.945829:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465434496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6663us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.945836:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7528 00000100:00100000:0.0:1746147243.947188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.948980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.956194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.957405:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465435392 00000100:00100000:0.0:1746147243.957408:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465435392 00010000:00010000:0.0:1746147243.957422:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8f6 expref: 29 pid: 8480 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.957440:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465435520 00000100:00100000:0.0:1746147243.957442:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465435520 00010000:00010000:0.0:1746147243.957451:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091234c00/0xb4b2209fbdacf356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9a5 expref: 7 pid: 6881 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746147243.957463:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7530 00000100:00100000:0.0:1746147243.957468:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465435392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147243.957474:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147243.957483:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8f6 expref: 29 pid: 8480 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.957490:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8f6 expref: 29 pid: 8480 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.957501:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdacf214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8f6 expref: 29 pid: 8480 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746147243.957511:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147243.958529:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465435392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1060us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147243.958534:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7530 00000100:00100000:0.0:1746147243.961583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.964115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.975255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147243.978179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.023604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147244.024160:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147244.024613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147244.025023:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147244.030809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.037706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.055827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.063293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.085301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.091427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.093744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.096377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.099617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.099643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.099666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.100703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.101070:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14889 00000100:00100000:0.0:1746147244.101076:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465438336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147244.101083:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.101095:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdacf405 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eba1c expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.101109:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.101111:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.101117:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdacf405 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba1c expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.101128:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdacf405 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba1c expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.101136:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b076a00, rc 0) 00000100:00100000:0.0:1746147244.102133:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465438336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1054us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.102138:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14889 00000100:00100000:0.0:1746147244.106985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147244.108325:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147244.116829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.116885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147244.117633:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147244.148485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.150640:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465440384 00000100:00100000:0.0:1746147244.150646:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465440384 00002000:00100000:0.0:1746147244.150666:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3796992->4194303) req@ffff88009b50ea00 x1830967465440384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:620/0 lens 488/0 e 0 to 0 dl 1746147255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.150674:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50ea00 with x1830967465440384 ext(3796992->4194303) 00002000:00010000:0.0:1746147244.150677:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50ea00 00000100:00100000:0.0:1746147244.150697:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6995 00000100:00100000:0.0:1746147244.150702:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967465440384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147244.156397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.156435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.157011:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465439744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27706us (27913us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147244.157190:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6992 00002000:00100000:0.0:1746147244.157210:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800b52e2d80 x1830967465439744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:620/0 lens 488/440 e 0 to 0 dl 1746147255 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.157218:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967465439744 ext(0->1048575) 00002000:00010000:0.0:1746147244.157221:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2d80 00000100:00100000:0.0:1746147244.187319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.187428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.200462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.208921:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465441664 00000100:00100000:0.0:1746147244.208927:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465441664 00002000:00100000:0.0:1746147244.208967:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4943871) req@ffff88008f9fe300 x1830967465441664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:620/0 lens 488/0 e 0 to 0 dl 1746147255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.208975:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe300 with x1830967465441664 ext(4194304->4943871) 00002000:00010000:0.0:1746147244.208979:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fe300 00000100:00100000:0.0:1746147244.208996:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6998 00000100:00100000:0.0:1746147244.209002:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465441664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147244.240587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.257249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.257908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.257971:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465442048 00000100:00100000:0.0:1746147244.257977:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465442048 00000100:00100000:0.0:1746147244.272117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.272138:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.272158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.272188:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465442304 00000100:00100000:0.0:1746147244.272194:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465442304 00010000:00010000:0.0:1746147244.272239:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f803600/0xb4b2209fbdacf34f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb99e expref: 6 pid: 11147 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1746147244.272263:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465442176 00000100:00100000:0.0:1746147244.272265:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465442176 00010000:00010000:0.0:1746147244.272274:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3c00/0xb4b2209fbdacf276 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb935 expref: 37 pid: 17530 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1746147244.272284:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465442432 00000100:00100000:0.0:1746147244.272285:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465442432 00010000:00010000:0.0:1746147244.272294:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf21b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8fd expref: 30 pid: 21080 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746147244.272304:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7538 00000100:00100000:0.0:1746147244.272310:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465442304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147244.272320:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147244.272338:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f803600/0xb4b2209fbdacf34f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb99e expref: 6 pid: 11147 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746147244.272346:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f803600/0xb4b2209fbdacf34f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb99e expref: 6 pid: 11147 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746147244.272365:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147244.272397:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465442304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.272402:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7538 00000100:00100000:0.0:1746147244.272416:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7539 00000100:00100000:0.0:1746147244.272420:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465442176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147244.272427:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147244.272434:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3c00/0xb4b2209fbdacf276 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb935 expref: 37 pid: 17530 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746147244.272442:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9d3c00/0xb4b2209fbdacf276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb935 expref: 37 pid: 17530 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746147244.272451:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147244.272463:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465442176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 43us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.272468:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7539 00000100:00100000:0.0:1746147244.272477:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7540 00000100:00100000:0.0:1746147244.272480:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465442432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147244.272485:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147244.272491:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf21b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8fd expref: 30 pid: 21080 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.272497:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb8fd expref: 30 pid: 21080 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.272506:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.272508:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.272513:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d561200/0xb4b2209fbdacf459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1372160->2019327) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba54 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.272520:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d561200/0xb4b2209fbdacf459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1372160->2019327) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba54 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.272544:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d561200/0xb4b2209fbdacf459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1372160->2019327) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba54 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.272554:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466929152:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147244.272601:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00080000:0.0:1746147244.272614:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147244.276016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.280687:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466929152:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147244.280705:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147244.280741:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465442432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8258us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.280751:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7540 00000100:00100000:0.0:1746147244.280838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.280894:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465442816 00000100:00100000:0.0:1746147244.280899:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465442816 00002000:00100000:0.0:1746147244.280925:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1372160->1376255) req@ffff8800936dd880 x1830967465442816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:620/0 lens 488/0 e 0 to 0 dl 1746147255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.280934:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830967465442816 ext(1372160->1376255) 00002000:00010000:0.0:1746147244.280954:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd880 00000100:00100000:0.0:1746147244.280967:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6999 00000100:00100000:0.0:1746147244.280974:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465442816:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147244.281079:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465442816:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 105us (241us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147244.281087:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6999 00002000:00100000:0.0:1746147244.281091:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1372160->1376255) req@ffff8800936dd880 x1830967465442816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:620/0 lens 488/4536 e 0 to 0 dl 1746147255 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.281098:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830967465442816 ext(1372160->1376255) 00002000:00010000:0.0:1746147244.281101:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd880 00000100:00100000:0.0:1746147244.291847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.292020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.292043:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443072 00000100:00100000:0.0:1746147244.292048:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443072 00010000:00010000:0.0:1746147244.292067:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf421 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba31 expref: 317 pid: 16361 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746147244.292091:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7542 00000100:00100000:0.0:1746147244.292098:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967465443072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147244.292107:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147244.292112:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf421 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba31 expref: 317 pid: 16361 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.292888:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf421 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba31 expref: 317 pid: 16361 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.292906:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdacf421 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba31 expref: 317 pid: 16361 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.292922:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147244.292926:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf475 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147244.292935:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf475 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147244.292972:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb4b2209fbdacf475 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147244.293338:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147244.293364:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465443072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1267us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.293370:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7542 00000100:00100000:0.0:1746147244.296082:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443200 00000100:00100000:0.0:1746147244.296089:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443200 00010000:00010000:0.0:1746147244.296123:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092885800/0xb4b2209fbdacf3b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9eb expref: 35 pid: 8480 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746147244.296181:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7543 00000100:00100000:0.0:1746147244.296188:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465443200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147244.296206:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147244.296224:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092885800/0xb4b2209fbdacf3b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9eb expref: 35 pid: 8480 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.296233:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092885800/0xb4b2209fbdacf3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9eb expref: 35 pid: 8480 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.296248:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092885800/0xb4b2209fbdacf3b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb9eb expref: 35 pid: 8480 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746147244.296264:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.296265:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.296270:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a825e00/0xb4b2209fbdacf452 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba4d expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.296277:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825e00/0xb4b2209fbdacf452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba4d expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.296304:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a825e00/0xb4b2209fbdacf452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba4d expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.296313:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466929536:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147244.301468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.301499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.301518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.301534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.301545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.301564:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443584 00000100:00100000:0.0:1746147244.301571:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443584 00000100:00100000:0.0:1746147244.301598:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443712 00000100:00100000:0.0:1746147244.301599:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443712 00000100:00100000:0.0:1746147244.301612:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443840 00000100:00100000:0.0:1746147244.301613:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443840 00000100:00100000:0.0:1746147244.301620:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443968 00000100:00100000:0.0:1746147244.301621:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443968 00000100:00100000:0.0:1746147244.301630:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14896 00000100:00100000:0.0:1746147244.301636:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465443584:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147244.301651:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.301662:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091234000/0xb4b2209fbdacf47c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eba62 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.301679:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.301681:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.301686:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091234000/0xb4b2209fbdacf47c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba62 expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.301699:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091234000/0xb4b2209fbdacf47c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba62 expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.301707:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091234000, rc 0) 00000100:00100000:0.0:1746147244.301734:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465443584:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.301739:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14896 00000100:00100000:0.0:1746147244.301750:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14897 00000100:00100000:0.0:1746147244.301753:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465443712:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147244.301758:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.301765:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091234c00/0xb4b2209fbdacf483 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eba69 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.301773:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.301774:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.301777:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091234c00/0xb4b2209fbdacf483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba69 expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.301784:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091234c00/0xb4b2209fbdacf483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba69 expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.301791:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091234c00, rc 0) 00000100:00100000:0.0:1746147244.301800:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465443712:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.301803:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14897 00000100:00100000:0.0:1746147244.301811:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14898 00000100:00100000:0.0:1746147244.301814:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465443840:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147244.301862:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.301867:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091235000/0xb4b2209fbdacf48a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eba70 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.301894:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466929664:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147244.301956:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746147244.301967:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147244.301982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.302079:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465444096 00000100:00100000:0.0:1746147244.302082:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465444096 00000100:00100000:0.0:1746147244.302095:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14899 00000100:00100000:0.0:1746147244.302099:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465443968:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147244.302104:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.302109:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091235600/0xb4b2209fbdacf491 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eba77 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.302118:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.302119:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147244.302123:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091235600/0xb4b2209fbdacf491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba77 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.302131:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091235600/0xb4b2209fbdacf491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba77 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147244.302137:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091235600, rc 0) 00000100:00100000:0.0:1746147244.302149:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465443968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 50us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.302153:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14899 00000100:00100000:0.0:1746147244.302160:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14900 00000100:00100000:0.0:1746147244.302164:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465444096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147244.302168:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.302173:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091234600/0xb4b2209fbdacf498 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eba7e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.302187:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466929792:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147244.302223:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147244.302272:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465443456 00000100:00100000:0.0:1746147244.302275:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465443456 00002000:00100000:0.0:1746147244.302291:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (2015232->2019327) req@ffff8800936dca80 x1830967465443456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:620/0 lens 488/0 e 0 to 0 dl 1746147255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.302299:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967465443456 ext(2015232->2019327) 00002000:00010000:0.0:1746147244.302302:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:0.0:1746147244.302314:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7000 00000100:00100000:0.0:1746147244.302317:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465443456:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147244.302414:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465443456:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 96us (952us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147244.302418:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7000 00002000:00100000:0.0:1746147244.302422:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (2015232->2019327) req@ffff8800936dca80 x1830967465443456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:620/0 lens 488/4536 e 0 to 0 dl 1746147255 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147244.302429:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967465443456 ext(2015232->2019327) 00002000:00010000:0.0:1746147244.302432:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:0.0:1746147244.320235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.320275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.338768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.348577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.349841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.349869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.350877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.351903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.355006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.365813:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465446400 00000100:00100000:0.0:1746147244.365816:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465446400 00000100:00100000:0.0:1746147244.365839:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465446272 00000100:00100000:0.0:1746147244.365840:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465446272 00000100:00100000:0.0:1746147244.365849:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465446528 00000100:00100000:0.0:1746147244.365850:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465446528 00000100:00100000:0.0:1746147244.365862:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14903 00000100:00100000:0.0:1746147244.365866:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465446400:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147244.365877:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.365888:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a824400/0xb4b2209fbdacf4d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebaa8 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.365913:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466930816:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147244.366598:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147244.369350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.383305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.383321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.383341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.384863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.388793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.391003:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14907 00000100:00100000:0.0:1746147244.391010:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465448064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147244.391024:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.391044:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4c24a00/0xb4b2209fbdacf4fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebac4 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.392040:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466931328:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147244.392925:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147244.418096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.435055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.435101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.435137:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.449643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.449678:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.455301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.459296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.461488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.461546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.462325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.462763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.474366:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465451008 00000100:00100000:0.0:1746147244.474373:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465451008 00000100:00100000:0.0:1746147244.474405:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14915 00000100:00100000:0.0:1746147244.474412:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:31471:x1830967465451008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147244.474425:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.474439:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d64a00/0xb4b2209fbdacf547 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebb03 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.474461:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147244.474462:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147244.474466:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64a00/0xb4b2209fbdacf547 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4943871] (req 4194304->4943871) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebb03 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.474477:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d64a00/0xb4b2209fbdacf547 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4943871] (req 4194304->4943871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebb03 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147244.474485:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64a00, rc 0) 00000100:00100000:0.0:1746147244.474529:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31471:x1830967465451008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 117us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.474535:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14915 00000100:00100000:0.0:1746147244.474877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.483774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.484171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.484424:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7008 00000100:00100000:0.0:1746147244.484432:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465451648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147244.495392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.495983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.498306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.501591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.501619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.501650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.509526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.516431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.516497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.516567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.518075:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7011 00000100:00100000:0.0:1746147244.518082:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465453184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147244.545429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.580255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.587682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.588541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.597577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.603652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.604436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.629646:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466933632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147244.629704:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147244.629864:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147244.630039:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466933632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147244.645218:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830967466933888:0@lo:400:kworker.0 00000100:00100000:0.0:1746147244.645247:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147244.645285:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466933888 00000100:00100000:0.0:1746147244.645288:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466933888 00000100:00100000:0.0:1746147244.645318:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1746147244.645324:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967466933888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147244.645352:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967466933888:12345-0@lo:400:kworker.0 Request processed in 29us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.645357:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1746147244.645381:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830967466933888:0@lo:400:kworker.0 00000100:00100000:0.0:1746147244.646044:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466934144:0@lo:400:kworker.0 00000100:00100000:0.0:1746147244.646066:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147244.646764:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466934144:0@lo:400:kworker.0 00000100:00100000:0.0:1746147244.661874:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466934400 00000100:00100000:0.0:1746147244.661881:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466934400 00000100:00100000:0.0:1746147244.662003:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1746147244.662010:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3294:x1830967466934400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147244.662029:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 530907136 pending 34078720 free 3843031040 avail 3840933888 00000100:00100000:0.0:1746147244.662594:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3294:x1830967466934400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 583us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147244.662601:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1746147244.697890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.705466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.711392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.724615:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2440 00000100:00100000:0.0:1746147244.724622:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465456128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147244.740127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.741364:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465456384 00000100:00100000:0.0:1746147244.741368:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465456384 00000100:00100000:0.0:1746147244.741390:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14925 00000100:00100000:0.0:1746147244.741394:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465456384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147244.741401:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147244.741406:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6487a00/0xb4b2209fbdacf5a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebb50 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147244.741425:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466934784:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147244.741446:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147244.757846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.758112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.758138:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.761650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.763866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.767213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.770267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.770915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.775584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.775620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.794253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.794293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.795272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.806802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.829825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.829865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.829897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.837000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.847350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.864710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.869688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.869722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.871089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.874147:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.874207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.880829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.937356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.946896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.960252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147244.966255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.018472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.021746:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.022896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.027733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.034588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.047160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.055397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.056499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.056529:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465464192 00000100:00100000:0.0:1746147245.056535:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465464192 00000100:00100000:0.0:1746147245.056572:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14942 00000100:00100000:0.0:1746147245.056578:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465464192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147245.056594:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147245.056607:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094841800/0xb4b2209fbdacf619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebbc7 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147245.056651:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466937984:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147245.056710:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147245.064894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.068677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.083512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.086342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.092122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.092504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.092536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.094399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.104593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.106011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.119986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.120025:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465465984 00000100:00100000:0.0:1746147245.120031:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465465984 00002000:00100000:0.0:1746147245.120064:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1110016->1589247) req@ffff88009b208000 x1830967465465984/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/0 e 0 to 0 dl 1746147256 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.120074:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967465465984 ext(1110016->1589247) 00010000:00010000:0.0:1746147245.120081:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55f800/0xb4b2209fbdacf5ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebb9d expref: 31 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.120093:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55f800/0xb4b2209fbdacf5ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebb9d expref: 31 pid: 21080 timeout: 732 lvb_type: 0 00002000:00010000:0.0:1746147245.120099:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b208000 00000100:00100000:0.0:1746147245.120115:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2447 00000100:00100000:0.0:1746147245.120121:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465465984:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147245.131581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.135210:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465465984:12345-192.168.203.36@tcp:4:cat.0 Request processed in 15067us (15209us total) trans 21474841233 rc 0/0 00000100:00100000:0.0:1746147245.135222:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2447 00002000:00100000:0.0:1746147245.135233:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1110016->1589247) req@ffff88009b208000 x1830967465465984/t21474841233(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/448 e 0 to 0 dl 1746147256 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.135242:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967465465984 ext(1110016->1589247) 00010000:00010000:0.0:1746147245.135251:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55f800/0xb4b2209fbdacf5ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebb9d expref: 33 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.135334:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55f800/0xb4b2209fbdacf5ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebb9d expref: 33 pid: 21080 timeout: 732 lvb_type: 0 00002000:00010000:0.0:1746147245.135342:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b208000 00000100:00100000:0.0:1746147245.135462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.135508:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465466496 00000100:00100000:0.0:1746147245.135514:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465466496 00002000:00100000:0.0:1746147245.135538:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3592192->4194303) req@ffff88009b208700 x1830967465466496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/0 e 0 to 0 dl 1746147256 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.135544:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208700 with x1830967465466496 ext(3592192->4194303) 00002000:00010000:0.0:1746147245.135547:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208700 00000100:00100000:0.0:1746147245.135564:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7033 00000100:00100000:0.0:1746147245.135569:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465466496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147245.151340:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967465466496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15760us (15867us total) trans 0 rc 602112/602112 00000100:00100000:0.0:1746147245.151351:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7033 00002000:00100000:0.0:1746147245.151362:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3592192->4194303) req@ffff88009b208700 x1830967465466496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/440 e 0 to 0 dl 1746147256 ref 1 fl Complete:/200/0 rc 602112/602112 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.151371:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208700 with x1830967465466496 ext(3592192->4194303) 00002000:00010000:0.0:1746147245.151375:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208700 00000100:00100000:0.0:1746147245.153745:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466938880:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147245.153761:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147245.153794:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465466624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12478us (12613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.153802:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7569 00000100:00100000:0.0:1746147245.155619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.155640:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465466880 00000100:00100000:0.0:1746147245.155646:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465466880 00002000:00100000:0.0:1746147245.155678:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b20a300 x1830967465466880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:621/0 lens 488/0 e 0 to 0 dl 1746147256 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.155686:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a300 with x1830967465466880 ext(1048576->2097151) 00002000:00010000:0.0:1746147245.155691:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20a300 00000100:00100000:0.0:1746147245.155706:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7034 00000100:00100000:0.0:1746147245.155713:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465466880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147245.183403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.187258:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465466880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 31537us (31635us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147245.187272:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7034 00002000:00100000:0.0:1746147245.187282:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b20a300 x1830967465466880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:621/0 lens 488/440 e 0 to 0 dl 1746147256 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.187291:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a300 with x1830967465466880 ext(1048576->2097151) 00002000:00010000:0.0:1746147245.187295:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20a300 00000100:00100000:0.0:1746147245.206061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.206090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.206110:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465467136 00000100:00100000:0.0:1746147245.206117:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465467136 00000100:00100000:0.0:1746147245.206151:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14949 00000100:00100000:0.0:1746147245.206157:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31515:x1830967465467136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147245.206171:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147245.206185:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebbf8 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.206215:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147245.206217:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147245.206223:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 33 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.206244:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 33 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.206253:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537e000, rc 0) 00000100:00100000:0.0:1746147245.206288:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:31515:x1830967465467136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 130us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.206297:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14949 00000100:00100000:0.0:1746147245.206314:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465467392 00000100:00100000:0.0:1746147245.206317:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465467392 00002000:00100000:0.0:1746147245.206334:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b208a80 x1830967465467392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/0 e 0 to 0 dl 1746147256 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.206342:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967465467392 ext(4194304->4976639) 00002000:00010000:0.0:1746147245.206345:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:0.0:1746147245.206356:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7035 00000100:00100000:0.0:1746147245.206360:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967465467392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147245.212255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.224662:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967465467392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18294us (18563us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746147245.224671:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7035 00002000:00100000:0.0:1746147245.224680:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b208a80 x1830967465467392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/440 e 0 to 0 dl 1746147256 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.224688:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967465467392 ext(4194304->4976639) 00002000:00010000:0.0:1746147245.224692:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:0.0:1746147245.262623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.268932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.285325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.295025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.295268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.429150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.432562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.464906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.465742:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466939648:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147245.465762:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136273c00/0xb4b2209fbdacf65f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc0d expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.465770:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273c00, rc 0) 00000100:00100000:0.0:1746147245.466827:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:31524:x1830967465469568:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 23581us (23815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.466833:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14952 00000100:00100000:0.0:1746147245.487662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.488242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.499307:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.504892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.505390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.526522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.537891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.537934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.537982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.538027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.538055:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:0.0:1746147245.538062:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465471488:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147245.538088:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465471488:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 27us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.538093:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:0.0:1746147245.538134:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465471616 00000100:00100000:0.0:1746147245.538137:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465471616 00000100:00100000:0.0:1746147245.538156:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:0.0:1746147245.538160:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465471616:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147245.553502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.562178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.569569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.570743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.603593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.606690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.607913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.607964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.635037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.642487:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466940928:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147245.642516:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936dae00/0xb4b2209fbdacf697 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc45 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.642525:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147245.642526:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147245.642532:0:21080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936da800/0xb4b2209fbdacf682 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc30 expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.642538:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936da800/0xb4b2209fbdacf682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc30 expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.642559:0:21080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936da800/0xb4b2209fbdacf682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc30 expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147245.642568:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466941056:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147245.642620:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147245.655623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.655665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.655687:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465473664 00000100:00100000:0.0:1746147245.655694:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465473664 00002000:00100000:0.0:1746147245.655728:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a044a680 x1830967465473664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/0 e 0 to 0 dl 1746147256 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.655737:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044a680 with x1830967465473664 ext(3145728->4194303) 00002000:00010000:0.0:1746147245.655741:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044a680 00000100:00100000:0.0:1746147245.655755:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465473920 00000100:00100000:0.0:1746147245.655757:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465473920 00002000:00100000:0.0:1746147245.655769:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a044b480 x1830967465473920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/0 e 0 to 0 dl 1746147256 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.655775:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044b480 with x1830967465473920 ext(3145728->4194303) 00002000:00010000:0.0:1746147245.655777:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044b480 00000100:00100000:0.0:1746147245.655803:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7047 00000100:00100000:0.0:1746147245.655809:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465473664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147245.679637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.691416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.703451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.715179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.724627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.736285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.746353:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465474688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25573us (31172us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746147245.746364:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7050 00002000:00100000:0.0:1746147245.746375:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a0448700 x1830967465474688/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:621/0 lens 488/440 e 0 to 0 dl 1746147256 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147245.746384:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448700 with x1830967465474688 ext(4194304->4976639) 00002000:00010000:0.0:1746147245.746389:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0448700 00000100:00100000:0.0:1746147245.754771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.766488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.766542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147245.771034:0:17530:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800b52e1180 x1830967466941568) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880136272200/0xb4b2209fbdacf66d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc1b expref: 21 pid: 8478 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.771060:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136272200/0xb4b2209fbdacf66d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc1b expref: 21 pid: 8478 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746147245.771085:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466941568:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147245.771108:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdacf6b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc61 expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147245.771117:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdacf6b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc61 expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147245.771128:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199800, rc 0) 00000100:00100000:0.0:1746147245.778666:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465475200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11872us (12115us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147245.778675:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14964 00000100:00100000:0.0:1746147245.780399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.780422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.780447:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.809623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.818222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.828918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.836241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.842039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.864584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.928424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.933860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.933899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.938739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.938780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.938820:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465478016 00000100:00100000:0.0:1746147245.938827:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465478016 00010000:00010000:0.0:1746147245.938854:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936da800/0xb4b2209fbdacf682 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc30 expref: 27 pid: 21080 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746147245.938873:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465478144 00000100:00100000:0.0:1746147245.938875:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465478144 00010000:00010000:0.0:1746147245.938881:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f964c00/0xb4b2209fbdacf69e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc4c expref: 28 pid: 21080 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1746147245.938891:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7581 00000100:00100000:0.0:1746147245.938896:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465478016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147245.938905:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147245.938923:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936da800/0xb4b2209fbdacf682 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc30 expref: 28 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.938957:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936da800/0xb4b2209fbdacf682 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc30 expref: 28 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.938976:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147245.939005:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465478016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.939010:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7581 00000100:00100000:0.0:1746147245.939075:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7582 00000100:00100000:0.0:1746147245.939080:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465478144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147245.939087:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147245.939094:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f964c00/0xb4b2209fbdacf69e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc4c expref: 27 pid: 21080 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1746147245.939101:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f964c00/0xb4b2209fbdacf69e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc4c expref: 27 pid: 21080 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1746147245.939110:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147245.939126:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465478144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.939131:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7582 00000100:00100000:0.0:1746147245.944920:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465478400 00000100:00100000:0.0:1746147245.944925:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465478400 00010000:00010000:0.0:1746147245.944957:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936dae00/0xb4b2209fbdacf697 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc45 expref: 10 pid: 21080 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746147245.945068:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7583 00000100:00100000:0.0:1746147245.945074:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465478400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147245.945084:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147245.945103:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936dae00/0xb4b2209fbdacf697 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc45 expref: 10 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.945114:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936dae00/0xb4b2209fbdacf697 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc45 expref: 10 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.945129:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936dae00/0xb4b2209fbdacf697 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc45 expref: 10 pid: 21080 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746147245.945241:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147245.945243:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147245.945248:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946e2c00/0xb4b2209fbdacf6c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4055039) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc76 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.945255:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946e2c00/0xb4b2209fbdacf6c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4055039) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc76 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147245.945274:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800946e2c00/0xb4b2209fbdacf6c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc76 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147245.945433:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466943104:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147245.945651:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147245.948112:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466943104:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147245.948121:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147245.948136:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465478400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3062us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147245.948142:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7583 00000100:00100000:0.0:1746147245.948881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.956456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.978619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147245.986693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.033365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.033405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.033435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.033473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.033492:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465479936 00000100:00100000:0.0:1746147246.033495:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465479936 00002000:00100000:0.0:1746147246.034681:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b20a680 x1830967465479936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 504/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.034690:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967465479936 ext(3145728->4194303) 00002000:00010000:0.0:1746147246.034694:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:0.0:1746147246.034710:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7063 00000100:00100000:0.0:1746147246.034717:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465479936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147246.088689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.089902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.091337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.139228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.169774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.180092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.204176:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465481472:12345-192.168.203.36@tcp:4:cat.0 Request processed in 23848us (24084us total) trans 17179873869 rc 0/0 00000100:00100000:0.0:1746147246.204202:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2454 00002000:00100000:0.0:1746147246.204214:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3387392->4055039) req@ffff880099f69880 x1830967465481472/t17179873869(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/448 e 0 to 0 dl 1746147257 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.204222:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967465481472 ext(3387392->4055039) 00010000:00010000:0.0:1746147246.204231:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800946e2c00/0xb4b2209fbdacf6c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc76 expref: 25 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.204246:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800946e2c00/0xb4b2209fbdacf6c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc76 expref: 25 pid: 17530 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746147246.204252:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69880 00000100:00100000:0.0:1746147246.210844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.225048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.225664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.226193:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7067 00000100:00100000:0.0:1746147246.226201:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465481856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147246.258909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.267291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.267392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.275551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.281080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.284030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.301501:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465483392 00000100:00100000:0.0:1746147246.301513:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465483392 00002000:00100000:0.0:1746147246.301559:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2367488->3145727) req@ffff8800b52e1180 x1830967465483392/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.301568:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1180 with x1830967465483392 ext(2367488->3145727) 00010000:00010000:0.0:1746147246.301578:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdacf6f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebca7 expref: 10 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.301590:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdacf6f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebca7 expref: 10 pid: 17530 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746147246.301666:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e1180 00000100:00100000:0.0:1746147246.301689:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2456 00000100:00100000:0.0:1746147246.301697:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465483392:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147246.308758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.308826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.308880:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14977 00000100:00100000:0.0:1746147246.308888:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465483648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147246.308903:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.308916:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdacf70e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebcbc expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.308931:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.308956:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdacf70e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcbc expref: 25 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.308964:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdacf70e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcbc expref: 25 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.308979:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173600, rc 0) 00000100:00100000:0.0:1746147246.308999:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465483648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 113us (242us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147246.309004:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14977 00000100:00100000:1.0:1746147246.316045:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.326270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.326351:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466944512:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147246.326372:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147246.327990:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465483904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12133us (12411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.328001:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7588 00000100:00100000:1.0:1746147246.343233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.343320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.344657:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465484288 00000100:00100000:0.0:1746147246.344669:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465484288 00010000:00010000:0.0:1746147246.344708:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdacf6f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebca7 expref: 12 pid: 17530 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.344755:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7589 00000100:00100000:0.0:1746147246.344763:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465484288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147246.344778:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147246.344798:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147245 -> 1746147246 00002000:00010000:0.0:1746147246.344800:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147245 -> 1746147246 00010000:00010000:0.0:1746147246.344805:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdacf6f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2367488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebca7 expref: 12 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.344816:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdacf6f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2367488->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebca7 expref: 12 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.344839:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdacf6f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2367488->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebca7 expref: 12 pid: 17530 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.345405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147246.345677:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.345679:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.345688:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.345697:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.345730:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147246.345742:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466944640:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147246.345824:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.354134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.355716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.363313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.378632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.379214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.394661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.394700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.394728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.394730:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465485824 00000100:00100000:1.0:1746147246.394740:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465485824 00002000:00100000:1.0:1746147246.394788:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009107bb80 x1830967465485824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.394797:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107bb80 with x1830967465485824 ext(2097152->3145727) 00002000:00010000:1.0:1746147246.394802:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009107bb80 00000100:00100000:0.0:1746147246.394804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.395143:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465486080 00000100:00100000:1.0:1746147246.395146:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465486080 00002000:00100000:1.0:1746147246.395160:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009107b800 x1830967465486080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.395166:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107b800 with x1830967465486080 ext(3145728->4194303) 00000100:00100000:0.0:1746147246.395168:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465486464 00002000:00010000:1.0:1746147246.395169:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009107b800 00000100:00100000:0.0:1746147246.395173:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465486464 00002000:00100000:0.0:1746147246.395213:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3964928->4194303) req@ffff880091078e00 x1830967465486464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.395221:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091078e00 with x1830967465486464 ext(3964928->4194303) 00002000:00010000:0.0:1746147246.395225:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091078e00 00000100:00100000:0.0:1746147246.395236:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465486336 00000100:00100000:0.0:1746147246.395239:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465486336 00002000:00100000:0.0:1746147246.395249:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3964927) req@ffff880091078380 x1830967465486336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 504/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.395255:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091078380 with x1830967465486336 ext(2097152->3964927) 00002000:00010000:0.0:1746147246.395258:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091078380 00000100:00100000:0.0:1746147246.395269:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7072 00000100:00100000:0.0:1746147246.395275:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465485824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147246.395697:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7074 00000100:00100000:1.0:1746147246.395702:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967465486464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147246.410000:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465486464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14284us (15258us total) trans 0 rc 229376/229376 00000100:00100000:1.0:1746147246.410012:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7074 00002000:00100000:1.0:1746147246.410023:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3964928->4194303) req@ffff880091078e00 x1830967465486464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 229376/229376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.410033:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091078e00 with x1830967465486464 ext(3964928->4194303) 00002000:00010000:1.0:1746147246.410039:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091078e00 00000100:00100000:0.0:1746147246.430199:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465486080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34516us (35483us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147246.430207:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7073 00002000:00100000:0.0:1746147246.430215:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009107b800 x1830967465486080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.430222:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107b800 with x1830967465486080 ext(3145728->4194303) 00002000:00010000:0.0:1746147246.430226:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009107b800 00000100:00100000:1.0:1746147246.434014:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465487104 00000100:00100000:1.0:1746147246.434024:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465487104 00000100:00100000:1.0:1746147246.434069:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14983 00000100:00100000:1.0:1746147246.434075:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465487104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.434093:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.434110:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b172c00/0xb4b2209fbdacf738 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebce6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.434162:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466945280:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147246.435278:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465486976 00000100:00100000:0.0:1746147246.435285:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465486976 00002000:00100000:0.0:1746147246.435318:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009fb71880 x1830967465486976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.435332:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71880 with x1830967465486976 ext(4194304->4976639) 00002000:00010000:0.0:1746147246.435338:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb71880 00000100:00100000:0.0:1746147246.435352:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7076 00000100:00100000:0.0:1746147246.435358:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465486976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147246.435693:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.440842:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466945280:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147246.440885:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b172c00/0xb4b2209fbdacf738 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebce6 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.440899:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b172c00/0xb4b2209fbdacf738 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebce6 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.441864:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b172c00, rc 0) 00000100:00100000:1.0:1746147246.441934:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465487104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7856us (8357us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147246.441954:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14983 00000100:00100000:1.0:1746147246.444290:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465486976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8924us (11672us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147246.444301:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7076 00002000:00100000:1.0:1746147246.444313:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009fb71880 x1830967465486976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.444329:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71880 with x1830967465486976 ext(4194304->4976639) 00002000:00010000:1.0:1746147246.444334:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb71880 00000100:00100000:0.0:1746147246.467613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.467857:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465487360 00000100:00100000:1.0:1746147246.467866:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465487360 00002000:00100000:1.0:1746147246.467912:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880091078a80 x1830967465487360/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.467922:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091078a80 with x1830967465487360 ext(2097152->3145727) 00002000:00010000:1.0:1746147246.467927:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091078a80 00000100:00100000:1.0:1746147246.468634:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7077 00000100:00100000:1.0:1746147246.468643:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465487360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147246.483034:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465487360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14378us (15417us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147246.483048:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7077 00002000:00100000:1.0:1746147246.483061:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880091078a80 x1830967465487360/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.483071:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091078a80 with x1830967465487360 ext(2097152->3145727) 00002000:00010000:1.0:1746147246.483077:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091078a80 00000100:00100000:0.0:1746147246.493836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.493929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.495819:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465487488 00000100:00100000:1.0:1746147246.495831:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465487488 00000100:00100000:1.0:1746147246.495876:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465487616 00000100:00100000:1.0:1746147246.495878:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465487616 00000100:00100000:1.0:1746147246.495897:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14984 00000100:00100000:1.0:1746147246.495905:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31561:x1830967465487488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.495924:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.495960:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebced expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.495992:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.495999:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147246.496001:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147246.496004:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.496036:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.496047:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 18 pid: 17530 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.496061:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466945408:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147246.496317:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14985 00000100:00100000:0.0:1746147246.496325:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31564:x1830967465487616:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147246.496331:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.496339:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebcf4 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.496352:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.496359:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.496363:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.496364:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.496367:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1253376->1634303] (req 1253376->1634303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.496379:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.496386:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 18 pid: 8478 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147246.496395:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091079500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466945536:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147246.497628:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746147246.498056:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.498066:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 14 pid: 8478 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.498077:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009107a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466945664:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147246.498138:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.504630:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466945408:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147246.504670:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.504689:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173600, rc 0) 00000100:00100000:1.0:1746147246.504890:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31561:x1830967465487488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8984us (11062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.504899:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14984 00000100:00100000:0.0:1746147246.508554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.508711:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465487744 00000100:00100000:1.0:1746147246.508720:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465487744 00002000:00100000:1.0:1746147246.508762:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2191360->3010559) req@ffff88009107a680 x1830967465487744/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.508772:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107a680 with x1830967465487744 ext(2191360->3010559) 00010000:00010000:1.0:1746147246.508781:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 19 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.508792:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 19 pid: 17530 timeout: 733 lvb_type: 0 00002000:00010000:1.0:1746147246.508799:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009107a680 00000100:00100000:1.0:1746147246.509893:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2458 00000100:00100000:1.0:1746147246.509903:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967465487744:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147246.518638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.518764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.518786:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465487872 00000100:00100000:0.0:1746147246.518795:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465487872 00010000:00010000:0.0:1746147246.518831:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 21 pid: 8478 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147246.518856:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465488000 00000100:00100000:0.0:1746147246.518857:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465488000 00010000:00010000:0.0:1746147246.518868:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 13 pid: 8478 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.518883:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7591 00000100:00100000:0.0:1746147246.518890:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465487872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147246.518904:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147246.518927:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 21 pid: 8478 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147246.518953:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 21 pid: 8478 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147246.518977:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6487400/0xb4b2209fbdacf643 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf1 expref: 21 pid: 8478 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1746147246.519064:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7592 00000100:00100000:1.0:1746147246.519070:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465488000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147246.519077:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147246.519087:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 13 pid: 8478 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.519094:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 13 pid: 8478 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.519105:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55e600/0xb4b2209fbdacf63c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbea expref: 13 pid: 8478 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.523450:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.523457:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.523472:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.523484:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.523534:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.523549:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466945792:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147246.524054:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.524131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147246.525462:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147246.525517:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465487872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6626us (6888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.525528:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7591 00000100:00100000:1.0:1746147246.533116:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465488768 00000100:00100000:1.0:1746147246.533120:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465488768 00010000:00010000:1.0:1746147246.533135:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131ba0400/0xb4b2209fbdacf3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba07 expref: 22 pid: 8481 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.533152:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7595 00000100:00100000:1.0:1746147246.533157:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967465488768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147246.533164:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147246.533173:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131ba0400/0xb4b2209fbdacf3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba07 expref: 22 pid: 8481 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.533194:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131ba0400/0xb4b2209fbdacf3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba07 expref: 22 pid: 8481 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.533208:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131ba0400/0xb4b2209fbdacf3d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eba07 expref: 22 pid: 8481 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.533218:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.533220:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.533226:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.533234:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.533262:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.533273:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466946304:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147246.534779:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.540480:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465487744:12345-192.168.203.36@tcp:4:cat.0 Request processed in 30567us (31923us total) trans 21474841237 rc 0/0 00000100:00100000:1.0:1746147246.540494:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2458 00002000:00100000:1.0:1746147246.540506:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2191360->3010559) req@ffff88009107a680 x1830967465487744/t21474841237(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/448 e 0 to 0 dl 1746147257 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.540521:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107a680 with x1830967465487744 ext(2191360->3010559) 00010000:00010000:1.0:1746147246.540532:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 21 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.540547:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 21 pid: 17530 timeout: 733 lvb_type: 0 00002000:00010000:1.0:1746147246.540554:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009107a680 00000100:00100000:1.0:1746147246.541471:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466946304:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147246.541736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.541788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147246.541847:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147246.541874:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967465488768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8716us (9521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.541882:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7595 00000100:00100000:0.0:1746147246.553130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.553177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.554988:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465489408 00000100:00100000:1.0:1746147246.555000:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465489408 00010000:00010000:1.0:1746147246.555039:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 20 pid: 17530 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.556196:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7596 00000100:00100000:1.0:1746147246.556206:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465489408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147246.556221:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147246.556242:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 21 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.556254:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 21 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.556276:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d200/0xb4b2209fbdacf700 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->3010559) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcae expref: 21 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.558102:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.558108:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.558120:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 10 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.558131:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 10 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.558178:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 10 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.558202:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466946432:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147246.558308:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.563021:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466946432:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147246.563046:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147246.563107:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967465489408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6903us (9984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.563118:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7596 00000100:00100000:0.0:1746147246.569345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.569382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.569466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.569502:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465490176 00000100:00100000:0.0:1746147246.569504:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465490176 00002000:00100000:0.0:1746147246.569518:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009107a300 x1830967465490176/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.569524:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107a300 with x1830967465490176 ext(3145728->4194303) 00002000:00010000:0.0:1746147246.569526:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009107a300 00000100:00100000:0.0:1746147246.569645:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7083 00000100:00100000:0.0:1746147246.569650:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465490432:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147246.589704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.592177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.595380:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465490432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 25725us (25909us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147246.595390:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7083 00002000:00100000:0.0:1746147246.595401:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880091079500 x1830967465490432/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.595411:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091079500 with x1830967465490432 ext(3145728->4194303) 00002000:00010000:0.0:1746147246.595416:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091079500 00000100:00100000:0.0:1746147246.598594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.607786:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465490176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 36919us (38391us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147246.607800:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7084 00002000:00100000:0.0:1746147246.607813:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009107a300 x1830967465490176/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.609897:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009107a300 with x1830967465490176 ext(3145728->4194303) 00002000:00010000:0.0:1746147246.609913:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009107a300 00000100:00100000:0.0:1746147246.619244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.622636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.634415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.644250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.646296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.649818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.671519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.671909:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465491968 00000100:00100000:1.0:1746147246.671920:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465491968 00010000:00010000:1.0:1746147246.672157:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 13 pid: 17530 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.672275:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7597 00000100:00100000:1.0:1746147246.672284:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465491968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147246.672300:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147246.672322:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 13 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.672336:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 13 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.672357:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf746 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1634303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcf4 expref: 13 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.672480:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.672483:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.672491:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f481800/0xb4b2209fbdacf777 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd25 expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.672499:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f481800/0xb4b2209fbdacf777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd25 expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.672533:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f481800/0xb4b2209fbdacf777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd25 expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.672545:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466947200:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147246.673080:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.677872:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466947200:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147246.677890:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147246.677969:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465491968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5684us (6459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.677981:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7597 00000100:00100000:0.0:1746147246.687202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.753797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.753859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.754136:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465492480 00000100:00100000:1.0:1746147246.754146:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465492480 00002000:00100000:1.0:1746147246.754200:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012df7ad80 x1830967465492480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.754210:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7ad80 with x1830967465492480 ext(2097152->3145727) 00002000:00010000:1.0:1746147246.754215:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7ad80 00000100:00100000:1.0:1746147246.754533:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7089 00000100:00100000:1.0:1746147246.754540:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967465492480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147246.774153:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967465492480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19598us (20279us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147246.774169:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7089 00002000:00100000:1.0:1746147246.774220:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012df7ad80 x1830967465492480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.774230:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7ad80 with x1830967465492480 ext(2097152->3145727) 00002000:00010000:1.0:1746147246.774238:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7ad80 00000100:00100000:0.0:1746147246.801720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.803296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.803319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.808782:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14994 00000100:00100000:1.0:1746147246.808805:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465492992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.808828:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.808847:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24400/0xb4b2209fbdacf785 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd33 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.808910:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466947584:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147246.810882:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.818296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.818404:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465493248 00000100:00100000:1.0:1746147246.818414:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465493248 00010000:00010000:1.0:1746147246.818453:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 15 pid: 8478 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.818497:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7598 00000100:00100000:1.0:1746147246.818506:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465493248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147246.818521:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147246.818542:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 15 pid: 8478 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.818554:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 15 pid: 8478 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.818578:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b173600/0xb4b2209fbdacf73f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebced expref: 15 pid: 8478 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.819209:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466947584:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147246.819236:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24400/0xb4b2209fbdacf785 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd33 expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.819247:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24400/0xb4b2209fbdacf785 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd33 expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.819909:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c24400, rc 0) 00010000:00010000:1.0:1746147246.820279:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147246.820300:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465493248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1795us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.820306:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7598 00000100:00100000:0.0:1746147246.822245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.822292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.827211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.827241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.827285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.827670:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14999 00000100:00100000:1.0:1746147246.827677:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31580:x1830967465493888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.827690:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.827706:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25e00/0xb4b2209fbdacf7a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd56 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.827731:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.827737:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147246.827738:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147246.827741:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25e00/0xb4b2209fbdacf7a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd56 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.827770:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.827779:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 22 pid: 17530 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.827789:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466947968:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147246.828378:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.829868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.830781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.830848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.830879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.831363:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465494144 00000100:00100000:1.0:1746147246.831367:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465494144 00000100:00100000:1.0:1746147246.831384:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465494272 00000100:00100000:1.0:1746147246.831386:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465494272 00000100:00100000:1.0:1746147246.831418:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15000 00000100:00100000:1.0:1746147246.831424:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967465494144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.831436:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.831446:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25600/0xb4b2209fbdacf7af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd5d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.831474:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009107ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466948352:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147246.831520:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.831555:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15001 00000100:00100000:1.0:1746147246.831560:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465494272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.831566:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.831572:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24e00/0xb4b2209fbdacf7b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd64 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147246.831592:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466948480:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147246.831611:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.832202:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466947968:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147246.832215:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25e00/0xb4b2209fbdacf7a1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd56 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.832224:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c25e00, rc 0) 00000100:00100000:1.0:1746147246.832243:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31580:x1830967465493888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4567us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.832249:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14999 00000100:00100000:0.0:1746147246.832893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.835563:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009107ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466948352:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147246.835595:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25600/0xb4b2209fbdacf7af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd5d expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.835613:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25600/0xb4b2209fbdacf7af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd5d expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.836204:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c25600, rc 0) 00000100:00100000:1.0:1746147246.836252:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465494144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4826us (5402us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147246.836261:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15000 00000100:00100000:1.0:1746147246.836438:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466948480:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147246.836454:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24e00/0xb4b2209fbdacf7b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd64 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.836461:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24e00/0xb4b2209fbdacf7b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd64 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.836469:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c24e00, rc 0) 00000100:00100000:1.0:1746147246.836487:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967465494272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4927us (5610us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147246.836492:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15001 00000100:00100000:0.0:1746147246.837463:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465494528:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4319us (4568us total) trans 21474841239 rc 0/0 00000100:00100000:0.0:1746147246.837472:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2460 00002000:00100000:0.0:1746147246.837480:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1855488->1908735) req@ffff88009050b100 x1830967465494528/t21474841239(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/448 e 0 to 0 dl 1746147257 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.837495:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050b100 with x1830967465494528 ext(1855488->1908735) 00010000:00010000:0.0:1746147246.837503:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 22 pid: 17530 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.837515:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1514e00/0xb4b2209fbdacf74d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcfb expref: 22 pid: 17530 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746147246.837521:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009050b100 00000100:00100000:0.0:1746147246.838100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.838132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.843400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.847238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.853741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.856925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.857717:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465495936 00000100:00100000:1.0:1746147246.857726:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465495936 00002000:00100000:1.0:1746147246.857765:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8801307ec000 x1830967465495936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 504/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.857776:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ec000 with x1830967465495936 ext(1048576->2097151) 00002000:00010000:1.0:1746147246.857782:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ec000 00000100:00100000:1.0:1746147246.857808:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7094 00000100:00100000:1.0:1746147246.857815:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465495936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147246.869821:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465495936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12006us (12901us total) trans 0 rc 417792/417792 00000100:00100000:0.0:1746147246.869827:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7094 00002000:00100000:0.0:1746147246.869833:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8801307ec000 x1830967465495936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 504/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 417792/417792 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147246.869839:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ec000 with x1830967465495936 ext(1048576->2097151) 00002000:00010000:0.0:1746147246.869843:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ec000 00000100:00100000:0.0:1746147246.878436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.878657:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465496064 00000100:00100000:1.0:1746147246.878721:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465496064 00000100:00100000:1.0:1746147246.878783:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15002 00000100:00100000:1.0:1746147246.878790:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31580:x1830967465496064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147246.878809:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147246.878825:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24600/0xb4b2209fbdacf7bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd6b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.878854:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.878861:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147246.878862:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147246.878865:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24600/0xb4b2209fbdacf7bd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd6b expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.878893:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.878903:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 20 pid: 11147 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.878914:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466948736:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147246.879296:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.881771:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466948736:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147246.881802:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c24600/0xb4b2209fbdacf7bd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd6b expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.881820:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c24600, rc 0) 00000100:00100000:1.0:1746147246.881874:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31580:x1830967465496064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3083us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.881883:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15002 00000100:00100000:0.0:1746147246.882109:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.882321:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465496192 00000100:00100000:1.0:1746147246.882328:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465496192 00002000:00100000:1.0:1746147246.882364:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3301376->3657727) req@ffff8801307ed180 x1830967465496192/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.882373:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ed180 with x1830967465496192 ext(3301376->3657727) 00010000:00010000:1.0:1746147246.882379:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 21 pid: 11147 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.882391:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 21 pid: 11147 timeout: 733 lvb_type: 0 00002000:00010000:1.0:1746147246.882398:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801307ed180 00000100:00100000:1.0:1746147246.882425:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2461 00000100:00100000:1.0:1746147246.882432:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465496192:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147246.892447:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465496192:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10003us (10327us total) trans 21474841240 rc 0/0 00000100:00100000:1.0:1746147246.892461:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2461 00002000:00100000:1.0:1746147246.892473:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3301376->3657727) req@ffff8801307ed180 x1830967465496192/t21474841240(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:622/0 lens 488/448 e 0 to 0 dl 1746147257 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.892484:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ed180 with x1830967465496192 ext(3301376->3657727) 00010000:00010000:1.0:1746147246.892494:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 23 pid: 11147 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.892510:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacf77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd2c expref: 23 pid: 11147 timeout: 733 lvb_type: 0 00002000:00010000:1.0:1746147246.892517:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801307ed180 00000100:00100000:0.0:1746147246.894463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.902925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.902996:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465496704 00000100:00100000:0.0:1746147246.903001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.903006:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465496704 00002000:00100000:1.0:1746147246.903057:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8801307ece00 x1830967465496704/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.903067:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ece00 with x1830967465496704 ext(3145728->4194303) 00002000:00010000:1.0:1746147246.903075:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ece00 00000100:00100000:1.0:1746147246.903104:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465496576 00000100:00100000:1.0:1746147246.903107:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465496576 00002000:00100000:1.0:1746147246.903118:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8801307ec700 x1830967465496576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/0 e 0 to 0 dl 1746147257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.903124:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ec700 with x1830967465496576 ext(2097152->3145727) 00002000:00010000:1.0:1746147246.903126:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ec700 00000100:00100000:1.0:1746147246.903138:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7095 00000100:00100000:1.0:1746147246.903145:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465496704:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147246.920451:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465496704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17293us (17522us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147246.920468:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7095 00002000:00100000:1.0:1746147246.920480:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8801307ece00 x1830967465496704/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:622/0 lens 488/440 e 0 to 0 dl 1746147257 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147246.920489:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ece00 with x1830967465496704 ext(3145728->4194303) 00002000:00010000:1.0:1746147246.920495:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ece00 00000100:00100000:0.0:1746147246.939270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.944973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.945203:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465497216 00000100:00100000:1.0:1746147246.945210:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465497216 00000100:00100000:1.0:1746147246.945286:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4688 00000100:00100000:1.0:1746147246.945293:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:27370:x1830967465497216:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1746147246.945627:0:14051:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589945269 00000100:00100000:1.0:1746147246.945716:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:27370:x1830967465497216:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 421us (789us total) trans 8589945270 rc 0/0 00000100:00100000:1.0:1746147246.945723:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4688 00000020:00080000:1.0:1746147246.945728:0:14051:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746147246.947049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147246.948373:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147246.951044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.951128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.954624:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465497984 00000100:00100000:0.0:1746147246.954632:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465497984 00000100:00100000:0.0:1746147246.954670:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465498240 00000100:00100000:0.0:1746147246.954673:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465498240 00000100:00100000:0.0:1746147246.954693:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465498496 00000100:00100000:0.0:1746147246.954695:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465498496 00000100:00100000:0.0:1746147246.954704:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465497856 00000100:00100000:0.0:1746147246.954705:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465497856 00000100:00100000:0.0:1746147246.954716:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465498112 00000100:00100000:0.0:1746147246.954717:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465498112 00000100:00100000:0.0:1746147246.954725:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465498368 00000100:00100000:0.0:1746147246.954726:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465498368 00000100:00100000:0.0:1746147246.954735:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15003 00000100:00100000:0.0:1746147246.954741:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465497984:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147246.954760:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.954776:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdacf7e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd80 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.954802:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.954805:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.954813:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdacf7e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd80 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.954826:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdacf7e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd80 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.954837:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344200, rc 0) 00000100:00100000:0.0:1746147246.954875:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465497984:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 134us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.954881:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15003 00000100:00100000:0.0:1746147246.954897:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15004 00000100:00100000:0.0:1746147246.954901:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465498240:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147246.954909:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.954918:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd8e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.954928:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.954930:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.954934:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.954969:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.954981:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e29600, rc 0) 00000100:00100000:0.0:1746147246.954996:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465498240:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 94us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.955001:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15004 00000100:00100000:0.0:1746147246.955011:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15005 00000100:00100000:0.0:1746147246.955015:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465498496:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147246.955020:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.955026:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e28e00/0xb4b2209fbdacf7ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd9c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.955034:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.955036:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.955039:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e28e00/0xb4b2209fbdacf7ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd9c expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.955047:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e28e00/0xb4b2209fbdacf7ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd9c expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.955053:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e28e00, rc 0) 00000100:00100000:0.0:1746147246.955068:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465498496:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 53us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.955073:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15005 00000100:00100000:0.0:1746147246.955083:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15006 00000100:00100000:0.0:1746147246.955087:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465497856:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147246.955095:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.955101:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd79 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.955109:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.955111:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.955115:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.955123:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.955129:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e28c00, rc 0) 00000100:00100000:0.0:1746147246.955142:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465497856:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 55us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.955147:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15006 00000100:00100000:0.0:1746147246.955157:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15007 00000100:00100000:0.0:1746147246.955162:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465498112:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147246.955167:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.955172:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5345c00/0xb4b2209fbdacf7fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd87 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147246.955226:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466949248:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147246.955281:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.955302:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15008 00000100:00100000:0.0:1746147246.955307:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465498368:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147246.955315:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147246.955321:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136967400/0xb4b2209fbdacf803 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebd95 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.955331:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.955332:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.955336:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136967400/0xb4b2209fbdacf803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd95 expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.955345:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136967400/0xb4b2209fbdacf803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd95 expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.955351:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136967400, rc 0) 00000100:00100000:0.0:1746147246.955366:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465498368:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 59us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.955371:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15008 00000100:00080000:0.0:1746147246.955396:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147246.959616:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466949248:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147246.959651:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5345c00/0xb4b2209fbdacf7fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd87 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.959663:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5345c00/0xb4b2209fbdacf7fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd87 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.959677:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5345c00, rc 0) 00000100:00100000:0.0:1746147246.960501:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465498112:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5336us (5926us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147246.960514:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15007 00000100:00100000:0.0:1746147246.962927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.965983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.966007:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465498880 00000100:00100000:0.0:1746147246.966015:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465498880 00010000:00010000:0.0:1746147246.966047:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08600/0xb4b2209fbdacf7d9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd72 expref: 15 pid: 16361 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.966069:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7606 00000100:00100000:0.0:1746147246.966074:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465498880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147246.966088:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147246.966093:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08600/0xb4b2209fbdacf7d9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd72 expref: 15 pid: 16361 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.966104:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08600/0xb4b2209fbdacf7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd72 expref: 15 pid: 16361 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147246.966122:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147246.966126:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f480200/0xb4b2209fbdacf811 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147246.966133:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f480200/0xb4b2209fbdacf811 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147246.966139:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f480200/0xb4b2209fbdacf811 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147246.966154:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147246.966198:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465498880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147246.966204:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7606 00000100:00100000:0.0:1746147246.970868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.977368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147246.977609:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465499136 00000100:00100000:1.0:1746147246.977618:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465499136 00010000:00010000:1.0:1746147246.977653:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f480200/0xb4b2209fbdacf811 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebda3 expref: 16 pid: 16361 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.977682:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7607 00000100:00100000:1.0:1746147246.977689:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465499136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147246.977703:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147246.977709:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f480200/0xb4b2209fbdacf811 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebda3 expref: 16 pid: 16361 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.977725:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f480200/0xb4b2209fbdacf811 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebda3 expref: 16 pid: 16361 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147246.977746:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147246.977750:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f481a00/0xb4b2209fbdacf826 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147246.977760:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f481a00/0xb4b2209fbdacf826 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147246.977766:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f481a00/0xb4b2209fbdacf826 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147246.977782:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147246.977827:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465499136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 138us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147246.977833:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7607 00000100:00100000:0.0:1746147246.982503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.987230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.991460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.992146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.992162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.992175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.992210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147246.992233:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465499648 00000100:00100000:0.0:1746147246.992242:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465499648 00000100:00100000:0.0:1746147246.992276:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465499904 00000100:00100000:0.0:1746147246.992278:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465499904 00000100:00100000:0.0:1746147246.992288:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465500160 00000100:00100000:0.0:1746147246.992289:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465500160 00000100:00100000:0.0:1746147246.992297:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465499776 00000100:00100000:0.0:1746147246.992298:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465499776 00000100:00100000:0.0:1746147246.992305:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465500032 00000100:00100000:0.0:1746147246.992306:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465500032 00000100:00100000:0.0:1746147246.992316:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15010 00000100:00100000:0.0:1746147246.992323:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465499648:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147246.992372:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992392:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992406:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.992413:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.992420:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.992423:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147246.992425:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992459:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.992471:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 13 pid: 21080 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147246.992484:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466949760:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147246.992558:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147246.992565:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147246.992572:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466949888:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147246.992593:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992600:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 24 pid: 21080 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.992606:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466950016:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147246.992618:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.992642:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15011 00000100:00100000:0.0:1746147246.992647:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465499904:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147246.992667:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992677:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f481e00/0xb4b2209fbdacf793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1146880->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd41 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992683:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147246.992684:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147246.992686:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992701:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f481e00/0xb4b2209fbdacf793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1146880->1777663) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd41 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147246.992708:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f481e00/0xb4b2209fbdacf793 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1146880->1777663) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd41 expref: 13 pid: 11147 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147246.992721:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466950144:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147246.992738:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147246.993357:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15014 00000100:00100000:1.0:1746147246.993364:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465500032:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147246.993379:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.993387:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.993393:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.993404:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.993409:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.993409:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147246.993411:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.993423:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.993429:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 13 pid: 21080 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.993435:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466950912:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147246.993474:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147246.993482:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 10 pid: 17530 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1746147246.993489:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009107ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466951040:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147246.993509:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147246.993521:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 24 pid: 21080 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147246.993528:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466951168:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147246.993540:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147246.993723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.005884:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466950144:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.005903:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.011734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.011764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.011786:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501440 00000100:00100000:1.0:1746147247.011793:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501440 00010000:00010000:1.0:1746147247.011840:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25e00/0xb4b2209fbdacf7a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd56 expref: 14 pid: 8481 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147247.011866:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501312 00000100:00100000:1.0:1746147247.011868:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501312 00010000:00010000:1.0:1746147247.011881:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdacf7e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd80 expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147247.012056:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466950912:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147247.012066:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009107ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466951040:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147247.012072:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466951168:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147247.012096:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.012193:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7608 00000100:00100000:1.0:1746147247.012201:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465501440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.012214:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.012233:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25e00/0xb4b2209fbdacf7a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd56 expref: 14 pid: 8481 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147247.012243:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c25e00/0xb4b2209fbdacf7a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd56 expref: 14 pid: 8481 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147247.012266:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.012300:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465501440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.012305:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7608 00000100:00100000:1.0:1746147247.012323:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7609 00000100:00100000:1.0:1746147247.012327:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465501312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.012332:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.012336:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdacf7e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd80 expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746147247.012343:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdacf7e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd80 expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746147247.012352:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.012353:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.012359:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f481c00/0xb4b2209fbdacf85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.012366:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f481c00/0xb4b2209fbdacf85e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.012379:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.012389:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465501312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.012394:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7609 00000100:00080000:0.0:1746147247.012534:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147247.012557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.012571:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501824 00000100:00100000:0.0:1746147247.012573:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501824 00010000:00010000:0.0:1746147247.012590:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 14 pid: 21080 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147247.012603:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7610 00000100:00100000:0.0:1746147247.012607:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465501824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.012614:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.012625:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 14 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.012633:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 14 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.012644:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdacf64a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbf8 expref: 14 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.012658:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.012671:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465501824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.012675:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7610 00000100:00080000:0.0:1746147247.012685:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147247.012719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.012726:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465500544 00000100:00100000:0.0:1746147247.012728:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465500544 00010000:00010000:0.0:1746147247.012737:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 25 pid: 21080 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147247.012747:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7611 00000100:00100000:0.0:1746147247.012751:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465500544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.012755:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.012763:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 25 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.012770:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 25 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.012781:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21e00/0xb4b2209fbdacf6dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc8b expref: 25 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.012794:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.012806:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465500544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.012812:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7611 00000100:00100000:0.0:1746147247.012853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.012865:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465500800 00000100:00100000:0.0:1746147247.012867:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465500800 00010000:00010000:0.0:1746147247.012876:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f480400/0xb4b2209fbdacf731 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcdf expref: 13 pid: 11147 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147247.012890:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7612 00000100:00100000:0.0:1746147247.012894:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465500800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.012900:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.012909:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f480400/0xb4b2209fbdacf731 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcdf expref: 13 pid: 11147 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.012915:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f480400/0xb4b2209fbdacf731 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcdf expref: 13 pid: 11147 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.012924:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f480400/0xb4b2209fbdacf731 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcdf expref: 13 pid: 11147 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.012931:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.012961:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465500800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.012970:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7612 00000100:00100000:0.0:1746147247.013021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.013031:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501056 00000100:00100000:0.0:1746147247.013033:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501056 00010000:00010000:0.0:1746147247.013043:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f480a00/0xb4b2209fbdacf72a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcd8 expref: 24 pid: 11147 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746147247.013054:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7613 00000100:00100000:0.0:1746147247.013058:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465501056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.013063:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.013069:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f480a00/0xb4b2209fbdacf72a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcd8 expref: 24 pid: 11147 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.013076:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f480a00/0xb4b2209fbdacf72a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcd8 expref: 24 pid: 11147 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.013087:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f480a00/0xb4b2209fbdacf72a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebcd8 expref: 24 pid: 11147 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746147247.013095:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.013107:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465501056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.013112:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7613 00000100:00100000:0.0:1746147247.013146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.013156:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501568 00000100:00100000:0.0:1746147247.013159:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501568 00010000:00010000:0.0:1746147247.013169:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147247.013195:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7614 00000100:00100000:0.0:1746147247.013200:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465501568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.013206:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.013213:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.013219:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.013230:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e29600/0xb4b2209fbdacf7e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd8e expref: 11 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.013238:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.013250:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465501568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.013255:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7614 00000100:00100000:0.0:1746147247.013285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.013294:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465500416 00000100:00100000:0.0:1746147247.013296:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465500416 00010000:00010000:0.0:1746147247.013304:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746147247.013316:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7615 00000100:00100000:0.0:1746147247.013320:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465500416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.013326:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.013333:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.013339:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.013349:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e28c00/0xb4b2209fbdacf7f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebd79 expref: 10 pid: 17530 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746147247.013357:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.013368:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465500416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.013372:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7615 00000100:00100000:0.0:1746147247.013410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.013432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.019121:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501184 00000100:00100000:1.0:1746147247.019130:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501184 00010000:00010000:1.0:1746147247.019161:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 12 pid: 21080 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1746147247.019198:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465501696 00000100:00100000:1.0:1746147247.019200:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465501696 00010000:00010000:1.0:1746147247.019210:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 23 pid: 21080 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746147247.019222:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7617 00000100:00100000:1.0:1746147247.019228:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465501184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.019239:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.019258:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 12 pid: 21080 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746147247.019269:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 12 pid: 21080 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746147247.019292:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdacf6e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebc92 expref: 12 pid: 21080 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746147247.019319:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.019321:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.019325:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019337:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019360:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.019392:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465501184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 164us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.019399:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7617 00000100:00100000:1.0:1746147247.019420:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7618 00000100:00100000:1.0:1746147247.019424:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465501696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.019430:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.019439:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 23 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147247.019447:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 23 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147247.019458:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f481600/0xb4b2209fbdacf620 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebbce expref: 23 pid: 21080 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746147247.019465:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.019467:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.019469:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019475:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019492:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.019505:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465501696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.019510:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7618 00010000:00010000:1.0:1746147247.019527:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019534:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019552:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019559:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019565:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019571:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f446200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147247.019574:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019580:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019592:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.019598:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdacf849 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.019634:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465499648:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 27312us (28184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.019641:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15010 00010000:00010000:0.0:1746147247.019815:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019822:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019834:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019838:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019849:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019853:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b86fe00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147247.019855:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019860:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019867:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.019872:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86fe00/0xb4b2209fbdacf865 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.019896:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1959:x1830967465500032:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 26534us (27686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.019901:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15014 00000100:00100000:0.0:1746147247.019985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.020007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.020078:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466951296:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147247.020087:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466951424:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147247.020109:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.020962:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.020968:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.020981:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.020986:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.020991:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.020995:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095370800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147247.020997:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.021002:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.021009:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.021014:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095370800/0xb4b2209fbdacf86c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.021059:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465500288:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 26890us (27335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.021065:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15015 00000100:00100000:0.0:1746147247.031701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147247.032103:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032112:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032132:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032139:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032150:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032157:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948db000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147247.032161:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032169:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032189:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.032195:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948db000/0xb4b2209fbdacf850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.032245:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465499904:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 39597us (40099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.032252:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15011 00000100:00100000:0.0:1746147247.033467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.042108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.042130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.042369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.042384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.042423:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465502848 00000100:00100000:0.0:1746147247.042430:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465502848 00000100:00100000:1.0:1746147247.042491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.042502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.042515:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465503232 00000100:00100000:1.0:1746147247.042517:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465503232 00010000:00010000:1.0:1746147247.042534:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf261 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb919 expref: 320 pid: 16361 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.042551:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465502592 00000100:00100000:1.0:1746147247.042553:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465502592 00010000:00010000:1.0:1746147247.042560:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb966 expref: 26 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.042579:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465503360 00000100:00100000:1.0:1746147247.042581:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465503360 00010000:00010000:1.0:1746147247.042589:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdacf0a8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb808 expref: 321 pid: 23726 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.042598:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465503488 00000100:00100000:1.0:1746147247.042599:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465503488 00010000:00010000:1.0:1746147247.042606:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdacf0a1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb801 expref: 27 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.042613:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7622 00000100:00100000:1.0:1746147247.042617:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1959:x1830967465503232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.042625:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.042630:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf261 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb919 expref: 322 pid: 16361 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.042638:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf261 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb919 expref: 322 pid: 16361 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.042657:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9d3200/0xb4b2209fbdacf261 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb919 expref: 322 pid: 16361 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.042670:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147247.042675:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147247.042682:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.042703:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1959:x1830967465503232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.042709:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7622 00000100:00100000:1.0:1746147247.042726:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7623 00000100:00100000:1.0:1746147247.042730:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465502592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.042736:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.042740:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb966 expref: 27 pid: 14049 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.042746:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb966 expref: 27 pid: 14049 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.042757:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009812a600/0xb4b2209fbdacf2c3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eb966 expref: 27 pid: 14049 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.042764:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147247.042767:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147247.042772:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.042776:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4691 00000100:00100000:0.0:1746147247.042781:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:27370:x1830967465502848:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147247.042784:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1959:x1830967465502592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 54us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.042860:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:27370:x1830967465502848:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 79us (756us total) trans 8589945275 rc 0/0 00000100:00100000:0.0:1746147247.042865:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4691 00000100:00100000:1.0:1746147247.043479:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7623 00000100:00100000:1.0:1746147247.043536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.049253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.049303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:1.0:1746147247.078426:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945275 is committed 00000001:00080000:1.0:1746147247.078446:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945243 is committed 00000001:00080000:1.0:1746147247.078451:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945236 is committed 00000001:00080000:1.0:1746147247.078465:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945263 is committed 00000001:00080000:1.0:1746147247.078471:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945256 is committed 00000001:00080000:1.0:1746147247.078484:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945274 is committed 00000001:00080000:1.0:1746147247.078488:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945273 is committed 00000001:00080000:1.0:1746147247.078521:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945276 is committed 00000004:00080000:1.0:1746147247.078526:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2440 committed 00000004:00080000:1.0:1746147247.078533:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2427 committed 00000004:00080000:1.0:1746147247.078539:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2426 committed 00000004:00080000:1.0:1746147247.078541:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2425 committed 00000004:00080000:1.0:1746147247.078542:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2424 committed 00000004:00080000:1.0:1746147247.078544:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2439 committed 00000004:00080000:1.0:1746147247.078545:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2423 committed 00000004:00080000:1.0:1746147247.078547:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2438 committed 00000004:00080000:1.0:1746147247.078548:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2422 committed 00000004:00080000:1.0:1746147247.078549:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2437 committed 00000004:00080000:1.0:1746147247.078550:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2436 committed 00000004:00080000:1.0:1746147247.078552:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2435 committed 00000004:00080000:1.0:1746147247.078553:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2421 committed 00000004:00080000:1.0:1746147247.078555:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2420 committed 00000004:00080000:1.0:1746147247.078556:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2434 committed 00000004:00080000:1.0:1746147247.078558:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2433 committed 00000004:00080000:1.0:1746147247.078560:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2419 committed 00000100:00100000:1.0:1746147247.080800:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466952576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.080826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.080848:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.080861:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.080871:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.080884:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.080892:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466954112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.080904:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.080912:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:1.0:1746147247.080917:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466952448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.080929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.080955:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466952960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.080971:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.080982:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.080995:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.081001:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.081013:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.081019:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466954496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.081031:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.081050:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466952576 00000100:00100000:1.0:1746147247.081053:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466952576 00000100:00100000:1.0:1746147247.081068:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466953088 00000100:00100000:1.0:1746147247.081070:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466953088 00000100:00100000:1.0:1746147247.081075:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466953600 00000100:00100000:1.0:1746147247.081077:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466953600 00000100:00100000:1.0:1746147247.081081:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466954112 00000100:00100000:1.0:1746147247.081083:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466954112 00000100:00100000:1.0:1746147247.081087:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466952448 00000100:00100000:1.0:1746147247.081088:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466952448 00000100:00100000:1.0:1746147247.081092:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466952960 00000100:00100000:1.0:1746147247.081093:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466952960 00000100:00100000:1.0:1746147247.081098:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466953472 00000100:00100000:1.0:1746147247.081099:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466953472 00000100:00100000:1.0:1746147247.081105:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466953984 00000100:00100000:1.0:1746147247.081106:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466953984 00000100:00100000:1.0:1746147247.081112:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466954496 00000100:00100000:1.0:1746147247.081113:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466954496 00000100:00100000:1.0:1746147247.081121:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15024 00000100:00100000:1.0:1746147247.081125:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967466952576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.081244:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967466952576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (417us total) trans 21474841246 rc 0/0 00000100:00100000:1.0:1746147247.081250:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15024 00000100:00100000:1.0:1746147247.081264:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15025 00000100:00100000:1.0:1746147247.081268:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967466953088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147247.081363:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:1.0:1746147247.081366:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147247.081368:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147247.081370:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147247.081371:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:1.0:1746147247.081388:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967466953088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (526us total) trans 21474841247 rc 0/0 00000100:00100000:1.0:1746147247.081393:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15025 00000100:00100000:1.0:1746147247.081402:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15027 00000100:00100000:1.0:1746147247.081406:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967466954112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.081477:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3296:x1830967466954112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (572us total) trans 17179873876 rc 0/0 00000100:00100000:1.0:1746147247.081481:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15027 00000100:00100000:1.0:1746147247.081490:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15029 00000100:00100000:1.0:1746147247.081494:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967466952960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.081575:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967466952960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (604us total) trans 21474841249 rc 0/0 00000100:00100000:1.0:1746147247.081582:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15029 00000100:00100000:1.0:1746147247.081590:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15031 00000100:00100000:1.0:1746147247.081594:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1830967466953984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147247.081654:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3296:x1830967466953984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (640us total) trans 17179873878 rc 0/0 00000100:00100000:1.0:1746147247.081659:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15031 00000004:00080000:1.0:1746147247.081686:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb71180/2, rc 0, transno 21474841248 00000100:00100000:1.0:1746147247.081690:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466952448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.081696:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb72680/2, rc 0, transno 21474841249 00000100:00100000:1.0:1746147247.081698:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466952960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.081703:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb70380/2, rc 0, transno 17179873877 00000100:00100000:1.0:1746147247.081706:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147247.081712:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050ad80/2, rc 0, transno 17179873878 00000100:00100000:1.0:1746147247.081714:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147247.081719:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb72d80/2, rc 0, transno 21474841246 00000100:00100000:1.0:1746147247.081722:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466952576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.081726:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb71c00/2, rc 0, transno 21474841247 00000100:00100000:1.0:1746147247.081728:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.081733:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509c00/2, rc 0, transno 17179873876 00000100:00100000:1.0:1746147247.081735:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466954112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.082404:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9180/2, rc 0, transno 17179873879 00000100:00100000:0.0:1746147247.082408:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466954496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.083162:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090508000/2, rc 0, transno 17179873875 00000100:00100000:0.0:1746147247.083166:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466953600:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147247.085017:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.085029:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.085036:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.085041:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8c3800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147247.085047:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.085054:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.085070:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147247.085073:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147247.085076:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.085081:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c3800/0xb4b2209fbdacf873 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147247.097501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.101894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.102092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.102142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.102157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.102231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.102306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.114242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.117652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.118288:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465505408 00000100:00100000:0.0:1746147247.118292:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465505408 00000100:00100000:0.0:1746147247.118316:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7098 00000100:00100000:0.0:1746147247.118321:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465505408:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147247.118354:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdacf8b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.118368:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.118370:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.118376:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdacf8b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.118388:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdacf8b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.123269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.125720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.126393:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465505920 00000100:00100000:1.0:1746147247.126399:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465505920 00000100:00100000:1.0:1746147247.126426:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7100 00000100:00100000:1.0:1746147247.126430:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465505920:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147247.126444:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.126451:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.126452:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.126455:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.126462:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.134488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.134520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.134545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.134652:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465506432 00000100:00100000:1.0:1746147247.134656:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465506432 00000100:00100000:1.0:1746147247.134734:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7101 00000100:00100000:1.0:1746147247.134741:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465506176:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147247.134776:0:21471:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.134788:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.134789:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.134793:0:21471:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.134805:0:21471:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.135141:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.135155:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465506944 00000100:00100000:0.0:1746147247.135158:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465506944 00000100:00100000:0.0:1746147247.135175:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7104 00000100:00100000:0.0:1746147247.135191:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465506944:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147247.135202:0:21472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b7a6c00/0xb4b2209fbdacf8ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.135208:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.135209:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.135211:0:21472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7a6c00/0xb4b2209fbdacf8ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.135218:0:21472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7a6c00/0xb4b2209fbdacf8ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.160959:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.160967:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.160973:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.160978:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f31d400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147247.160980:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.160986:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.160996:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.161002:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdacf8ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.161079:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465505920:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 34643us (35360us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147247.161089:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7100 00010000:00010000:1.0:1746147247.166827:0:21471:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.166868:0:21471:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.166877:0:21471:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.166883:0:21471:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f31cc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147247.166900:0:21471:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.166918:0:21471:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.166966:0:21471:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.167005:0:21471:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdacf8d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.167204:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465506176:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 32420us (32682us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147247.167214:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7101 00000100:00100000:0.0:1746147247.182562:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507200 00000100:00100000:0.0:1746147247.182572:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507200 00000100:00100000:0.0:1746147247.183033:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11306 00000100:00100000:0.0:1746147247.183043:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31585:x1830967465507200:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:0.0:1746147247.183092:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.183117:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdacf888 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdc6 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.183145:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147247.183150:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147247.183196:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a824200/0xb4b2209fbdacf8f1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.183206:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a824200/0xb4b2209fbdacf8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.183218:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a824200/0xb4b2209fbdacf8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00010000:0.0:1746147247.183489:0:16361:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008e5c8700 reply state ffff880135306000 transno 8589945277 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a824200/0xb4b2209fbdacf8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147247.183495:0:16361:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147247.183590:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31585:x1830967465507200:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 547us (2357us total) trans 8589945277 rc 0/0 00000100:00100000:0.0:1746147247.183595:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11306 00000100:00100000:0.0:1746147247.188347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.188392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.188706:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507328 00000100:00100000:1.0:1746147247.188715:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507328 00000100:00100000:1.0:1746147247.188752:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507456 00000100:00100000:1.0:1746147247.188754:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507456 00000100:00100000:1.0:1746147247.188770:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15039 00000100:00100000:1.0:1746147247.188777:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465507328:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147247.188984:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147247.188986:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147245 -> 1746147246 00002000:00010000:1.0:1746147247.188989:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147245 -> 1746147246 00002000:00010000:1.0:1746147247.188991:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147245 -> 1746147246 00002000:00010000:1.0:1746147247.188993:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:1.0:1746147247.189616:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465507328:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 839us (1277us total) trans 17179873880 rc 0/0 00000100:00100000:1.0:1746147247.189622:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15039 00000100:00100000:0.0:1746147247.189634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.189648:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507712 00000100:00100000:1.0:1746147247.189651:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507712 00000100:00100000:0.0:1746147247.189671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.189673:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15041 00000100:00100000:1.0:1746147247.189678:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465507712:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:0.0:1746147247.189719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.189738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147247.189755:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147247.189757:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147244 -> 1746147246 00002000:00010000:1.0:1746147247.189759:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147244 -> 1746147246 00002000:00010000:1.0:1746147247.189761:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147244 -> 1746147246 00002000:00010000:1.0:1746147247.189763:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147247.189781:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465507712:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 103us (147us total) trans 17179873881 rc 0/0 00000100:00100000:1.0:1746147247.189786:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15041 00000100:00100000:1.0:1746147247.189795:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507968 00000100:00100000:1.0:1746147247.189797:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507968 00000100:00100000:1.0:1746147247.189807:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507584 00000100:00100000:1.0:1746147247.189808:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507584 00000100:00100000:1.0:1746147247.189815:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465507840 00000100:00100000:1.0:1746147247.189817:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465507840 00000100:00100000:1.0:1746147247.189825:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15042 00000100:00100000:1.0:1746147247.189829:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465507968:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147247.189891:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147247.189893:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.189895:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.189897:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.189898:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147247.189913:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465507968:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 83us (242us total) trans 21474841251 rc 0/0 00000100:00100000:1.0:1746147247.189918:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15042 00000100:00100000:1.0:1746147247.189927:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15044 00000100:00100000:1.0:1746147247.189931:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465507840:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147247.190001:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:1.0:1746147247.190004:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.190005:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147245 -> 1746147246 00002000:00010000:1.0:1746147247.190007:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.190009:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746147247.190498:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465507840:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 565us (758us total) trans 17179873882 rc 0/0 00000100:00100000:1.0:1746147247.190505:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15044 00000100:00100000:0.0:1746147247.192010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147247.221509:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945277 is committed 00000001:00080000:0.0:1746147247.221526:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945278 is committed 00000004:00080000:0.0:1746147247.221531:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2448 committed 00000004:00080000:0.0:1746147247.221538:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2436 committed 00000004:00080000:0.0:1746147247.221543:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2435 committed 00000004:00080000:0.0:1746147247.221545:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2434 committed 00000004:00080000:0.0:1746147247.221546:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2433 committed 00000004:00080000:0.0:1746147247.221548:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2447 committed 00000004:00080000:0.0:1746147247.221549:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2432 committed 00000004:00080000:0.0:1746147247.221550:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2446 committed 00000004:00080000:0.0:1746147247.221552:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2431 committed 00000004:00080000:0.0:1746147247.221554:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2445 committed 00000004:00080000:0.0:1746147247.221555:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2444 committed 00000004:00080000:0.0:1746147247.221556:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2443 committed 00000004:00080000:0.0:1746147247.221557:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2430 committed 00000004:00080000:0.0:1746147247.221559:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2429 committed 00000004:00080000:0.0:1746147247.221561:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2442 committed 00000004:00080000:0.0:1746147247.221562:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2441 committed 00000004:00080000:0.0:1746147247.221564:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2428 committed 00000100:00100000:0.0:1746147247.221718:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466954752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221776:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221815:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466955264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221828:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221843:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147247.221846:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466955136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221857:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221865:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009107ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466955648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221877:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221893:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466954880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221906:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221915:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466955392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221925:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221934:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147247.221964:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466955008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.221977:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.221990:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466955520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.222000:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.222020:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466954752 00000100:00100000:0.0:1746147247.222027:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466954752 00000100:00100000:0.0:1746147247.222057:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955264 00000100:00100000:0.0:1746147247.222059:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955264 00000100:00100000:0.0:1746147247.222068:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955136 00000100:00100000:0.0:1746147247.222069:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955136 00000100:00100000:0.0:1746147247.222076:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955648 00000100:00100000:0.0:1746147247.222078:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955648 00000100:00100000:0.0:1746147247.222082:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466954880 00000100:00100000:0.0:1746147247.222084:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466954880 00000100:00100000:0.0:1746147247.222089:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955392 00000100:00100000:0.0:1746147247.222090:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955392 00000100:00100000:0.0:1746147247.222095:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955008 00000100:00100000:0.0:1746147247.222097:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955008 00000100:00100000:0.0:1746147247.222101:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955520 00000100:00100000:0.0:1746147247.222102:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955520 00000100:00100000:0.0:1746147247.222110:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15045 00000100:00100000:0.0:1746147247.222117:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466954752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147247.222295:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147247.222298:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.222300:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.222302:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.222303:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:0.0:1746147247.222331:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466954752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (555us total) trans 17179873883 rc 0/0 00000100:00100000:0.0:1746147247.222336:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15045 00000100:00100000:0.0:1746147247.222349:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15046 00000100:00100000:0.0:1746147247.222353:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466955264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.222429:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466955264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (599us total) trans 17179873884 rc 0/0 00000100:00100000:0.0:1746147247.222434:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15046 00000100:00100000:0.0:1746147247.222443:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15047 00000100:00100000:0.0:1746147247.222447:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466955136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.222518:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466955136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (659us total) trans 17179873885 rc 0/0 00000100:00100000:0.0:1746147247.222523:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15047 00000100:00100000:0.0:1746147247.222531:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15048 00000100:00100000:0.0:1746147247.222535:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466955648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.222607:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466955648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (727us total) trans 17179873886 rc 0/0 00000100:00100000:0.0:1746147247.222612:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15048 00000100:00100000:0.0:1746147247.222736:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15049 00000100:00100000:0.0:1746147247.222741:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466954880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147247.222805:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147247.222808:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.222810:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.222812:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.222813:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147247.222835:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466954880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (927us total) trans 17179873887 rc 0/0 00000100:00100000:0.0:1746147247.222840:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15049 00000100:00100000:0.0:1746147247.222850:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15050 00000100:00100000:0.0:1746147247.222855:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466955392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.222923:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466955392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (995us total) trans 17179873888 rc 0/0 00000100:00100000:0.0:1746147247.222928:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15050 00000100:00100000:0.0:1746147247.222959:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15051 00000100:00100000:0.0:1746147247.222964:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466955008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147247.223028:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147247.223031:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.223033:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.223035:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.223036:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746147247.223053:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466955008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1074us total) trans 17179873889 rc 0/0 00000100:00100000:0.0:1746147247.223058:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15051 00000100:00100000:0.0:1746147247.223067:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15052 00000100:00100000:0.0:1746147247.223071:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466955520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.223143:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466955520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1141us total) trans 17179873890 rc 0/0 00000100:00100000:0.0:1746147247.223147:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15052 00000004:00080000:0.0:1746147247.223208:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0d880/2, rc 0, transno 17179873889 00000100:00100000:0.0:1746147247.223217:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466955008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223225:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091079880/2, rc 0, transno 17179873890 00000100:00100000:0.0:1746147247.223227:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466955520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223232:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0ea00/2, rc 0, transno 17179873887 00000100:00100000:0.0:1746147247.223235:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466954880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223240:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091079180/2, rc 0, transno 17179873888 00000100:00100000:0.0:1746147247.223242:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466955392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.223273:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147247.223279:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466955776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.223297:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.223322:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466955776 00000100:00100000:0.0:1746147247.223326:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466955776 00000100:00100000:0.0:1746147247.223341:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15053 00000100:00100000:0.0:1746147247.223346:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1830967466955776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.223422:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967466955776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (123us total) trans 17179873891 rc 0/0 00000100:00100000:0.0:1746147247.223427:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15053 00000004:00080000:0.0:1746147247.223445:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e6f0e00/2, rc 0, transno 17179873891 00000100:00100000:0.0:1746147247.223448:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466955776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223459:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0c380/2, rc 0, transno 17179873885 00000100:00100000:0.0:1746147247.223461:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466955136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223467:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009107ad80/2, rc 0, transno 17179873886 00000100:00100000:0.0:1746147247.223470:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009107ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466955648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223478:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0e300/2, rc 0, transno 17179873883 00000100:00100000:0.0:1746147247.223480:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466954752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.223485:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0e680/2, rc 0, transno 17179873884 00000100:00100000:0.0:1746147247.223488:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466955264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.226323:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466956160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147247.226389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.229565:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466956672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147247.229618:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.229637:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466956160 00000100:00100000:1.0:1746147247.229645:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466956160 00000100:00100000:1.0:1746147247.229992:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15058 00000100:00100000:1.0:1746147247.230000:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830967466956160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147247.230220:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147247.230223:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.230225:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.230227:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.230229:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147247.230258:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967466956160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (3869us total) trans 21474841257 rc 0/0 00000100:00100000:1.0:1746147247.230264:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15058 00000100:00100000:1.0:1746147247.230298:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466956288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147247.230439:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5ca680/2, rc 0, transno 21474841257 00000100:00100000:0.0:1746147247.230444:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466956160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147247.230709:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb72a00/2, rc 0, transno 21474841258 00000100:00100000:0.0:1746147247.230712:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466956672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147247.230830:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465508480 00000100:00100000:0.0:1746147247.230833:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465508480 00000100:00100000:0.0:1746147247.230859:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11307 00000100:00100000:0.0:1746147247.230863:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:31585:x1830967465508480:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147247.230876:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.230894:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdacf8ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebdf7 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.231120:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.231153:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466956800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.231170:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.231196:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466956288 00000100:00100000:1.0:1746147247.231198:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466956288 00000100:00100000:1.0:1746147247.231210:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466956800 00000100:00100000:1.0:1746147247.231211:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466956800 00000100:00100000:1.0:1746147247.231221:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15060 00000100:00100000:1.0:1746147247.231225:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466956288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.231314:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466956288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (194us total) trans 21474841259 rc 0/0 00000100:00100000:1.0:1746147247.231319:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15060 00000100:00100000:1.0:1746147247.231329:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15061 00000100:00100000:1.0:1746147247.231333:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466956800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.231398:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466956800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (227us total) trans 21474841260 rc 0/0 00000100:00100000:1.0:1746147247.231406:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15061 00000004:00080000:1.0:1746147247.231423:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5caa00/2, rc 0, transno 21474841259 00000100:00100000:1.0:1746147247.231427:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466956288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.231433:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050a300/2, rc 0, transno 21474841260 00000100:00100000:1.0:1746147247.231435:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466956800:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147247.231567:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdacf8ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdf7 expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.231582:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdacf8ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdf7 expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.231604:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147247.231607:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147247.231609:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31c200, rc 0) 00000100:00100000:0.0:1746147247.231641:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31585:x1830967465508480:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 778us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.231647:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11307 00000100:00100000:0.0:1746147247.237762:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465508736 00000100:00100000:0.0:1746147247.237771:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465508736 00000100:00100000:0.0:1746147247.237807:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4693 00000100:00100000:0.0:1746147247.237813:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094360c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31585:x1830967465508736:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147247.238242:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094360c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31585:x1830967465508736:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 427us (643us total) trans 8589945279 rc 0/0 00000100:00100000:0.0:1746147247.238259:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4693 00000100:00100000:0.0:1746147247.263130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.271382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.277234:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465509504 00000100:00100000:0.0:1746147247.277244:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465509504 00000100:00100000:0.0:1746147247.277280:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11310 00000100:00100000:0.0:1746147247.277287:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31597:x1830967465509504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147247.277310:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.277328:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fe800/0xb4b2209fbdacf94c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe0c expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.277419:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.277435:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147247.277445:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147247.277455:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147247.277558:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fe800/0xb4b2209fbdacf94c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe0c expref: 305 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.277585:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe0c expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.277593:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147247.277596:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147247.277599:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a76fec00, rc 0) 00000100:00100000:0.0:1746147247.277644:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31597:x1830967465509504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 358us (498us total) trans 8589945282 rc 0/0 00000100:00100000:0.0:1746147247.277649:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11310 00000100:00100000:0.0:1746147247.280412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.280457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.280502:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465509888 00000100:00100000:0.0:1746147247.280511:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465509888 00000100:00100000:0.0:1746147247.280555:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15062 00000100:00100000:0.0:1746147247.280563:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31596:x1830967465509888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147247.280582:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.280599:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf961 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe1a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.280627:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.280629:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.280636:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf961 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe1a expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.280649:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a825c00/0xb4b2209fbdacf961 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe1a expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.280659:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a825c00, rc 0) 00000100:00100000:0.0:1746147247.280713:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31596:x1830967465509888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 151us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.280719:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15062 00000100:00100000:0.0:1746147247.287897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.290194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.293422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.293478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.293496:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465510272 00000100:00100000:1.0:1746147247.293501:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465510272 00000100:00100000:1.0:1746147247.293527:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465510400 00000100:00100000:1.0:1746147247.293528:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465510400 00000100:00100000:1.0:1746147247.293541:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11312 00000100:00100000:1.0:1746147247.293546:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31597:x1830967465510272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.293563:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.293575:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed800/0xb4b2209fbdacf97d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe21 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.293641:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdacf984 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147247.293651:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdacf96f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe13 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.293657:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdacf984 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147247.293683:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdacf96f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe13 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.293697:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdacf96f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe13 expref: 9 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.293707:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466957184:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147247.293754:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.293772:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11313 00000100:00100000:1.0:1746147247.293778:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31596:x1830967465510400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.293784:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.293789:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ecc00/0xb4b2209fbdacf98b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe28 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.293816:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ecc00/0xb4b2209fbdacf98b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe28 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.293825:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ecc00/0xb4b2209fbdacf98b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe28 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.293838:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147247.293840:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147247.293842:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904ecc00, rc 0) 00000100:00100000:1.0:1746147247.293861:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31596:x1830967465510400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.293866:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11313 00000100:00100000:1.0:1746147247.298813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.298907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.307271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.319932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.321033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.321085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.321135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.321188:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465511424 00000100:00100000:0.0:1746147247.321192:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465511424 00000100:00100000:0.0:1746147247.321219:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15063 00000100:00100000:0.0:1746147247.321224:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:31597:x1830967465511424:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147247.321237:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.321251:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe36 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.321269:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.321271:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.321279:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe36 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.321291:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe36 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.321298:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009531ee00, rc 0) 00000100:00100000:0.0:1746147247.321319:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31597:x1830967465511424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.321323:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15063 00000100:00100000:0.0:1746147247.321366:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465511168 00000100:00100000:0.0:1746147247.321368:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465511168 00010000:00010000:0.0:1746147247.321380:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe0c expref: 304 pid: 16361 timeout: 734 lvb_type: 0 00000100:00100000:0.0:1746147247.321391:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465511552 00000100:00100000:0.0:1746147247.321392:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465511552 00010000:00010000:0.0:1746147247.321398:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdacf984 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe21 expref: 305 pid: 14048 timeout: 734 lvb_type: 0 00000100:00100000:0.0:1746147247.321412:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7634 00000100:00100000:0.0:1746147247.321416:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1957:x1830967465511168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.321422:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.321425:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe0c expref: 305 pid: 16361 timeout: 734 lvb_type: 0 00010000:00010000:0.0:1746147247.321432:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe0c expref: 305 pid: 16361 timeout: 734 lvb_type: 0 00010000:00010000:0.0:1746147247.321447:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a76fec00/0xb4b2209fbdacf953 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe0c expref: 305 pid: 16361 timeout: 734 lvb_type: 0 00010000:00010000:0.0:1746147247.321458:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147247.321461:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147247.321465:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147247.321469:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.321480:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967465511168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.321484:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7634 00000100:00100000:0.0:1746147247.321492:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7635 00000100:00100000:0.0:1746147247.321495:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1958:x1830967465511552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147247.321500:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147247.321503:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdacf984 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe21 expref: 303 pid: 14048 timeout: 734 lvb_type: 0 00010000:00010000:0.0:1746147247.321509:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdacf984 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe21 expref: 303 pid: 14048 timeout: 734 lvb_type: 0 00010000:00010000:0.0:1746147247.321517:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdacf984 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe21 expref: 303 pid: 14048 timeout: 734 lvb_type: 0 00010000:00010000:0.0:1746147247.321529:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147247.321531:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147247.321537:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147247.321542:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147247.321557:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147247.321566:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1958:x1830967465511552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.321570:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7635 00010000:00010000:0.0:1746147247.321603:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147247.321609:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:0.0:1746147247.322244:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3313, 88 off277024 00000004:00080000:0.0:1746147247.322252:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634309314068ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.322309:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3321, 88 off277728 00000004:00080000:0.0:1746147247.322315:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634309377422ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.322349:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3322, 88 off277816 00000004:00080000:0.0:1746147247.322353:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634309415380ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.322360:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3314, 88 off277112 00000004:00080000:0.0:1746147247.322363:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634309425368ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.322369:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3315, 88 off277200 00000004:00080000:0.0:1746147247.322371:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634309434297ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334410:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3323, 88 off277904 00000004:00080000:0.0:1746147247.334448:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634321510221ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.334508:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3324, 88 off277992 00000004:00080000:0.0:1746147247.334526:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634321588596ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.334547:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3325, 88 off278080 00000004:00080000:0.0:1746147247.334550:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634321613080ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.334577:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3316, 88 off277288 00000004:00080000:0.0:1746147247.334580:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634321642552ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334605:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3326, 88 off278168 00000004:00080000:0.0:1746147247.334628:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634321690287ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.334637:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3317, 88 off277376 00000004:00080000:0.0:1746147247.334639:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634321702107ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334655:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3327, 88 off278256 00000004:00080000:0.0:1746147247.334658:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634321720880ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147247.334665:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3318, 88 off277464 00000004:00080000:0.0:1746147247.334678:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634321730336ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334686:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3319, 88 off277552 00000004:00080000:0.0:1746147247.334689:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634321751772ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334696:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3320, 88 off277640 00000004:00080000:0.0:1746147247.334698:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634321761315ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334704:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3321, 88 off277728 00000004:00080000:0.0:1746147247.334718:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634321780511ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147247.334726:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3328, 88 off278344 00000004:00080000:0.0:1746147247.334729:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634321791627ns, next at 607576201812ns, rc = 0 00000100:00100000:0.0:1746147247.337956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.350776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.350817:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465511808 00000100:00100000:0.0:1746147247.350825:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465511808 00000100:00100000:0.0:1746147247.350871:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15064 00000100:00100000:0.0:1746147247.350880:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31596:x1830967465511808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147247.350896:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.350914:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe44 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.350952:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.350954:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.350961:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe44 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.350974:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe44 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.350982:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e03aa00, rc 0) 00000100:00100000:0.0:1746147247.351019:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31596:x1830967465511808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 141us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147247.351024:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15064 00000100:00100000:0.0:1746147247.360878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147247.395279:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945284 is committed 00000004:00080000:0.0:1746147247.395290:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2456 committed 00000004:00080000:0.0:1746147247.395324:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2445 committed 00000004:00080000:0.0:1746147247.395331:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2444 committed 00000004:00080000:0.0:1746147247.395333:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2443 committed 00000004:00080000:0.0:1746147247.395334:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2442 committed 00000004:00080000:0.0:1746147247.395336:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2455 committed 00000004:00080000:0.0:1746147247.395338:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2441 committed 00000004:00080000:0.0:1746147247.395339:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2454 committed 00000004:00080000:0.0:1746147247.395341:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2440 committed 00000004:00080000:0.0:1746147247.395343:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2453 committed 00000004:00080000:0.0:1746147247.395344:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2452 committed 00000004:00080000:0.0:1746147247.395346:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2451 committed 00000004:00080000:0.0:1746147247.395361:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2439 committed 00000004:00080000:0.0:1746147247.395363:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2438 committed 00000004:00080000:0.0:1746147247.395364:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2450 committed 00000004:00080000:0.0:1746147247.395366:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2449 committed 00000004:00080000:0.0:1746147247.395367:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2437 committed 00000001:00080000:0.0:1746147247.395373:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945282 is committed 00000001:00080000:0.0:1746147247.395386:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945279 is committed 00000100:00100000:0.0:1746147247.395566:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466957568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.395650:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.395703:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466958080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.395723:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.395739:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147247.395756:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466957696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.395768:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.395789:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466958208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.395801:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.395817:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466957824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.395862:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.395921:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466958336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.396146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.396372:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147247.396380:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466957952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.396595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.396638:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466958464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.396791:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.397084:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466957568 00000100:00100000:0.0:1746147247.397093:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466957568 00000100:00100000:0.0:1746147247.397301:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466958080 00000100:00100000:0.0:1746147247.397333:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466958080 00000100:00100000:0.0:1746147247.397452:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466957696 00000100:00100000:0.0:1746147247.397505:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466957696 00000100:00100000:0.0:1746147247.397522:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466958208 00000100:00100000:0.0:1746147247.397525:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466958208 00000100:00100000:0.0:1746147247.397583:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466957824 00000100:00100000:0.0:1746147247.397607:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466957824 00000100:00100000:0.0:1746147247.397722:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466958336 00000100:00100000:0.0:1746147247.397754:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466958336 00000100:00100000:0.0:1746147247.397766:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466957952 00000100:00100000:0.0:1746147247.397769:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466957952 00000100:00100000:0.0:1746147247.397778:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466958464 00000100:00100000:0.0:1746147247.397780:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466958464 00000100:00100000:0.0:1746147247.397795:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15065 00000100:00100000:0.0:1746147247.397863:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466957568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147247.399213:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147247.399218:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.399220:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.399221:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.399223:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:0.0:1746147247.399312:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466957568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1452us (3661us total) trans 17179873892 rc 0/0 00000100:00100000:0.0:1746147247.399319:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15065 00000100:00100000:0.0:1746147247.399357:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15066 00000100:00100000:0.0:1746147247.399363:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466958080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.399725:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466958080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 334us (3971us total) trans 17179873893 rc 0/0 00000100:00100000:0.0:1746147247.399754:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15066 00000100:00100000:0.0:1746147247.399778:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15067 00000100:00100000:0.0:1746147247.399783:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466957696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147247.400422:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147247.400427:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.400429:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.400431:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.400432:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147247.400470:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466957696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 685us (4698us total) trans 17179873894 rc 0/0 00000100:00100000:0.0:1746147247.400476:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15067 00000100:00100000:0.0:1746147247.400495:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15068 00000100:00100000:0.0:1746147247.400503:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466958208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.400623:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466958208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (4818us total) trans 17179873895 rc 0/0 00000100:00100000:0.0:1746147247.400629:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15068 00000100:00100000:0.0:1746147247.400644:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15069 00000100:00100000:0.0:1746147247.400651:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830967466957824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147247.400747:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147247.400749:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.400750:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.400752:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:0.0:1746147247.400754:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746147247.400784:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967466957824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (4921us total) trans 17179873896 rc 0/0 00000100:00100000:0.0:1746147247.400789:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15069 00000100:00100000:0.0:1746147247.400805:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15070 00000100:00100000:0.0:1746147247.400813:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830967466958336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.400926:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967466958336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (4780us total) trans 17179873897 rc 0/0 00000100:00100000:0.0:1746147247.400931:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15070 00000100:00100000:0.0:1746147247.400996:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15071 00000100:00100000:0.0:1746147247.401004:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1830967466957952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.401121:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967466957952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (4525us total) trans 17179873898 rc 0/0 00000100:00100000:0.0:1746147247.401127:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15071 00000100:00100000:0.0:1746147247.401143:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15072 00000100:00100000:0.0:1746147247.401150:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1830967466958464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.401273:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967466958464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (4504us total) trans 17179873899 rc 0/0 00000100:00100000:0.0:1746147247.401278:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15072 00000004:00080000:0.0:1746147247.401369:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b20bb80/2, rc 0, transno 17179873894 00000100:00100000:0.0:1746147247.401384:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466957696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401397:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5e680/2, rc 0, transno 17179873895 00000100:00100000:0.0:1746147247.401401:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466958208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401411:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e6f1c00/2, rc 0, transno 17179873892 00000100:00100000:0.0:1746147247.401415:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466957568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401424:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5c700/2, rc 0, transno 17179873893 00000100:00100000:0.0:1746147247.401427:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466958080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.401585:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147247.401599:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466958592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.401630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147247.401677:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466958592 00000100:00100000:0.0:1746147247.401682:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466958592 00000100:00100000:0.0:1746147247.401703:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15073 00000100:00100000:0.0:1746147247.401706:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3294:x1830967466958592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147247.401792:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967466958592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (162us total) trans 17179873900 rc 0/0 00000100:00100000:0.0:1746147247.401797:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15073 00000004:00080000:0.0:1746147247.401814:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcb100/2, rc 0, transno 17179873900 00000100:00100000:0.0:1746147247.401817:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466958592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401831:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5ed80/2, rc 0, transno 17179873898 00000100:00100000:0.0:1746147247.401833:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466957952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401839:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5f100/2, rc 0, transno 17179873899 00000100:00100000:0.0:1746147247.401842:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466958464:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401848:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b208e00/2, rc 0, transno 17179873896 00000100:00100000:0.0:1746147247.401850:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466957824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147247.401855:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5d180/2, rc 0, transno 17179873897 00000100:00100000:0.0:1746147247.401857:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466958336:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147247.402031:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402042:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147247.402045:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746147247.402049:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdacf9a7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe3d expref: 300 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402058:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdacf9a7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe3d expref: 300 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402064:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdacf9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe3d expref: 300 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402070:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdacf9b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe4b expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402075:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdacf9b5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe4b expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402079:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdacf9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe4b expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.402100:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdacf9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe4b expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.402107:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466958720:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147247.402171:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdacf9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe3d expref: 300 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.402187:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466958848:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147247.402201:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.402812:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.402840:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.402856:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.402868:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.402878:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147247.402881:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.402894:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.402903:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.402915:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.402931:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959232 00000100:00100000:1.0:1746147247.402935:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959232 00000100:00100000:1.0:1746147247.402971:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959744 00000100:00100000:1.0:1746147247.402973:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959744 00000100:00100000:1.0:1746147247.402982:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959104 00000100:00100000:1.0:1746147247.402983:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959104 00000100:00100000:1.0:1746147247.402991:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959616 00000100:00100000:1.0:1746147247.402993:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959616 00000100:00100000:1.0:1746147247.403002:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15074 00000100:00100000:1.0:1746147247.403007:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967466959232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147247.403150:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147247.403153:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.403155:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.403157:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.403159:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147247.403202:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3296:x1830967466959232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (360us total) trans 21474841261 rc 0/0 00000100:00100000:1.0:1746147247.403209:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15074 00000100:00100000:1.0:1746147247.403228:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15075 00000100:00100000:1.0:1746147247.403235:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967466959744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.403349:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3296:x1830967466959744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (478us total) trans 21474841262 rc 0/0 00000100:00100000:1.0:1746147247.403355:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15075 00000100:00100000:1.0:1746147247.403369:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15076 00000100:00100000:1.0:1746147247.403375:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967466959104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147247.403475:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147247.403478:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.403480:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.403482:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.403484:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147247.403512:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3296:x1830967466959104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (615us total) trans 21474841263 rc 0/0 00000100:00100000:1.0:1746147247.403518:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15076 00000100:00100000:1.0:1746147247.403532:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15077 00000100:00100000:1.0:1746147247.403538:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967466959616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147247.403633:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:1.0:1746147247.403637:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147247.403638:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147247.403640:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147247.403642:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:1.0:1746147247.403669:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3296:x1830967466959616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (751us total) trans 21474841264 rc 0/0 00000100:00100000:1.0:1746147247.403674:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15077 00000100:00100000:1.0:1746147247.403712:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466958976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.403741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.403757:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466959488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.403776:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.403796:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147247.403802:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466959360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.403824:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.403842:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466959872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.403864:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147247.403891:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466958976 00000100:00100000:1.0:1746147247.403896:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466958976 00000100:00100000:1.0:1746147247.403919:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959488 00000100:00100000:1.0:1746147247.403922:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959488 00000100:00100000:1.0:1746147247.403972:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959360 00000100:00100000:1.0:1746147247.403976:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959360 00000100:00100000:1.0:1746147247.403995:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466959872 00000100:00100000:1.0:1746147247.403998:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466959872 00000100:00100000:1.0:1746147247.404011:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15078 00000100:00100000:1.0:1746147247.404017:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466958976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147247.404121:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147247.404124:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.404126:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.404128:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147246 -> 1746147246 00002000:00010000:1.0:1746147247.404130:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147247.404165:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466958976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (423us total) trans 21474841265 rc 0/0 00000100:00100000:1.0:1746147247.404171:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15078 00000100:00100000:1.0:1746147247.404200:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15079 00000100:00100000:1.0:1746147247.404206:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466959488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.404323:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466959488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (544us total) trans 21474841266 rc 0/0 00000100:00100000:1.0:1746147247.404328:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15079 00000100:00100000:1.0:1746147247.404343:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15080 00000100:00100000:1.0:1746147247.404349:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466959360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.404461:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466959360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (635us total) trans 21474841267 rc 0/0 00000100:00100000:1.0:1746147247.404467:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15080 00000100:00100000:1.0:1746147247.404481:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15081 00000100:00100000:1.0:1746147247.404487:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466959872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147247.404595:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466959872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (729us total) trans 21474841268 rc 0/0 00000100:00100000:1.0:1746147247.404601:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15081 00000004:00080000:1.0:1746147247.404643:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fdf80/2, rc 0, transno 21474841267 00000100:00100000:1.0:1746147247.404647:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466959360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404654:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fce00/2, rc 0, transno 21474841268 00000100:00100000:1.0:1746147247.404656:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466959872:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404661:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fed80/2, rc 0, transno 21474841265 00000100:00100000:1.0:1746147247.404664:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466958976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404669:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fc380/2, rc 0, transno 21474841266 00000100:00100000:1.0:1746147247.404671:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466959488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404688:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fc000/2, rc 0, transno 21474841263 00000100:00100000:1.0:1746147247.404691:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404696:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fc700/2, rc 0, transno 21474841264 00000100:00100000:1.0:1746147247.404699:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404705:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fe680/2, rc 0, transno 21474841261 00000100:00100000:1.0:1746147247.404708:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147247.404713:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9ffb80/2, rc 0, transno 21474841262 00000100:00100000:1.0:1746147247.404715:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466959744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147247.411638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.412141:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466958720:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147247.412667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.412725:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466958848:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147247.412761:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661000/0xb4b2209fbdacf992 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 9 pid: 14049 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746147247.412779:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.412800:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f660800, rc 0) 00000100:00100000:1.0:1746147247.412824:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31594:x1830967465511040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 105366us (105571us total) trans 8589945284 rc 0/0 00000100:00100000:1.0:1746147247.412831:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11314 00000100:00100000:0.0:1746147247.416294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.423102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.423136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.423188:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465512576 00000100:00100000:0.0:1746147247.423198:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465512576 00000100:00100000:0.0:1746147247.423235:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15082 00000100:00100000:0.0:1746147247.423242:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31594:x1830967465512576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147247.423258:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.423275:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe52 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.423303:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdacf89d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebde9 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147247.423310:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.423312:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.423314:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2924544->3080191] (req 2924544->3080191) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe52 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.423341:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdacf89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebde9 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147247.423350:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdacf89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebde9 expref: 10 pid: 17530 timeout: 734 lvb_type: 1 00000100:00100000:0.0:1746147247.423361:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466960000:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147247.423424:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465512832 00000100:00100000:0.0:1746147247.423427:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465512832 00002000:00100000:0.0:1746147247.423453:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b50ca80 x1830967465512832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.423464:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50ca80 with x1830967465512832 ext(0->1048575) 00002000:00010000:0.0:1746147247.423469:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50ca80 00000100:00100000:0.0:1746147247.423487:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7107 00000100:00100000:0.0:1746147247.423493:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465512832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147247.428711:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.438312:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466960000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.438345:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2924544->3080191] (req 2924544->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe52 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.438364:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85ada00, rc 0) 00000100:00100000:1.0:1746147247.438424:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31594:x1830967465512576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15180us (15330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.438432:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15082 00000100:00100000:0.0:1746147247.443819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.457798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.465098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.469464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.469556:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465513600 00000100:00100000:1.0:1746147247.469567:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465513600 00000100:00100000:1.0:1746147247.469632:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15083 00000100:00100000:1.0:1746147247.469640:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:31597:x1830967465513600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.469654:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.469669:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdacf9c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe59 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.469689:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.469690:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.469697:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdacf9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe59 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.469708:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdacf9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe59 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.469717:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ddf0a00, rc 0) 00000100:00100000:1.0:1746147247.469770:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31597:x1830967465513600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.469775:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15083 00000100:00100000:0.0:1746147247.469910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.471623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.472025:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465513984 00000100:00100000:1.0:1746147247.472030:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465513984 00000100:00100000:1.0:1746147247.472055:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4696 00000100:00100000:1.0:1746147247.472061:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31594:x1830967465513984:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147247.472303:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31594:x1830967465513984:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 242us (681us total) trans 8589945285 rc 0/0 00000100:00100000:1.0:1746147247.472310:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4696 00000100:00100000:0.0:1746147247.473034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.473878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.476749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.476782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.478405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.478457:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465514752 00000100:00100000:1.0:1746147247.478462:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465514752 00010000:00010000:1.0:1746147247.478480:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdacf88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdcd expref: 10 pid: 17530 timeout: 734 lvb_type: 1 00000100:00100000:1.0:1746147247.478507:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465514624 00000100:00100000:1.0:1746147247.478509:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465514624 00010000:00010000:1.0:1746147247.478518:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe36 expref: 24 pid: 8481 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.478530:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7638 00000100:00100000:1.0:1746147247.478534:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465514752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.478542:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.478558:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdacf88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdcd expref: 10 pid: 17530 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147247.478566:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdacf88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdcd expref: 10 pid: 17530 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147247.478582:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdacf88f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdcd expref: 10 pid: 17530 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147247.478595:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.478617:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465514752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 82us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.478622:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7638 00000100:00100000:1.0:1746147247.478639:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7639 00000100:00100000:1.0:1746147247.478644:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465514624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.478650:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.478657:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe36 expref: 24 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.478665:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe36 expref: 24 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.478674:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009531ee00/0xb4b2209fbdacf9a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe36 expref: 24 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.478683:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.478685:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.478689:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b1c00/0xb4b2209fbdacf9ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe60 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.478695:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b1c00/0xb4b2209fbdacf9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe60 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.478718:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a47b1c00/0xb4b2209fbdacf9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe60 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.478726:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466960640:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147247.478773:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.481620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.481774:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465515008 00000100:00100000:0.0:1746147247.481780:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465515008 00002000:00100000:0.0:1746147247.481808:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (823296->827391) req@ffff88009b50c700 x1830967465515008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.481817:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50c700 with x1830967465515008 ext(823296->827391) 00002000:00010000:0.0:1746147247.481820:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50c700 00000100:00100000:0.0:1746147247.481845:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7111 00000100:00100000:0.0:1746147247.481851:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465515008:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147247.482703:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465515008:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 850us (1086us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147247.482710:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7111 00002000:00100000:0.0:1746147247.482716:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (823296->827391) req@ffff88009b50c700 x1830967465515008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/4536 e 0 to 0 dl 1746147258 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.482722:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50c700 with x1830967465515008 ext(823296->827391) 00002000:00010000:0.0:1746147247.482725:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50c700 00000100:00100000:0.0:1746147247.491209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.508387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.508800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.508867:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465515392 00000100:00100000:1.0:1746147247.508878:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465515392 00000100:00100000:1.0:1746147247.508929:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465515520 00000100:00100000:1.0:1746147247.508931:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465515520 00000100:00100000:1.0:1746147247.508975:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15086 00000100:00100000:1.0:1746147247.508982:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31597:x1830967465515392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.509000:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.509017:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebe6e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.509040:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.509042:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.509050:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe6e expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.509064:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe6e expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.509074:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360c00, rc 0) 00000100:00100000:1.0:1746147247.511146:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31597:x1830967465515392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2163us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.511155:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15086 00000100:00100000:0.0:1746147247.518463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.519870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.519884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.519913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.519932:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465515776 00000100:00100000:1.0:1746147247.519949:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465515776 00010000:00010000:1.0:1746147247.519963:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacf8a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdd4 expref: 12 pid: 17530 timeout: 734 lvb_type: 1 00000100:00100000:1.0:1746147247.519981:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465515904 00000100:00100000:1.0:1746147247.519983:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465515904 00010000:00010000:1.0:1746147247.519991:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe44 expref: 15 pid: 4445 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.520003:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7641 00000100:00100000:1.0:1746147247.520008:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465515776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.520014:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.520021:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacf8a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdd4 expref: 12 pid: 17530 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147247.520029:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacf8a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdd4 expref: 12 pid: 17530 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147247.520041:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacf8a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdd4 expref: 12 pid: 17530 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147247.520051:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.520068:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465515776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.520073:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7641 00000100:00100000:1.0:1746147247.520083:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7642 00000100:00100000:1.0:1746147247.520088:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465515904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.520093:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.520098:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe44 expref: 15 pid: 4445 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.520107:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe44 expref: 15 pid: 4445 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.520117:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdacf9ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe44 expref: 15 pid: 4445 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.520124:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.520126:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.520132:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.520139:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.520166:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.520190:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466961152:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147247.520230:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.520296:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465516160 00000100:00100000:1.0:1746147247.520299:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465516160 00002000:00100000:1.0:1746147247.520322:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b50e680 x1830967465516160/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147247.520330:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50e680 with x1830967465516160 ext(1048576->2097151) 00002000:00010000:1.0:1746147247.520334:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50e680 00000100:00100000:1.0:1746147247.520346:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7113 00000100:00100000:1.0:1746147247.520351:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465516160:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147247.521638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.526015:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466961152:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147247.526040:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.526083:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465515904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5993us (6195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.526093:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7642 00000100:00100000:0.0:1746147247.530586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.532657:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465516160:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12301us (12738us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147247.532665:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7113 00002000:00100000:1.0:1746147247.532671:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b50e680 x1830967465516160/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/440 e 0 to 0 dl 1746147258 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147247.532679:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50e680 with x1830967465516160 ext(1048576->2097151) 00002000:00010000:1.0:1746147247.532683:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50e680 00000100:00100000:0.0:1746147247.534778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.535241:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465516800 00000100:00100000:1.0:1746147247.535250:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465516800 00002000:00100000:1.0:1746147247.535291:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012ecece00 x1830967465516800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147247.535304:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967465516800 ext(1048576->2097151) 00002000:00010000:1.0:1746147247.535309:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:1.0:1746147247.535338:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7115 00000100:00100000:1.0:1746147247.535345:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465516800:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147247.552825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.563278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.566574:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465516800:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 31223us (31796us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147247.566583:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7115 00002000:00100000:1.0:1746147247.566593:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012ecece00 x1830967465516800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:623/0 lens 488/440 e 0 to 0 dl 1746147258 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147247.566602:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967465516800 ext(1048576->2097151) 00002000:00010000:1.0:1746147247.566607:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:0.0:1746147247.576572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.581083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.582368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.590315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.590414:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465518464 00000100:00100000:1.0:1746147247.590425:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465518464 00000100:00100000:1.0:1746147247.590480:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11317 00000100:00100000:1.0:1746147247.590488:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31601:x1830967465518464:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147247.590508:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.590524:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360200/0xb4b2209fbdacfa02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebea6 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.590623:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590632:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590645:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590655:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590660:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590664:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590764:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590770:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590774:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147247.590783:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147247.590866:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590878:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590883:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590889:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f361e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147247.590892:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590899:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590909:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147247.590911:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147247.590914:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590919:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f361e00/0xb4b2209fbdacfa10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590982:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590988:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590993:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.590997:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f360800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147247.590999:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.591004:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.591010:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134f48700) 00010000:00010000:1.0:1746147247.591012:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147247.591014:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.591018:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360800/0xb4b2209fbdacfa17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.591066:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360200/0xb4b2209fbdacfa02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebea6 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.591075:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebea6 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.591081:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147247.591082:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147247.591084:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360400, rc 0) 00000100:00100000:1.0:1746147247.591103:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31601:x1830967465518464:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 616us (799us total) trans 8589945287 rc 0/0 00000100:00100000:1.0:1746147247.591108:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11317 00000100:00100000:0.0:1746147247.594396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.596592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.616297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.616413:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465518976 00000100:00100000:1.0:1746147247.616425:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465518976 00010000:00010000:1.0:1746147247.616466:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe52 expref: 15 pid: 8478 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.616522:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7643 00000100:00100000:1.0:1746147247.616532:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465518976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.616548:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.616574:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe52 expref: 15 pid: 8478 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.616586:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3080191) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe52 expref: 15 pid: 8478 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.616616:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85ada00/0xb4b2209fbdacf9bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3080191) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe52 expref: 15 pid: 8478 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.616659:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.616662:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.616671:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.616681:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.616721:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.616735:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466961536:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147247.616819:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.623239:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466961536:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147247.623275:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.623348:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465518976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6816us (7062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.623360:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7643 00000100:00100000:0.0:1746147247.626345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.636255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.636303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.640950:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7120 00000100:00100000:0.0:1746147247.640969:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465519616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147247.650962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.650996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.651018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.651045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.651081:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465519872 00000100:00100000:0.0:1746147247.651089:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465519872 00002000:00100000:0.0:1746147247.651130:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e976680 x1830967465519872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.651140:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967465519872 ext(2097152->3145727) 00002000:00010000:0.0:1746147247.651146:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:0.0:1746147247.651161:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465520128 00000100:00100000:0.0:1746147247.651163:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465520128 00002000:00100000:0.0:1746147247.651170:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e977b80 x1830967465520128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.651189:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977b80 with x1830967465520128 ext(3145728->4194303) 00002000:00010000:0.0:1746147247.651191:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977b80 00000100:00100000:0.0:1746147247.651199:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465520384 00000100:00100000:0.0:1746147247.651201:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465520384 00002000:00100000:0.0:1746147247.651213:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e974700 x1830967465520384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.651219:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974700 with x1830967465520384 ext(2097152->3145727) 00002000:00010000:0.0:1746147247.651222:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974700 00000100:00100000:0.0:1746147247.651228:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465520640 00000100:00100000:0.0:1746147247.651230:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465520640 00002000:00100000:0.0:1746147247.651238:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e976a00 x1830967465520640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:623/0 lens 488/0 e 0 to 0 dl 1746147258 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.651248:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967465520640 ext(3145728->4194303) 00002000:00010000:0.0:1746147247.651251:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e976a00 00000100:00100000:0.0:1746147247.651261:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7121 00000100:00100000:0.0:1746147247.651268:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465519872:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147247.653289:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7122 00000100:00100000:0.0:1746147247.653301:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967465520128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147247.662134:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465519360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24984us (25878us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147247.662146:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7119 00002000:00100000:0.0:1746147247.662157:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e975880 x1830967465519360/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:623/0 lens 488/440 e 0 to 0 dl 1746147258 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147247.662166:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975880 with x1830967465519360 ext(3145728->4194303) 00002000:00010000:0.0:1746147247.662172:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975880 00000100:00100000:0.0:1746147247.671772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.671841:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465520768 00000100:00100000:1.0:1746147247.671851:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465520768 00000100:00100000:1.0:1746147247.671918:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15095 00000100:00100000:1.0:1746147247.671926:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31601:x1830967465520768:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147247.671966:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.671986:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebeb4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.672016:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.672024:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.672029:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.672031:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.672034:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.672061:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.672071:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.672081:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466961664:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.672162:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.672170:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 28 pid: 8481 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.672192:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466961792:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147247.672207:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.676338:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466961664:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147247.676353:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466961792:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.676383:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.676401:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f195c00, rc 0) 00000100:00100000:1.0:1746147247.676474:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31601:x1830967465520768:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4547us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.676483:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15095 00000100:00100000:0.0:1746147247.677203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.677246:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465520896 00000100:00100000:1.0:1746147247.677253:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465520896 00010000:00010000:1.0:1746147247.677282:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.677343:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7644 00000100:00100000:1.0:1746147247.677349:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967465520896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.677362:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.677377:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.677386:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.677408:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f481000/0xb4b2209fbdacfa33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebead expref: 16 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.678011:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.678030:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465520896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 681us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.678035:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7644 00000100:00100000:0.0:1746147247.683790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.683829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.683854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.683863:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465521024 00000100:00100000:0.0:1746147247.683871:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465521152 00000100:00100000:1.0:1746147247.683873:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465521024 00000100:00100000:0.0:1746147247.683873:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465521152 00000100:00100000:0.0:1746147247.683914:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465521280 00000100:00100000:0.0:1746147247.683916:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465521280 00000100:00100000:1.0:1746147247.684008:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15096 00000100:00100000:1.0:1746147247.684017:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465521152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.684036:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.684056:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfa41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebec2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.684111:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466961920:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147247.684193:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.684218:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15097 00000100:00100000:1.0:1746147247.684223:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465521024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.684237:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.684248:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f194000/0xb4b2209fbdacfa48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebebb expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.684272:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466962048:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147247.684295:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.685662:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15098 00000100:00100000:0.0:1746147247.685671:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465521280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147247.685683:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.685698:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f360e00/0xb4b2209fbdacfa4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebec9 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.685754:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.685766:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f360e00/0xb4b2209fbdacfa4f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebec9 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.685776:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f360e00/0xb4b2209fbdacfa4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebec9 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.685801:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360e00, rc 0) 00000100:00100000:1.0:1746147247.685847:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465521280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 178us (1990us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.686336:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15098 00000100:00100000:0.0:1746147247.688908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.689688:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465521536 00000100:00100000:1.0:1746147247.689698:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465521536 00000100:00100000:1.0:1746147247.689774:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11318 00000100:00100000:1.0:1746147247.689784:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31603:x1830967465521536:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147247.689810:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.689830:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195600/0xb4b2209fbdacfa56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebed0 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.689976:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.689989:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.689999:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690016:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690021:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690026:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690127:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690134:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690139:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147247.690148:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147247.690251:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690258:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690263:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690268:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f195800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147247.690272:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690278:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690289:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147247.690291:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147247.690295:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690299:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdacfa5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690324:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690328:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690333:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690337:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f194200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147247.690339:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690343:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690348:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134f48700) 00010000:00010000:1.0:1746147247.690350:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147247.690352:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690356:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfa64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.690391:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195600/0xb4b2209fbdacfa56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed0 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.690403:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed0 expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.690408:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147247.690410:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147247.690412:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194800, rc 0) 00000100:00100000:1.0:1746147247.692523:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31603:x1830967465521536:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2732us (3616us total) trans 8589945288 rc 0/0 00000100:00100000:1.0:1746147247.692655:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11318 00002000:00010000:1.0:1746147247.692724:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147246 -> 1746147247 00002000:00010000:1.0:1746147247.692728:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147246 -> 1746147247 00002000:00010000:1.0:1746147247.692729:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime: 1746147246 -> 1746147247 00000100:00100000:1.0:1746147247.692746:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466961920:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147247.692771:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfa41 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebec2 expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.692783:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfa41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebec2 expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.692791:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194600, rc 0) 00000100:00100000:1.0:1746147247.693169:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465521152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9152us (9338us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.693185:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15096 00002000:00010000:1.0:1746147247.693241:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime: 1746147246 -> 1746147247 00002000:00010000:1.0:1746147247.693243:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime: 1746147246 -> 1746147247 00002000:00010000:1.0:1746147247.693245:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime: 1746147246 -> 1746147247 00000100:00100000:1.0:1746147247.693269:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466962048:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147247.693285:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f194000/0xb4b2209fbdacfa48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebebb expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.693293:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f194000/0xb4b2209fbdacfa48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebebb expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.693300:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194000, rc 0) 00000100:00100000:0.0:1746147247.693596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.693960:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465521024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9735us (10179us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.693968:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15097 00000100:00100000:1.0:1746147247.693998:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465521664 00000100:00100000:1.0:1746147247.694004:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465521664 00000100:00100000:1.0:1746147247.694040:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15099 00000100:00100000:1.0:1746147247.694046:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:31597:x1830967465521664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.694059:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.694072:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebed7 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.694090:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.694095:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.694101:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147247.694103:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.694134:0:4445:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.694143:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.694152:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f195000, rc 0) 00000100:00100000:1.0:1746147247.694168:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31597:x1830967465521664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 122us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.694183:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15099 00000100:00100000:0.0:1746147247.700481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.706837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.709851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.710063:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465522176 00000100:00100000:1.0:1746147247.710074:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465522176 00010000:00010000:1.0:1746147247.710111:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 26 pid: 8481 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.710557:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7645 00000100:00100000:1.0:1746147247.710591:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465522176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.710605:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.710685:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 26 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.710697:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 26 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.710716:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f480200/0xb4b2209fbdacfa09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe98 expref: 26 pid: 8481 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.710737:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.710738:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.710744:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.710751:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.710780:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.710789:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 17 pid: 11147 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.710800:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466962304:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147247.712145:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.718912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.718932:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466962304:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147247.718974:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.719025:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465522176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8436us (9174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.719034:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7645 00000100:00100000:0.0:1746147247.727441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.731779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.731999:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465523072 00000100:00100000:1.0:1746147247.732007:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465523072 00000100:00100000:1.0:1746147247.732056:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4698 00000100:00100000:1.0:1746147247.732062:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31601:x1830967465523072:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147247.732261:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31601:x1830967465523072:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 198us (489us total) trans 8589945289 rc 0/0 00000100:00100000:1.0:1746147247.732268:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4698 00000100:00100000:0.0:1746147247.737444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.737480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.737883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.738023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.738067:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465523456 00000100:00100000:1.0:1746147247.738075:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465523456 00000100:00100000:1.0:1746147247.738108:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465523328 00000100:00100000:1.0:1746147247.738110:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465523328 00000100:00100000:1.0:1746147247.738125:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465523584 00000100:00100000:1.0:1746147247.738127:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465523584 00000100:00100000:0.0:1746147247.738244:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15102 00000100:00100000:0.0:1746147247.738250:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465523328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147247.738257:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.738264:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdacfa8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebee5 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.738286:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466962560:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147247.738304:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147247.738353:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15103 00000100:00100000:1.0:1746147247.738358:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465523584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.738364:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.738370:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdacfa95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebef3 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.738385:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdacfa95 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebef3 expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.738393:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdacfa95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebef3 expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.738413:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f195800, rc 0) 00000100:00100000:1.0:1746147247.738434:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465523584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (551us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.738439:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15103 00000100:00100000:1.0:1746147247.741736:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466962560:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147247.741764:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdacfa8e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebee5 expref: 19 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.741775:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdacfa8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebee5 expref: 19 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.741784:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065800, rc 0) 00000100:00100000:1.0:1746147247.741819:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465523328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3569us (4339us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.741826:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15102 00000100:00100000:0.0:1746147247.746735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.746763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.746792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.747251:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465523840 00000100:00100000:1.0:1746147247.747256:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465523840 00000100:00100000:1.0:1746147247.747277:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15105 00000100:00100000:1.0:1746147247.747282:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465523840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147247.747289:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.747297:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfaaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf01 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.747322:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466962688:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147247.747414:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.748791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.749061:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465524096 00000100:00100000:1.0:1746147247.749065:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465524096 00010000:00010000:1.0:1746147247.749082:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 19 pid: 11147 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.749145:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7646 00000100:00100000:1.0:1746147247.749152:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465524096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147247.749162:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147247.749172:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 18 pid: 11147 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.749192:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 18 pid: 11147 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.749206:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f195c00/0xb4b2209fbdacfa3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3387392->3862527] (req 3387392->3862527) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebeb4 expref: 18 pid: 11147 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147247.749219:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.749220:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147247.749225:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.749232:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.749252:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147247.749259:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466962944:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147247.749491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.749735:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466962688:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147247.749750:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfaaa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf01 expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.749764:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f194200/0xb4b2209fbdacfaaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf01 expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.749771:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194200, rc 0) 00000100:00100000:1.0:1746147247.749793:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465523840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2510us (3029us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.749798:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15105 00000100:00100000:1.0:1746147247.749844:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.751703:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.753367:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466962944:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147247.753382:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147247.753427:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1958:x1830967465524096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4274us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.753436:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7646 00000100:00100000:0.0:1746147247.754658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.757020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.773722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.794605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.884992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.885096:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465525888 00000100:00100000:1.0:1746147247.885107:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465525888 00000100:00100000:1.0:1746147247.885164:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11319 00000100:00100000:1.0:1746147247.885183:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31610:x1830967465525888:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147247.885208:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.885227:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b000/0xb4b2209fbdacfab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf0f expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.885327:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.885341:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebea6 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.885348:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed0 expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.885354:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.885383:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed0 expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.885393:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdacfa6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed0 expref: 307 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.885404:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466963072:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.890443:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebea6 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.890462:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebea6 expref: 12 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.890477:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466963200:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147247.890519:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.898928:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.899279:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466963072:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.899293:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f360400/0xb4b2209fbdacfa25 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebea6 expref: 12 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.899322:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466963200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.899343:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147247.899497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147247.900185:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.900192:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147247.900210:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147247.900350:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b000/0xb4b2209fbdacfab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf0f expref: 308 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.900363:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf0f expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.900369:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147247.900372:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147247.900374:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009342b200, rc 0) 00000100:00100000:1.0:1746147247.900401:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:31610:x1830967465525888:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15230us (15466us total) trans 8589945293 rc 0/0 00000100:00100000:1.0:1746147247.900407:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11319 00000100:00100000:0.0:1746147247.955850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.955928:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465526272 00000100:00100000:1.0:1746147247.955972:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465526272 00000100:00100000:1.0:1746147247.956032:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11320 00000100:00100000:1.0:1746147247.956040:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:31613:x1830967465526272:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147247.956065:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147247.956084:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342a000/0xb4b2209fbdacfac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf16 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.956152:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956164:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956183:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956197:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956202:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956207:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956316:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956326:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf0f expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.956332:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.956366:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf0f expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.956377:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b200/0xb4b2209fbdacfab8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf0f expref: 306 pid: 14049 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746147247.956394:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466963328:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147247.956490:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.970671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.970808:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466963328:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.970830:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.970975:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.970981:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147247.971025:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:1.0:1746147247.971029:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147247.971044:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971054:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971063:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971068:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971074:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971080:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009342ae00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147247.971083:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971089:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971100:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147247.971103:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147247.971106:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971110:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ae00/0xb4b2209fbdacfacd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971126:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971130:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971135:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971138:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009342aa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147247.971140:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971144:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971149:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134f48000) 00010000:00010000:1.0:1746147247.971151:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147247.971153:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971156:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342aa00/0xb4b2209fbdacfad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147247.971228:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342a000/0xb4b2209fbdacfac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf16 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.971239:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf16 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147247.971245:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147247.971246:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147247.971248:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009342ba00, rc 0) 00000100:00100000:1.0:1746147247.971281:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31613:x1830967465526272:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 15243us (15443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147247.971288:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11320 00000100:00100000:0.0:1746147247.980572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.981991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.983666:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465526912 00000100:00100000:0.0:1746147247.983670:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465526912 00000100:00100000:0.0:1746147247.983691:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15108 00000100:00100000:0.0:1746147247.983696:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465526912:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147247.983703:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.983712:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacfb0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf2b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147247.983737:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466963584:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147247.984387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147247.984431:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147247.989642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.995202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147247.997785:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15110 00000100:00100000:0.0:1746147247.997794:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31610:x1830967465527424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147247.997809:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147247.997823:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf40 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.997897:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f065200/0xb4b2209fbdacf8b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdf0 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147247.997906:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacfa1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe9f expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.997912:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdacf9fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe91 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147247.997917:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.997919:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147247.997921:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.997963:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdacf9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe91 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147247.997965:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466963584:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147247.997973:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdacf9fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe91 expref: 26 pid: 8478 timeout: 734 lvb_type: 1 00000100:00100000:0.0:1746147247.997983:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466963712:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147247.997989:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacfb0c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf2b expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.998000:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacfb0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf2b expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147247.998012:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194a00, rc 0) 00000100:00100000:1.0:1746147247.998034:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465526912:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 14337us (16047us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147247.998039:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15108 00010000:00010000:0.0:1746147247.998047:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacfa1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe9f expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147247.998055:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f481200/0xb4b2209fbdacfa1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe9f expref: 14 pid: 8478 timeout: 734 lvb_type: 0 00000100:00100000:0.0:1746147247.998063:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466963840:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147247.998088:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f065200/0xb4b2209fbdacf8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdf0 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147247.998095:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f065200/0xb4b2209fbdacf8b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebdf0 expref: 10 pid: 17530 timeout: 734 lvb_type: 1 00000100:00100000:0.0:1746147247.998103:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466963968:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147247.998210:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.005478:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147248.005697:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147248.012859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.012895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.012919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.013006:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466963712:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147248.013039:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466963840:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147248.013064:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466963968:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147248.013092:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.013113:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194600, rc 0) 00000100:00100000:0.0:1746147248.013150:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31610:x1830967465527424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15357us (17958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.013157:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15110 00000100:00100000:0.0:1746147248.013198:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15111 00000100:00100000:0.0:1746147248.013206:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465527552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147248.013219:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147248.013231:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f195a00/0xb4b2209fbdacfb44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf47 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.013265:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15112 00000100:00100000:0.0:1746147248.013265:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466964352:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147248.013281:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465527680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.013294:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.013307:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009342a600/0xb4b2209fbdacfb52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf4e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147248.013307:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.013328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.013348:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466964480:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147248.013369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.013632:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.013657:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7651 00000100:00100000:1.0:1746147248.013663:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465528192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.013671:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.013681:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdacf9fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe91 expref: 26 pid: 8478 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147248.013691:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdacf9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe91 expref: 26 pid: 8478 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147248.013710:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdacf9fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe91 expref: 26 pid: 8478 timeout: 734 lvb_type: 1 00010000:00010000:1.0:1746147248.013723:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.013741:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465528192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.013747:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7651 00000100:00100000:0.0:1746147248.015514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.015532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.015550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.015602:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466964352:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147248.015622:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f195a00/0xb4b2209fbdacfb44 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf47 expref: 19 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147248.015634:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f195a00/0xb4b2209fbdacfb44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf47 expref: 19 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147248.015653:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f195a00, rc 0) 00000100:00100000:0.0:1746147248.015686:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465527552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2479us (2833us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147248.015693:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15111 00000100:00100000:0.0:1746147248.016025:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466964480:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147248.016039:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009342a600/0xb4b2209fbdacfb52 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf4e expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147248.016047:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009342a600/0xb4b2209fbdacfb52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf4e expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147248.016054:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009342a600, rc 0) 00000100:00100000:0.0:1746147248.016073:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465527680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2801us (3178us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147248.016078:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15112 00000100:00100000:1.0:1746147248.017705:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7654 00000100:00100000:1.0:1746147248.017715:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465528576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.017723:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.017730:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf16 expref: 9 pid: 14049 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147248.017740:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf16 expref: 9 pid: 14049 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147248.017752:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfadb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf16 expref: 9 pid: 14049 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746147248.017769:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.017773:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63ac00/0xb4b2209fbdacfb3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147248.017779:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63ac00/0xb4b2209fbdacfb3d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147248.017785:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63ac00/0xb4b2209fbdacfb3d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147248.017812:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.017843:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465528576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 131us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.017850:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7654 00000100:00100000:0.0:1746147248.020242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.021510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.021534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.021798:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465529088 00000100:00100000:1.0:1746147248.021802:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465529088 00000100:00100000:0.0:1746147248.025729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.026143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.026180:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465529472 00000100:00100000:1.0:1746147248.026188:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465529472 00000100:00100000:0.0:1746147248.026194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147248.026231:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdacf8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebde2 expref: 10 pid: 17530 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746147248.026252:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465529344 00000100:00100000:1.0:1746147248.026255:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465529344 00010000:00010000:1.0:1746147248.026280:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f481800/0xb4b2209fbdacf9ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe83 expref: 25 pid: 8478 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.026296:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7656 00000100:00100000:1.0:1746147248.026301:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465529344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.026312:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.026329:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f481800/0xb4b2209fbdacf9ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe83 expref: 25 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.026340:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f481800/0xb4b2209fbdacf9ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe83 expref: 25 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.026372:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f481800/0xb4b2209fbdacf9ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe83 expref: 25 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.026397:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.026421:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465529344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 119us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.026426:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7656 00000100:00100000:1.0:1746147248.031734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.031756:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465530112 00000100:00100000:1.0:1746147248.031760:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465530112 00000100:00100000:1.0:1746147248.031795:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11325 00000100:00100000:1.0:1746147248.031800:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31619:x1830967465530112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.031812:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.031823:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b800/0xb4b2209fbdacfb83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf7f expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.031917:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.031926:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.031934:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.031966:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.031970:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.031975:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032072:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032079:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032084:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147248.032092:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147248.032185:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032192:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032200:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032206:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009342b600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147248.032209:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032215:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032222:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147248.032225:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147248.032228:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032232:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b600/0xb4b2209fbdacfb8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032241:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032245:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032249:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032253:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009342b400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147248.032255:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032259:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032347:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134f48500) 00010000:00010000:1.0:1746147248.032350:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147248.032352:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032357:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b400/0xb4b2209fbdacfb91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147248.032390:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342b800/0xb4b2209fbdacfb83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf7f expref: 309 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.032400:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf7f expref: 308 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.032406:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.032408:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147248.032410:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147248.032415:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147248.032419:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009342ba00, rc 0) 00000100:00100000:1.0:1746147248.032441:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31619:x1830967465530112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 640us (707us total) trans 8589945297 rc 0/0 00000100:00100000:1.0:1746147248.032446:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11325 00000100:00080000:1.0:1746147248.032464:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147248.033037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.038789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.038973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.039035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.039058:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465531008 00000100:00100000:0.0:1746147248.039066:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465531008 00010000:00010000:0.0:1746147248.039099:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5291a00/0xb4b2209fbdacfb4b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf55 expref: 20 pid: 8478 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746147248.039133:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7659 00000100:00100000:0.0:1746147248.039140:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465531008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.039157:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.039187:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5291a00/0xb4b2209fbdacfb4b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf55 expref: 20 pid: 8478 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.039198:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5291a00/0xb4b2209fbdacfb4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf55 expref: 20 pid: 8478 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.039220:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.039256:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465531008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.039261:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7659 00000100:00100000:0.0:1746147248.039333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.039349:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465530752 00000100:00100000:0.0:1746147248.039352:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465530752 00010000:00010000:0.0:1746147248.039362:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63a400/0xb4b2209fbdacfa80 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3862528->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebede expref: 20 pid: 21080 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.039377:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7660 00000100:00100000:0.0:1746147248.039382:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465530752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.039389:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.039398:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d63a400/0xb4b2209fbdacfa80 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3862528->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebede expref: 20 pid: 21080 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.039406:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d63a400/0xb4b2209fbdacfa80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3862528->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebede expref: 20 pid: 21080 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.039416:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.039432:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465530752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.039437:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7660 00000100:00100000:1.0:1746147248.039990:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15117 00000100:00100000:1.0:1746147248.040002:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15118 00000100:00100000:1.0:1746147248.040008:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465530624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.040022:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.040033:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009342a600/0xb4b2209fbdacfba6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf8d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.040076:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466966016:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147248.040122:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.040134:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465530496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.040140:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.040147:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009342a000/0xb4b2209fbdacfbad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf86 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.040168:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466966144:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147248.040198:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.040808:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.040823:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465530880 00000100:00100000:0.0:1746147248.040826:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465530880 00010000:00010000:0.0:1746147248.040839:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63a000/0xb4b2209fbdacfb13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf32 expref: 9 pid: 8480 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746147248.040858:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7661 00000100:00100000:0.0:1746147248.040864:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465530880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.040871:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.040880:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d63a000/0xb4b2209fbdacfb13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf32 expref: 9 pid: 8480 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.040888:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d63a000/0xb4b2209fbdacfb13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf32 expref: 9 pid: 8480 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.040902:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d63a000/0xb4b2209fbdacfb13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf32 expref: 9 pid: 8480 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.040919:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.040953:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465530880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.040960:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7661 00000100:00100000:0.0:1746147248.041012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.041216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.041231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.041251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.041273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.041285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.041298:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465531904 00000100:00100000:0.0:1746147248.041300:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465531904 00000100:00100000:0.0:1746147248.041313:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15120 00000100:00100000:0.0:1746147248.041316:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465531520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147248.041322:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147248.041330:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f195c00/0xb4b2209fbdacfbbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebf9b expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147248.041350:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466966400:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147248.041503:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465531648 00000100:00100000:1.0:1746147248.041506:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465531648 00000100:00100000:0.0:1746147248.041595:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.041628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147248.041825:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 31 pid: 4445 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.041844:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7662 00000100:00100000:1.0:1746147248.041849:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465531648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.041855:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.041864:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 31 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.041872:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 31 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.041885:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f195000/0xb4b2209fbdacfa79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebed7 expref: 31 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.041894:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.041895:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.041901:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.041910:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.041931:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.041960:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466966784:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147248.043137:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466966144:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147248.043155:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009342a000/0xb4b2209fbdacfbad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf86 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746147248.043163:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147246 -> 1746147247 00002000:00010000:1.0:1746147248.043169:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147246 -> 1746147247 00010000:00010000:0.0:1746147248.043169:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009342a000/0xb4b2209fbdacfbad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf86 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746147248.043182:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147246 -> 1746147247 00010000:00010000:0.0:1746147248.043185:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009342a000, rc 0) 00000100:00100000:1.0:1746147248.043202:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466966016:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147248.043207:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465530496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3210us (4429us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147248.043213:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15117 00010000:00010000:1.0:1746147248.043228:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009342a600/0xb4b2209fbdacfba6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf8d expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.043241:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009342a600/0xb4b2209fbdacfba6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf8d expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.043256:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009342a600, rc 0) 00000100:00100000:1.0:1746147248.043775:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465530624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3765us (4800us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147248.043783:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15118 00000100:00100000:1.0:1746147248.043839:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.044334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.046256:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466966400:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147248.046281:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f195c00/0xb4b2209fbdacfbbb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf9b expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.046292:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f195c00/0xb4b2209fbdacfbbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf9b expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.046302:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f195c00, rc 0) 00000100:00100000:1.0:1746147248.046342:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465531520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5023us (5108us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147248.046349:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15120 00000100:00100000:1.0:1746147248.046444:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466966784:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.046454:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.046473:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465531648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4623us (5220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.046485:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7662 00000100:00100000:0.0:1746147248.046495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.052621:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466966912:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147248.052647:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.054443:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465532160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9617us (10098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.054455:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7663 00000100:00100000:1.0:1746147248.054543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.058984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.059078:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465533184 00000100:00100000:0.0:1746147248.059082:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465533184 00000100:00100000:0.0:1746147248.059113:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11326 00000100:00100000:0.0:1746147248.059120:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31613:x1830967465533184:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147248.059135:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147248.059153:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacfbe5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebfc5 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.060666:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060680:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060691:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060701:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060707:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060712:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060716:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f195200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147248.060719:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060724:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060733:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147248.060735:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147248.060738:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060742:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfbec lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147248.060772:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacfbe5 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfc5 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.060778:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacfbe5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfc5 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.060789:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194a00, rc 0) 00000100:00100000:0.0:1746147248.060815:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31613:x1830967465533184:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1695us (1829us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147248.060820:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11326 00000100:00100000:0.0:1746147248.062674:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465533440 00000100:00100000:0.0:1746147248.062681:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465533440 00000100:00100000:0.0:1746147248.062733:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4702 00000100:00100000:0.0:1746147248.062740:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31613:x1830967465533440:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147248.062923:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31613:x1830967465533440:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 184us (343us total) trans 8589945298 rc 0/0 00000100:00100000:0.0:1746147248.062929:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4702 00000100:00100000:0.0:1746147248.068150:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465533952 00000100:00100000:0.0:1746147248.068163:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465533952 00000100:00100000:0.0:1746147248.068222:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4703 00000100:00100000:0.0:1746147248.068230:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31610:x1830967465533952:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147248.068454:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+309:31610:x1830967465533952:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 224us (2127us total) trans 8589945299 rc 0/0 00000100:00100000:0.0:1746147248.068461:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4703 00000100:00100000:0.0:1746147248.068486:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465533696 00000100:00100000:0.0:1746147248.068490:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465533696 00002000:00100000:0.0:1746147248.068514:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4718591) req@ffff88009fe1f480 x1830967465533696/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.068524:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe1f480 with x1830967465533696 ext(4194304->4718591) 00010000:00010000:0.0:1746147248.068532:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 26 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.068547:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 26 pid: 4445 timeout: 735 lvb_type: 0 00002000:00010000:0.0:1746147248.068555:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe1f480 00000100:00100000:0.0:1746147248.068577:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2469 00000100:00100000:0.0:1746147248.068582:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465533696:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147248.068880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.069010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.069111:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465534464 00000100:00100000:0.0:1746147248.069115:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465534464 00002000:00100000:0.0:1746147248.069135:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1884160->2097151) req@ffff88009b50e300 x1830967465534464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.069142:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50e300 with x1830967465534464 ext(1884160->2097151) 00002000:00010000:0.0:1746147248.069146:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50e300 00000100:00100000:0.0:1746147248.069168:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7133 00000100:00100000:0.0:1746147248.069183:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465534464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147248.082785:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465534464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13601us (13765us total) trans 0 rc 212992/212992 00000100:00100000:1.0:1746147248.082798:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7133 00002000:00100000:1.0:1746147248.082810:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x420:0x0] (1884160->2097151) req@ffff88009b50e300 x1830967465534464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 212992/212992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.082819:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50e300 with x1830967465534464 ext(1884160->2097151) 00002000:00010000:1.0:1746147248.082825:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50e300 00000100:00100000:0.0:1746147248.097036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.097134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.097451:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465534592 00000100:00100000:0.0:1746147248.097459:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465534592 00010000:00010000:0.0:1746147248.097496:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 28 pid: 4445 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.097534:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7664 00000100:00100000:0.0:1746147248.097541:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465534592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.097555:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.097583:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 28 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.097596:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 28 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.097620:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5291000/0xb4b2209fbdacfb7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf78 expref: 28 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.097638:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147248.097640:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147248.097647:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.097655:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.097687:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147248.097699:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466967168:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147248.097783:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.102760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.102812:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465534848 00000100:00100000:1.0:1746147248.102822:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465534848 00000100:00100000:1.0:1746147248.102883:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15127 00000100:00100000:1.0:1746147248.102892:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31619:x1830967465534848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.102923:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.102956:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdacfbfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebfd3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.102989:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.102997:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147248.102998:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147248.103002:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdacfbfa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfd3 expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.103035:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.103050:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 17 pid: 4445 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.103062:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466967424:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147248.103164:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.106806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.106964:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466967424:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.106981:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdacfbfa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfd3 expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.107120:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a800, rc 0) 00000100:00100000:1.0:1746147248.107199:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31619:x1830967465534848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4297us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.107208:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15127 00000100:00100000:1.0:1746147248.107272:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466967168:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.107286:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.107304:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465534592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9765us (10171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.107311:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7664 00000100:00100000:0.0:1746147248.107644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.108249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.115049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.115167:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465535744 00000100:00100000:1.0:1746147248.115184:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465535744 00010000:00010000:1.0:1746147248.115220:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 20 pid: 4445 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.115303:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7665 00000100:00100000:1.0:1746147248.115312:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465535744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.115325:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.115348:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 20 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.115747:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 20 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.115773:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d63bc00/0xb4b2209fbdacfb60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf63 expref: 20 pid: 4445 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.115801:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.115803:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.115811:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdacfbfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfd3 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.115819:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdacfbfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfd3 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.115856:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdacfbfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfd3 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.115869:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466967552:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.115982:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.121619:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466967552:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.121642:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.121705:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465535744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6392us (6662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.121716:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7665 00000100:00100000:0.0:1746147248.122080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.130347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.130428:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465536128 00000100:00100000:1.0:1746147248.130436:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465536128 00010000:00010000:1.0:1746147248.130462:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 27 pid: 8481 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.130499:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7666 00000100:00100000:1.0:1746147248.130506:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465536128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.130516:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.130534:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 27 pid: 8481 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.130543:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 27 pid: 8481 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.130559:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdacf9df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe75 expref: 27 pid: 8481 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.130582:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.130584:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.130590:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.130598:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.130628:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.130638:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466967680:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.131767:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.135768:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466967680:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.135780:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.135807:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465536128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5303us (5468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.135813:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7666 00000100:00100000:0.0:1746147248.137648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.138829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.138905:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465536512 00000100:00100000:1.0:1746147248.138913:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465536512 00000100:00100000:1.0:1746147248.138961:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15128 00000100:00100000:1.0:1746147248.138967:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31619:x1830967465536512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.138977:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.138991:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebfda expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.139011:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.139017:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147248.139019:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147248.139022:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfda expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.139048:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.139059:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 18 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.139069:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466967808:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147248.139140:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.141580:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466967808:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.141602:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfda expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.141615:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95b600, rc 0) 00000100:00100000:1.0:1746147248.141643:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31619:x1830967465536512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2676us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.141650:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15128 00000100:00100000:1.0:1746147248.143920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.154500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.154557:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465536768 00000100:00100000:1.0:1746147248.154564:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465536768 00010000:00010000:1.0:1746147248.154591:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 21 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.154623:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7667 00000100:00100000:1.0:1746147248.154631:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465536768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.154645:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.154663:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 21 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.154672:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 21 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.154692:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdacfbd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfb7 expref: 21 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.154717:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.154718:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.154724:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfda expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.154730:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfda expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.154753:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfda expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.154765:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466967936:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.154831:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.159018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.159071:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465536896 00000100:00100000:1.0:1746147248.159078:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465536896 00000100:00100000:1.0:1746147248.159129:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15129 00000100:00100000:1.0:1746147248.159136:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31616:x1830967465536896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.159150:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.159166:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebfe1 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.159216:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.159218:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.159224:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe1 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.159236:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe1 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.159244:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1000, rc 0) 00000100:00100000:1.0:1746147248.159287:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31616:x1830967465536896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 152us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.159293:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15129 00000100:00100000:1.0:1746147248.159327:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466967936:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.159340:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.159355:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465536768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4727us (4865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.159361:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7667 00000100:00100000:0.0:1746147248.163732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.165453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.165518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.165541:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.165555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.165569:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465537536 00000100:00100000:1.0:1746147248.165572:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465537536 00002000:00100000:1.0:1746147248.165590:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134c55c00 x1830967465537536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.165596:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55c00 with x1830967465537536 ext(2097152->3145727) 00002000:00010000:1.0:1746147248.165600:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55c00 00000100:00100000:1.0:1746147248.165618:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465537920 00000100:00100000:1.0:1746147248.165620:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465537920 00002000:00100000:1.0:1746147248.165629:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c54a80 x1830967465537920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.165635:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54a80 with x1830967465537920 ext(2097152->3145727) 00000100:00100000:0.0:1746147248.165635:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465538048 00002000:00010000:1.0:1746147248.165638:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54a80 00000100:00100000:0.0:1746147248.165638:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465538048 00000100:00100000:1.0:1746147248.165647:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7138 00000100:00100000:1.0:1746147248.165652:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465537536:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147248.165653:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c54e00 x1830967465538048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.165660:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54e00 with x1830967465538048 ext(3145728->4194303) 00002000:00010000:0.0:1746147248.165663:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54e00 00000100:00100000:0.0:1746147248.165673:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7139 00000100:00100000:0.0:1746147248.165677:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465537920:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147248.166587:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7140 00000100:00100000:1.0:1746147248.166593:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465538048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147248.173424:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465537152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9203us (9689us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.173434:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7137 00002000:00100000:1.0:1746147248.173443:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134c54000 x1830967465537152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.173452:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967465537152 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.173457:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:1.0:1746147248.178271:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465537536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12610us (12744us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.178281:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7138 00002000:00100000:1.0:1746147248.178290:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134c55c00 x1830967465537536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.178303:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55c00 with x1830967465537536 ext(2097152->3145727) 00002000:00010000:1.0:1746147248.178308:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55c00 00000100:00100000:0.0:1746147248.183141:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.186219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.187602:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465538432 00000100:00100000:1.0:1746147248.187613:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465538432 00000100:00100000:1.0:1746147248.187734:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15131 00000100:00100000:1.0:1746147248.187742:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465538432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.187758:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.187774:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdacfc16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebfef expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.187819:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968064:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147248.188134:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.194919:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968064:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147248.194961:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdacfc16 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfef expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.194974:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdacfc16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfef expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.194987:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1c00, rc 0) 00000100:00100000:1.0:1746147248.195033:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465538432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7291us (8821us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147248.195040:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15131 00000100:00100000:1.0:1746147248.197093:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465538048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30492us (31527us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.197104:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7140 00002000:00100000:1.0:1746147248.197113:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c54e00 x1830967465538048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.197121:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54e00 with x1830967465538048 ext(3145728->4194303) 00002000:00010000:1.0:1746147248.197126:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54e00 00000100:00100000:0.0:1746147248.200101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.200189:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465538688 00000100:00100000:1.0:1746147248.200196:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465538688 00002000:00100000:1.0:1746147248.200236:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c54380 x1830967465538688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.200245:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967465538688 ext(2097152->3145727) 00002000:00010000:1.0:1746147248.200249:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:1.0:1746147248.200836:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7142 00000100:00100000:1.0:1746147248.200845:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465538688:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.204672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.206034:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465538816 00000100:00100000:1.0:1746147248.206043:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465538816 00000100:00100000:1.0:1746147248.206088:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15132 00000100:00100000:1.0:1746147248.206095:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465538816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.206110:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.206123:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ebff6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.206141:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.206142:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.206148:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.206163:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.206183:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1200, rc 0) 00000100:00100000:1.0:1746147248.206232:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967465538816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 137us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.206237:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15132 00000100:00100000:1.0:1746147248.208426:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465538688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7575us (8326us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.208436:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7142 00002000:00100000:1.0:1746147248.208444:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c54380 x1830967465538688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.208717:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967465538688 ext(2097152->3145727) 00002000:00010000:1.0:1746147248.208722:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:0.0:1746147248.209583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.209645:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465539072 00000100:00100000:1.0:1746147248.209652:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465539072 00002000:00100000:1.0:1746147248.209680:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134c54700 x1830967465539072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.209687:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54700 with x1830967465539072 ext(4194304->4976639) 00002000:00010000:1.0:1746147248.209691:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54700 00000100:00100000:1.0:1746147248.209769:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7143 00000100:00100000:1.0:1746147248.209776:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465539072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.213155:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.219754:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465539072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9977us (10173us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147248.219761:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7143 00002000:00100000:1.0:1746147248.219770:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134c54700 x1830967465539072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.219777:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54700 with x1830967465539072 ext(4194304->4976639) 00002000:00010000:1.0:1746147248.219781:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54700 00000100:00100000:0.0:1746147248.219955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.220095:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465539328 00000100:00100000:1.0:1746147248.220100:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465539328 00002000:00100000:1.0:1746147248.220123:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (4009984->4194303) req@ffff880134c57480 x1830967465539328/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.220130:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57480 with x1830967465539328 ext(4009984->4194303) 00010000:00010000:1.0:1746147248.220135:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 27 pid: 11147 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.220146:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 27 pid: 11147 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.220152:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c57480 00000100:00100000:1.0:1746147248.220182:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2473 00000100:00100000:1.0:1746147248.220187:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465539328:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147248.225729:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465539328:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5530us (5781us total) trans 21474841270 rc 0/0 00000100:00100000:1.0:1746147248.225743:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2473 00002000:00100000:1.0:1746147248.225755:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (4009984->4194303) req@ffff880134c57480 x1830967465539328/t21474841270(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/448 e 0 to 0 dl 1746147259 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.225769:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57480 with x1830967465539328 ext(4009984->4194303) 00010000:00010000:1.0:1746147248.225779:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 29 pid: 11147 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.225794:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 29 pid: 11147 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.225800:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c57480 00000100:00100000:0.0:1746147248.226789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.232545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.232568:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465539584 00000100:00100000:1.0:1746147248.232574:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465539584 00010000:00010000:1.0:1746147248.232601:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 29 pid: 11147 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.232637:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7668 00000100:00100000:1.0:1746147248.232644:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465539584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.232657:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.232666:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 29 pid: 11147 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.232677:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 29 pid: 11147 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.232696:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f194600/0xb4b2209fbdacfb2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf40 expref: 29 pid: 11147 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.232717:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.232719:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.232726:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9a00/0xb4b2209fbdacfc24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebffd expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.232734:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9a00/0xb4b2209fbdacfc24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebffd expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.232782:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9a00/0xb4b2209fbdacfc24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebffd expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.232795:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466968448:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.234226:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.239150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.239293:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466968448:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.239314:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.239374:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465539584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6729us (6828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.239384:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7668 00000100:00100000:0.0:1746147248.247427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.254684:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465540736 00000100:00100000:1.0:1746147248.254689:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465540736 00002000:00100000:1.0:1746147248.255043:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009fe1f800 x1830967465540736/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.255050:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe1f800 with x1830967465540736 ext(3145728->4194303) 00002000:00010000:1.0:1746147248.255053:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe1f800 00000100:00100000:1.0:1746147248.255072:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7146 00000100:00100000:1.0:1746147248.255078:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465540736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.297015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.299586:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465540992 00000100:00100000:1.0:1746147248.299593:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465540992 00000100:00100000:1.0:1746147248.299635:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11327 00000100:00100000:1.0:1746147248.299642:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:31625:x1830967465540992:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147248.299660:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.299677:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6400/0xb4b2209fbdacfc39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec012 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.299774:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299786:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299797:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299811:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299817:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299821:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299929:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299951:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.299960:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147248.299969:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147248.300058:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300064:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300069:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300074:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941c6600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147248.300077:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300084:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300093:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147248.300096:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147248.300100:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300104:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6600/0xb4b2209fbdacfc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300129:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300134:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300142:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300146:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941c6800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147248.300148:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300152:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300158:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134f48a00) 00010000:00010000:1.0:1746147248.300160:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147248.300161:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300166:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6800/0xb4b2209fbdacfc47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.300208:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6400/0xb4b2209fbdacfc39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 313 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.300218:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 312 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.300224:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.300226:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147248.300228:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941c6a00, rc 0) 00000100:00100000:1.0:1746147248.300258:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:31625:x1830967465540992:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 617us (3254us total) trans 8589945302 rc 0/0 00000100:00100000:1.0:1746147248.300263:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11327 00000100:00100000:0.0:1746147248.342257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.342538:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465541504 00000100:00100000:1.0:1746147248.342549:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465541504 00000100:00100000:1.0:1746147248.342642:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11328 00000100:00100000:1.0:1746147248.342651:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31628:x1830967465541504:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147248.342678:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.342695:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6c00/0xb4b2209fbdacfc5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec019 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.342983:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.342995:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343005:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343016:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343020:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343025:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343134:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343142:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343147:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147248.343157:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147248.343267:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343274:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343279:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343284:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941c6e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147248.343288:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343295:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343305:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147248.343308:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147248.343312:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343317:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6e00/0xb4b2209fbdacfc63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343339:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343344:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343348:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343355:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941c7000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147248.343358:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343363:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343368:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134f48700) 00010000:00010000:1.0:1746147248.343370:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147248.343372:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343376:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7000/0xb4b2209fbdacfc6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.343412:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6c00/0xb4b2209fbdacfc5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec019 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.343424:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec019 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.343430:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.343431:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147248.343434:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941c7200, rc 0) 00000100:00100000:1.0:1746147248.343488:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31628:x1830967465541504:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 839us (1241us total) trans 8589945303 rc 0/0 00000100:00100000:1.0:1746147248.343495:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11328 00000100:00100000:0.0:1746147248.385706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.385814:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465541760 00000100:00100000:1.0:1746147248.385826:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465541760 00000100:00100000:1.0:1746147248.385890:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11329 00000100:00100000:1.0:1746147248.385900:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:31631:x1830967465541760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147248.385930:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.386240:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7400/0xb4b2209fbdacfc7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec020 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.386355:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.386369:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.386379:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147248.386389:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147248.386515:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7400/0xb4b2209fbdacfc7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec020 expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.387147:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec020 expref: 314 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.387155:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.387158:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147248.387163:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941c7600, rc 0) 00000100:00100000:1.0:1746147248.388127:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:31631:x1830967465541760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2225us (2427us total) trans 8589945304 rc 0/0 00000100:00100000:1.0:1746147248.388136:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11329 00000100:00100000:0.0:1746147248.392110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.393790:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465541888 00000100:00100000:1.0:1746147248.393801:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465541888 00000100:00100000:1.0:1746147248.393896:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15136 00000100:00100000:1.0:1746147248.393905:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31628:x1830967465541888:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147248.393926:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.393961:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec027 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.393992:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.394001:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 28 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.394008:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.394010:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.394013:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1585152->2097151] (req 1585152->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.394045:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 28 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147248.394056:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 28 pid: 8478 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746147248.394068:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968576:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.394200:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.394213:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 17 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.394221:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968704:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147248.394239:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.396461:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968576:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147248.396475:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968704:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.396504:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1585152->2097151] (req 1585152->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.396521:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941c7800, rc 0) 00000100:00100000:1.0:1746147248.396593:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31628:x1830967465541888:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2687us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.396603:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15136 00000100:00100000:1.0:1746147248.397746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.397785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.397839:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465542016 00000100:00100000:0.0:1746147248.397845:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465542016 00010000:00010000:0.0:1746147248.397876:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 29 pid: 8478 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746147248.397898:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465542144 00000100:00100000:0.0:1746147248.397900:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465542144 00010000:00010000:0.0:1746147248.397909:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdacfbf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfcc expref: 17 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.397922:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7669 00000100:00100000:0.0:1746147248.397928:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465542016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.397955:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.397975:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 29 pid: 8478 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.397985:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 29 pid: 8478 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.398103:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdacfc1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebff6 expref: 29 pid: 8478 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.398404:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.398435:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465542016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 506us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.398442:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7669 00000100:00100000:0.0:1746147248.398609:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465542272 00000100:00100000:0.0:1746147248.398612:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465542272 00000100:00100000:0.0:1746147248.398644:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15137 00000100:00100000:0.0:1746147248.398802:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31631:x1830967465542272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147248.398817:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147248.398828:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec02e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.398993:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.398999:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147248.399001:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147248.399004:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.399022:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.399032:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 16 pid: 8478 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.399041:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466968960:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147248.399101:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.402189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.409530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.409672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.422094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.422119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.422160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.422210:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465543040 00000100:00100000:0.0:1746147248.422220:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465543040 00010000:00010000:0.0:1746147248.422257:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacf896 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebddb expref: 10 pid: 17530 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746147248.422284:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465543168 00000100:00100000:0.0:1746147248.422287:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465543168 00010000:00010000:0.0:1746147248.422298:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1800/0xb4b2209fbdacf9d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe67 expref: 19 pid: 8481 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.422312:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465543296 00000100:00100000:0.0:1746147248.422314:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465543296 00010000:00010000:0.0:1746147248.422325:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe6e expref: 29 pid: 8478 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.422341:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7671 00000100:00100000:0.0:1746147248.422348:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465543040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.422368:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.422391:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacf896 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebddb expref: 10 pid: 17530 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.422402:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacf896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebddb expref: 10 pid: 17530 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.422435:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacf896 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebddb expref: 10 pid: 17530 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746147248.422457:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.422501:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465543040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 153us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.422508:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7671 00000100:00100000:0.0:1746147248.422523:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7672 00000100:00100000:0.0:1746147248.422528:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465543168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.422535:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.422543:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1800/0xb4b2209fbdacf9d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe67 expref: 19 pid: 8481 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.422551:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1800/0xb4b2209fbdacf9d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe67 expref: 19 pid: 8481 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.422563:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1800/0xb4b2209fbdacf9d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe67 expref: 19 pid: 8481 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.422571:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.422586:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465543168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.422591:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7672 00000100:00100000:0.0:1746147248.422601:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7673 00000100:00100000:0.0:1746147248.422606:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465543296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147248.422612:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147248.422620:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe6e expref: 29 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.422627:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe6e expref: 29 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.422639:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdacf9d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe6e expref: 29 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.422649:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147248.422652:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147248.422659:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.422668:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.422700:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147248.422714:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466969472:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147248.422772:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.431028:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466969472:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147248.431051:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.431112:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465543296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8502us (8949us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.431123:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7673 00000100:00100000:0.0:1746147248.431767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.431823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.432219:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465543680 00000100:00100000:1.0:1746147248.432226:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465543680 00010000:00010000:1.0:1746147248.432256:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 18 pid: 8478 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.432283:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7674 00000100:00100000:1.0:1746147248.432290:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465543680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.432306:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147248.432325:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147247 -> 1746147248 00002000:00010000:1.0:1746147248.432328:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147247 -> 1746147248 00010000:00010000:1.0:1746147248.432334:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 18 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.432346:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 18 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.432369:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941c7800/0xb4b2209fbdacfc94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec027 expref: 18 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.432386:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.432388:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.432395:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.432404:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.432436:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.432448:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466969600:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.432515:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.441880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.444057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.444215:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466969600:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.444230:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.444253:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465543680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 11964us (12430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.444261:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7674 00000100:00100000:0.0:1746147248.450623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.464869:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.464904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.465367:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7151 00000100:00100000:1.0:1746147248.465374:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465544832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.466287:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465544064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21816us (22229us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147248.466295:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7149 00002000:00100000:0.0:1746147248.466301:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b6bbb80 x1830967465544064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.466308:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967465544064 ext(1048576->2097151) 00002000:00010000:0.0:1746147248.466312:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00000100:00100000:0.0:1746147248.486086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.490602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.495052:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465544832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 29671us (30138us total) trans 0 rc 1028096/1028096 00000100:00100000:1.0:1746147248.495063:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7151 00002000:00100000:1.0:1746147248.495071:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1069056->2097151) req@ffff8800a4672680 x1830967465544832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.495079:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672680 with x1830967465544832 ext(1069056->2097151) 00010000:00010000:1.0:1746147248.495088:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.495101:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.495108:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4672680 00000100:00100000:0.0:1746147248.496550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.496675:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465545216 00000100:00100000:1.0:1746147248.496682:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465545216 00002000:00100000:1.0:1746147248.496718:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1069055) req@ffff8800a4671500 x1830967465545216/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.496727:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967465545216 ext(1048576->1069055) 00010000:00010000:1.0:1746147248.496733:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.496744:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.496750:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4671500 00000100:00100000:1.0:1746147248.496785:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2476 00000100:00100000:1.0:1746147248.496792:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465545216:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147248.499199:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465545216:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2399us (2641us total) trans 21474841272 rc 0/0 00000100:00100000:1.0:1746147248.499210:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2476 00002000:00100000:1.0:1746147248.499218:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1069055) req@ffff8800a4671500 x1830967465545216/t21474841272(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/448 e 0 to 0 dl 1746147259 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.499226:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967465545216 ext(1048576->1069055) 00010000:00010000:1.0:1746147248.499234:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.499247:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.499253:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4671500 00000100:00100000:0.0:1746147248.501724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.501779:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465545344 00000100:00100000:1.0:1746147248.501788:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465545344 00010000:00010000:1.0:1746147248.501823:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.501874:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7675 00000100:00100000:1.0:1746147248.501882:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465545344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.501896:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147248.501914:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147246 -> 1746147248 00002000:00010000:1.0:1746147248.501917:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147246 -> 1746147248 00010000:00010000:1.0:1746147248.501922:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.501934:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.501980:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdacfca2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec035 expref: 20 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.502009:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.502011:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.502018:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.502027:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.502062:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.502078:0:7119:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 29 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.502090:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466969984:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.502194:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.504741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.504757:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466969984:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.504780:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.504827:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465545344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2946us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.504837:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7675 00000100:00100000:1.0:1746147248.505158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.505222:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465545728 00000100:00100000:0.0:1746147248.505225:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465545728 00002000:00100000:0.0:1746147248.505254:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1519616->1523711) req@ffff88012df78000 x1830967465545728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.505263:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78000 with x1830967465545728 ext(1519616->1523711) 00010000:00010000:0.0:1746147248.505270:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 30 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.505281:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 30 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:0.0:1746147248.505287:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012df78000 00000100:00100000:0.0:1746147248.505301:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2477 00000100:00100000:0.0:1746147248.505306:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465545728:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147248.505444:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465545728:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 136us (284us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147248.505449:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2477 00002000:00100000:0.0:1746147248.505454:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1519616->1523711) req@ffff88012df78000 x1830967465545728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/4536 e 0 to 0 dl 1746147259 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.505461:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78000 with x1830967465545728 ext(1519616->1523711) 00010000:00010000:0.0:1746147248.505465:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 30 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.505473:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 30 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:0.0:1746147248.505479:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012df78000 00000100:00100000:0.0:1746147248.510723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.510831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.511551:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465545984 00000100:00100000:1.0:1746147248.511556:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465545984 00002000:00100000:1.0:1746147248.511585:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1519616->2097151) req@ffff8800a4673480 x1830967465545984/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.511603:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673480 with x1830967465545984 ext(1519616->2097151) 00010000:00010000:1.0:1746147248.511613:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 30 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.511622:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 30 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.511628:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673480 00000100:00100000:1.0:1746147248.511654:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2478 00000100:00100000:1.0:1746147248.511660:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465545984:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147248.515521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.515845:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465546240 00000100:00100000:1.0:1746147248.515852:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465546240 00010000:00010000:1.0:1746147248.515877:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe1 expref: 22 pid: 8478 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.515902:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7676 00000100:00100000:1.0:1746147248.515908:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465546240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.515918:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.515955:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe1 expref: 22 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.515965:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe1 expref: 22 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.515983:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1000/0xb4b2209fbdacfc08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe1 expref: 22 pid: 8478 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.515995:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.516012:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465546240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.516017:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7676 00000100:00100000:1.0:1746147248.519793:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465545984:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8131us (8960us total) trans 21474841273 rc 0/0 00000100:00100000:1.0:1746147248.519801:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2478 00002000:00100000:1.0:1746147248.519809:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1519616->2097151) req@ffff8800a4673480 x1830967465545984/t21474841273(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/448 e 0 to 0 dl 1746147259 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.519818:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673480 with x1830967465545984 ext(1519616->2097151) 00010000:00010000:1.0:1746147248.519826:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 32 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.519838:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f064400/0xb4b2209fbdacfcb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec043 expref: 32 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.519845:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673480 00000100:00100000:0.0:1746147248.520554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.520597:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465546624 00000100:00100000:1.0:1746147248.520602:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465546624 00002000:00100000:1.0:1746147248.520640:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1372160->1376255) req@ffff8800a4671880 x1830967465546624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.520648:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967465546624 ext(1372160->1376255) 00002000:00010000:1.0:1746147248.520654:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:1.0:1746147248.520724:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7152 00000100:00100000:1.0:1746147248.520731:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465546624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147248.521013:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465546624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 282us (460us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147248.521019:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7152 00002000:00100000:1.0:1746147248.521024:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1372160->1376255) req@ffff8800a4671880 x1830967465546624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/4536 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.521031:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967465546624 ext(1372160->1376255) 00002000:00010000:1.0:1746147248.521034:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:0.0:1746147248.524043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.524679:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.530875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.531049:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465547264 00000100:00100000:1.0:1746147248.531060:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465547264 00002000:00100000:1.0:1746147248.531100:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012b0c0380 x1830967465547264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.531109:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0380 with x1830967465547264 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.531113:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0380 00000100:00100000:1.0:1746147248.531146:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7153 00000100:00100000:1.0:1746147248.531153:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465547264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.538542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.538595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.538648:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465547648 00000100:00100000:1.0:1746147248.538653:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465547648 00002000:00100000:1.0:1746147248.538671:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012b0c1880 x1830967465547648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.538678:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1880 with x1830967465547648 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.538682:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c1880 00000100:00100000:1.0:1746147248.538727:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7155 00000100:00100000:1.0:1746147248.538734:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465547648:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147248.544750:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465547264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13590us (13879us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.544760:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7153 00002000:00100000:1.0:1746147248.544770:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012b0c0380 x1830967465547264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.544778:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0380 with x1830967465547264 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.544783:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0380 00000100:00100000:0.0:1746147248.555082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.555551:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465547648:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16816us (16954us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.555559:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7155 00002000:00100000:1.0:1746147248.555566:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012b0c1880 x1830967465547648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.555573:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1880 with x1830967465547648 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.555577:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c1880 00000100:00100000:0.0:1746147248.561025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.561104:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465548032 00000100:00100000:1.0:1746147248.561109:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465548032 00002000:00100000:1.0:1746147248.561137:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1376255) req@ffff88012b0c3480 x1830967465548032/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.561147:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3480 with x1830967465548032 ext(1048576->1376255) 00010000:00010000:1.0:1746147248.561153:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f065a00/0xb4b2209fbdacfcc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec058 expref: 29 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.561165:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f065a00/0xb4b2209fbdacfcc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec058 expref: 29 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.561181:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b0c3480 00000100:00100000:1.0:1746147248.561207:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2479 00000100:00100000:1.0:1746147248.561213:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465548032:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147248.574512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.574576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.574601:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465548544 00000100:00100000:0.0:1746147248.574604:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465548544 00002000:00100000:0.0:1746147248.574620:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012b0c1180 x1830967465548544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.574628:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1180 with x1830967465548544 ext(3145728->4194303) 00002000:00010000:0.0:1746147248.574630:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c1180 00000100:00100000:0.0:1746147248.574838:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7157 00000100:00100000:0.0:1746147248.574844:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465548544:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.586346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.591291:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466970880:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147248.591308:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147248.591359:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465548672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4237us (5016us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147248.591367:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7679 00000100:00100000:0.0:1746147248.594707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.600685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.687659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.687929:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465549312 00000100:00100000:1.0:1746147248.687958:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465549312 00000100:00100000:1.0:1746147248.688003:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11330 00000100:00100000:1.0:1746147248.688009:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31640:x1830967465549312:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147248.688027:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147248.688040:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62400/0xb4b2209fbdacfcda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec06d expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688111:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.688123:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688129:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 314 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688134:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec019 expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688139:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.688160:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec019 expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688177:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec019 expref: 20 pid: 14049 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.688186:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466971008:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.688275:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 314 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688287:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 314 pid: 14049 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.688294:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466971136:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.688316:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.688323:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 8 pid: 16361 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.688329:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466971264:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147248.688343:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.690752:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466971008:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147248.690752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.690764:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466971136:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147248.690770:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466971264:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147248.690792:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147248.692575:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465549568 00000100:00100000:1.0:1746147248.692582:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465549568 00010000:00010000:1.0:1746147248.692614:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 315 pid: 14049 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.692637:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465549440 00000100:00100000:1.0:1746147248.692639:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465549440 00010000:00010000:1.0:1746147248.692648:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7200/0xb4b2209fbdacfc71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec019 expref: 21 pid: 14049 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.692672:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465549696 00000100:00100000:1.0:1746147248.692674:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465549696 00010000:00010000:1.0:1746147248.692683:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 9 pid: 16361 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.692694:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7680 00000100:00100000:1.0:1746147248.692700:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1957:x1830967465549568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.692711:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.692716:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 315 pid: 14049 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.692725:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 315 pid: 14049 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.692742:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c6a00/0xb4b2209fbdacfc4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec012 expref: 315 pid: 14049 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.692757:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.692762:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.692769:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.692773:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.692808:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967465549568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.692817:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7680 00000100:00100000:1.0:1746147248.692832:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7682 00000100:00100000:1.0:1746147248.692837:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465549696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.692843:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.692846:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 9 pid: 16361 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.692854:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 9 pid: 16361 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.692864:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1200/0xb4b2209fbdacfb75 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf71 expref: 9 pid: 16361 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.692872:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147248.692875:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.692881:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.692886:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147248.694162:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.694212:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465549696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1372us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.694220:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7682 00000100:00100000:0.0:1746147248.702035:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.709391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.709963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.719149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.752880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.761196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.761837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.770576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.832227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.853160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.855067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.859091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.860584:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465552000 00000100:00100000:0.0:1746147248.860588:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465552000 00002000:00100000:0.0:1746147248.860614:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1171456->1376255) req@ffff8801312a6680 x1830967465552000/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.860621:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6680 with x1830967465552000 ext(1171456->1376255) 00010000:00010000:0.0:1746147248.860628:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacfcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec074 expref: 20 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746147248.860639:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacfcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec074 expref: 20 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:0.0:1746147248.860645:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a6680 00000100:00100000:0.0:1746147248.860672:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2480 00000100:00100000:0.0:1746147248.860677:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465552000:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147248.867025:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465552000:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6341us (6936us total) trans 21474841274 rc 0/0 00000100:00100000:1.0:1746147248.867034:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2480 00002000:00100000:1.0:1746147248.867042:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1171456->1376255) req@ffff8801312a6680 x1830967465552000/t21474841274(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/448 e 0 to 0 dl 1746147259 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.867050:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6680 with x1830967465552000 ext(1171456->1376255) 00010000:00010000:1.0:1746147248.867058:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacfcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec074 expref: 22 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.867068:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdacfcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec074 expref: 22 pid: 8480 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746147248.867074:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a6680 00000100:00100000:0.0:1746147248.868301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.870533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.872192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.875427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.881396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.881435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.881468:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465553152 00000100:00100000:1.0:1746147248.881477:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465553152 00002000:00100000:1.0:1746147248.881516:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3870720->3874815) req@ffff88012c85ed80 x1830967465553152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.881524:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ed80 with x1830967465553152 ext(3870720->3874815) 00002000:00010000:1.0:1746147248.881528:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85ed80 00000100:00100000:1.0:1746147248.881543:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465553408 00000100:00100000:1.0:1746147248.881545:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465553408 00002000:00100000:1.0:1746147248.881553:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012c85c000 x1830967465553408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.881559:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c000 with x1830967465553408 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.881561:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85c000 00000100:00100000:1.0:1746147248.881577:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7161 00000100:00100000:1.0:1746147248.881582:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465553152:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147248.883496:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465553152:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1907us (2101us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147248.883505:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7161 00002000:00100000:1.0:1746147248.883515:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3870720->3874815) req@ffff88012c85ed80 x1830967465553152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:624/0 lens 488/4536 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.883524:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ed80 with x1830967465553152 ext(3870720->3874815) 00002000:00010000:1.0:1746147248.883529:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85ed80 00000100:00100000:0.0:1746147248.883728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.883909:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465553664 00000100:00100000:1.0:1746147248.883920:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465553664 00002000:00100000:1.0:1746147248.883963:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012c85d500 x1830967465553664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.883970:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85d500 with x1830967465553664 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.883972:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85d500 00000100:00100000:1.0:1746147248.883991:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7163 00000100:00100000:1.0:1746147248.883997:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465553664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147248.894286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.907832:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465553664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23827us (24095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.907843:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7163 00002000:00100000:1.0:1746147248.907852:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012c85d500 x1830967465553664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.907860:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85d500 with x1830967465553664 ext(1048576->2097151) 00002000:00010000:1.0:1746147248.907866:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85d500 00000100:00100000:1.0:1746147248.915157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.915218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.915641:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465554048 00000100:00100000:0.0:1746147248.915648:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465554048 00000100:00100000:0.0:1746147248.915698:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15150 00000100:00100000:0.0:1746147248.915705:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:31645:x1830967465554048:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147248.915720:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147248.915735:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdacfd66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec0a5 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.915757:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdacfd58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec097 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.915763:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147248.915764:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147248.915767:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdacfd66 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1466368->2097151] (req 1466368->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0a5 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.915789:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdacfd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec097 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147248.915799:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdacfd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec097 expref: 32 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746147248.915809:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466972544:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147248.915871:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147248.922997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.926417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.933593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.941295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.941349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.962762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.962825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.962855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.962879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147248.962914:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465555456 00000100:00100000:0.0:1746147248.962921:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465555456 00002000:00100000:0.0:1746147248.962969:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012c85e680 x1830967465555456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.962978:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e680 with x1830967465555456 ext(3145728->4194303) 00002000:00010000:0.0:1746147248.962982:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85e680 00000100:00100000:0.0:1746147248.962998:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465555328 00000100:00100000:0.0:1746147248.963001:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465555328 00002000:00100000:0.0:1746147248.963011:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c85ea00 x1830967465555328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/0 e 0 to 0 dl 1746147259 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147248.963017:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ea00 with x1830967465555328 ext(2097152->3145727) 00002000:00010000:0.0:1746147248.963020:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85ea00 00000100:00100000:0.0:1746147248.963030:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7166 00000100:00100000:0.0:1746147248.963036:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465555456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147248.965907:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465555200 00000100:00100000:1.0:1746147248.965916:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465555200 00010000:00010000:1.0:1746147248.965958:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdacfcd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec066 expref: 32 pid: 8480 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746147248.965992:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465555712 00000100:00100000:1.0:1746147248.965995:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465555712 00010000:00010000:1.0:1746147248.966004:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdacfccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec05f expref: 22 pid: 8480 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147248.966019:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7690 00000100:00100000:1.0:1746147248.966025:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465555200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.966035:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.966053:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdacfcd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec066 expref: 32 pid: 8480 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746147248.966062:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdacfcd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec066 expref: 32 pid: 8480 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746147248.966077:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdacfcd3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec066 expref: 32 pid: 8480 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746147248.966098:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.966129:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465555200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.966138:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7690 00000100:00100000:1.0:1746147248.966152:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7691 00000100:00100000:1.0:1746147248.966156:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465555712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147248.966162:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147248.966180:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdacfccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec05f expref: 22 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.966188:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdacfccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec05f expref: 22 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.966198:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdacfccc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec05f expref: 22 pid: 8480 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147248.966206:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.966207:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147248.966212:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.966218:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147248.966241:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147248.966251:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466973312:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147248.966300:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147248.974645:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466973312:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147248.974662:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147248.974709:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465555712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8551us (11828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147248.974718:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7691 00000100:00100000:0.0:1746147248.977477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147248.978266:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465555456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15228us (15439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147248.978273:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7166 00002000:00100000:1.0:1746147248.978278:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012c85e680 x1830967465555456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:624/0 lens 488/440 e 0 to 0 dl 1746147259 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147248.978285:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e680 with x1830967465555456 ext(3145728->4194303) 00002000:00010000:1.0:1746147248.978288:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85e680 00000100:00100000:0.0:1746147249.007037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.010501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.010547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.010580:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465556352 00000100:00100000:0.0:1746147249.010586:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465556352 00000100:00100000:0.0:1746147249.010769:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465556608 00000100:00100000:0.0:1746147249.010771:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465556608 00000100:00100000:1.0:1746147249.011331:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4710 00000100:00100000:1.0:1746147249.011341:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:27372:x1830967465556352:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147249.011523:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:27372:x1830967465556352:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 185us (1026us total) trans 8589945313 rc 0/0 00000100:00100000:1.0:1746147249.011529:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4710 00000100:00100000:0.0:1746147249.013002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.013080:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465556736 00000100:00100000:1.0:1746147249.013085:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465556736 00010000:00010000:1.0:1746147249.013103:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec06d expref: 26 pid: 14049 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147249.013299:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7692 00000100:00100000:1.0:1746147249.013306:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465556736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147249.013311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147249.013318:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.013324:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec06d expref: 26 pid: 14049 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147249.013333:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec06d expref: 26 pid: 14049 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147249.013349:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f62600/0xb4b2209fbdacfce1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec06d expref: 26 pid: 14049 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147249.013361:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.013366:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.013373:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.013378:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.013382:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.013415:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465556736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.013420:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7692 00000100:00100000:1.0:1746147249.013431:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465556864 00000100:00100000:1.0:1746147249.013433:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465556864 00010000:00010000:1.0:1746147249.013441:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8600/0xb4b2209fbdacfd20 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec082 expref: 317 pid: 16361 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746147249.013454:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7693 00000100:00100000:1.0:1746147249.013458:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1956:x1830967465556864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.013465:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.013469:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8600/0xb4b2209fbdacfd20 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec082 expref: 317 pid: 16361 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147249.013476:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8600/0xb4b2209fbdacfd20 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec082 expref: 317 pid: 16361 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147249.013486:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8600/0xb4b2209fbdacfd20 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec082 expref: 317 pid: 16361 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746147249.013494:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.013497:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.013503:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.013508:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.013967:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.013989:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1956:x1830967465556864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 530us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.013995:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7693 00000100:00100000:0.0:1746147249.017140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.017182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.017207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.017500:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465556992 00000100:00100000:0.0:1746147249.017507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.017508:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465556992 00000100:00100000:0.0:1746147249.017559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.017584:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465557376 00000100:00100000:0.0:1746147249.017586:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465557376 00000100:00100000:0.0:1746147249.017601:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15153 00000100:00100000:0.0:1746147249.017705:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465556992:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147249.017719:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.017732:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec0c1 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.018064:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.018066:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.018070:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c1 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147249.018079:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c1 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147249.018090:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942ea800, rc 0) 00000100:00100000:0.0:1746147249.018103:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465556992:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 498us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.018108:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15153 00000100:00100000:0.0:1746147249.022981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.025343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.025382:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465558016 00000100:00100000:1.0:1746147249.025387:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465558016 00010000:00010000:1.0:1746147249.025408:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ba expref: 11 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.025448:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7694 00000100:00100000:1.0:1746147249.025453:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465558016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.025463:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.025468:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ba expref: 11 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.025481:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ba expref: 11 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.025495:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfd90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ba expref: 11 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.025518:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.025522:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.025532:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.025537:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.025549:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.025580:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465558016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.025586:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7694 00000100:00100000:0.0:1746147249.027303:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465558144 00000100:00100000:0.0:1746147249.027308:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465558144 00000100:00100000:0.0:1746147249.027336:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11336 00000100:00100000:0.0:1746147249.027341:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31658:x1830967465558144:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147249.027354:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.027364:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb400/0xb4b2209fbdacfdd6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec0f2 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.027720:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb600/0xb4b2209fbdacfddd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.027730:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.027735:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb600/0xb4b2209fbdacfddd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.027754:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.027762:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 11 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.027771:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466974080:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.027839:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147249.029624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.029727:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465558272 00000100:00100000:1.0:1746147249.029734:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465558272 00010000:00010000:1.0:1746147249.029755:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 12 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.030011:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7695 00000100:00100000:1.0:1746147249.030018:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465558272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.030028:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.030033:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 12 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.030043:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 12 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.030058:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacfdc8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0eb expref: 12 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.030069:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.030073:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb600/0xb4b2209fbdacfddd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.030080:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb600/0xb4b2209fbdacfddd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.030085:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb600/0xb4b2209fbdacfddd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.030107:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.030132:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465558272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.030138:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7695 00000100:00100000:0.0:1746147249.031749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.031810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.031916:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15160 00000100:00100000:1.0:1746147249.031924:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465558528:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147249.031932:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147249.031954:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f62600/0xb4b2209fbdacfdeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec100 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.032040:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466974208:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147249.032142:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.033069:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466974208:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147249.033091:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f62600/0xb4b2209fbdacfdeb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec100 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.033100:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f62600/0xb4b2209fbdacfdeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec100 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.033106:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f62600, rc 0) 00000100:00100000:1.0:1746147249.033130:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465558528:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1207us (1320us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147249.033135:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15160 00000100:00100000:0.0:1746147249.034547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.036869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.036900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.036923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.036963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.036970:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559040 00000100:00100000:1.0:1746147249.036976:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559040 00000100:00100000:0.0:1746147249.036977:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465558912 00000100:00100000:0.0:1746147249.036983:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465558912 00000100:00100000:0.0:1746147249.036999:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559296 00000100:00100000:1.0:1746147249.037012:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559168 00000100:00100000:1.0:1746147249.037014:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559168 00000100:00100000:1.0:1746147249.037035:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15162 00000100:00100000:1.0:1746147249.037040:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465559040:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147249.037060:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.037075:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.037081:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.037087:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.037091:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.037092:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.037094:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.037111:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147249.037153:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559296 00000100:00100000:0.0:1746147249.037183:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15164 00000100:00100000:0.0:1746147249.037188:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465559296:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147249.037203:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.037213:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.037218:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147249.037219:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147249.037220:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.037415:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.037527:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 21 pid: 8478 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.037531:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.037536:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466974592:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.037539:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466974976:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.037558:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed840 going to sleep for 11 seconds 00010000:00010000:1.0:1746147249.037573:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.037580:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 12 pid: 21080 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.037580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.037593:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466975104:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.037617:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.037621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147249.037624:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 30 pid: 8478 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.037631:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466975360:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.037647:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.037659:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559552 00000100:00100000:1.0:1746147249.037662:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559552 00000100:00100000:1.0:1746147249.037676:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559424 00000100:00100000:1.0:1746147249.037677:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559424 00000100:00100000:1.0:1746147249.037685:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15165 00000100:00100000:1.0:1746147249.037689:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465559552:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147249.038027:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.038038:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.038045:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.038050:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.038051:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.038053:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.038066:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.038073:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.038080:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466975872:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.038161:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.038200:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 30 pid: 8480 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.038208:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466976000:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.038229:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.042998:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466974592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.043196:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466974976:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.043209:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.049334:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466975104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.049345:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466975360:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.049349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147249.049367:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.049373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.049386:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466975872:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.049387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.049393:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466976000:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.049399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147249.049400:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.049414:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560448 00000100:00100000:0.0:1746147249.049414:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559936 00000100:00100000:1.0:1746147249.049418:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560448 00000100:00100000:0.0:1746147249.049418:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559936 00010000:00010000:1.0:1746147249.049446:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5290200/0xb4b2209fbdacfb67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf6a expref: 21 pid: 8480 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.049466:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560320 00000100:00100000:1.0:1746147249.049467:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560320 00010000:00010000:1.0:1746147249.049475:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 14 pid: 21080 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.049487:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7697 00000100:00100000:1.0:1746147249.049491:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465560320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.049498:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.049511:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 14 pid: 21080 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.049519:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 14 pid: 21080 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.049536:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eab2c00/0xb4b2209fbdacfd9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c8 expref: 14 pid: 21080 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.049547:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.049577:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465560320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.049582:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7697 00000100:00080000:1.0:1746147249.049599:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147249.049601:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147249.049622:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 22 pid: 8478 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.049801:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7698 00000100:00100000:1.0:1746147249.049806:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465559936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.049812:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.049819:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 22 pid: 8478 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.049826:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 22 pid: 8478 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.049835:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56f600/0xb4b2209fbdacfca9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec03c expref: 22 pid: 8478 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.049841:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.049855:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465559936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.049859:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7698 00000100:00100000:0.0:1746147249.049932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.049987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.049998:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560832 00000100:00100000:0.0:1746147249.050001:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560832 00010000:00010000:0.0:1746147249.050011:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 32 pid: 8478 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.050027:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465559808 00000100:00100000:0.0:1746147249.050030:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465559808 00010000:00010000:0.0:1746147249.050038:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5290e00/0xb4b2209fbdacfbde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfbe expref: 31 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.050061:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7699 00000100:00100000:0.0:1746147249.050066:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465560832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.050072:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.050079:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 32 pid: 8478 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.050086:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 32 pid: 8478 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.050096:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f195200/0xb4b2209fbdacfc9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec02e expref: 32 pid: 8478 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.050106:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.050108:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.050111:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.050118:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.050130:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.050143:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465560832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.050147:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7699 00000100:00100000:0.0:1746147249.050155:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7700 00000100:00100000:0.0:1746147249.050159:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465559808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.050174:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.050181:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5290e00/0xb4b2209fbdacfbde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfbe expref: 31 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.050189:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5290e00/0xb4b2209fbdacfbde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfbe expref: 31 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.050198:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5290e00/0xb4b2209fbdacfbde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfbe expref: 31 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.050205:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.050218:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465559808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.050223:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7700 00000100:00100000:0.0:1746147249.050253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.050261:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560064 00000100:00100000:0.0:1746147249.050263:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560064 00010000:00010000:0.0:1746147249.050282:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c1 expref: 13 pid: 11147 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.050297:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7701 00000100:00100000:0.0:1746147249.050301:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465560064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.050307:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.050312:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c1 expref: 13 pid: 11147 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.050322:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c1 expref: 13 pid: 11147 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.050331:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942ea800/0xb4b2209fbdacfd97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0c1 expref: 13 pid: 11147 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.050337:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.050339:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.050341:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eab2400/0xb4b2209fbdacfe07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.050346:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eab2400/0xb4b2209fbdacfe07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.050356:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.050366:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465560064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.050370:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7701 00000100:00100000:0.0:1746147249.050393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.050409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.050415:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560704 00000100:00100000:0.0:1746147249.050417:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560704 00010000:00010000:0.0:1746147249.050424:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.050439:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7702 00000100:00100000:0.0:1746147249.050443:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967465560704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.050448:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.050457:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.050468:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.050478:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdacfdba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0e4 expref: 13 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.050486:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.050499:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465560704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.050504:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7702 00000100:00100000:1.0:1746147249.050532:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560192 00000100:00100000:1.0:1746147249.050535:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560192 00002000:00100000:1.0:1746147249.050549:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1323007) req@ffff88009f045c00 x1830967465560192/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147249.050549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:1.0:1746147249.050555:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830967465560192 ext(1048576->1323007) 00010000:00010000:1.0:1746147249.050559:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.050566:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 30 pid: 21080 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746147249.050571:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f045c00 00000100:00100000:0.0:1746147249.050571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.050579:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465561088 00000100:00100000:1.0:1746147249.050580:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2483 00000100:00100000:0.0:1746147249.050582:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465561088 00000100:00100000:1.0:1746147249.050584:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465560192:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147249.050591:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95b600/0xb4b2209fbdacfc01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfda expref: 31 pid: 8478 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.050601:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560576 00000100:00100000:0.0:1746147249.050603:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560576 00010000:00010000:0.0:1746147249.050610:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eab3c00/0xb4b2209fbdacfdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0dd expref: 11 pid: 4444 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.050630:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7704 00000100:00100000:0.0:1746147249.050634:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465560576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.050640:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.050784:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050790:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050800:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050805:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050810:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050815:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f62c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147249.050817:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050822:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050829:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.050833:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f62c00/0xb4b2209fbdacfe0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.050857:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465559040:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 13816us (13992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.050861:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15162 00010000:00010000:0.0:1746147249.051044:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eab3c00/0xb4b2209fbdacfdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0dd expref: 11 pid: 4444 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.051052:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eab3c00/0xb4b2209fbdacfdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0dd expref: 11 pid: 4444 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.051069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147249.051070:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eab3c00/0xb4b2209fbdacfdb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0dd expref: 11 pid: 4444 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.051076:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.051088:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465560576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 454us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.051089:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465560960 00000100:00100000:1.0:1746147249.051091:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465560960 00000100:00100000:0.0:1746147249.051091:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7704 00010000:00010000:1.0:1746147249.051100:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdacfc0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe8 expref: 20 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.051112:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7705 00000100:00100000:1.0:1746147249.051116:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465560960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.051122:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.051128:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdacfc0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe8 expref: 20 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.051134:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdacfc0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe8 expref: 20 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.051143:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdacfc0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebfe8 expref: 20 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.051150:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.051151:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.051153:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eab3600/0xb4b2209fbdacfe23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.051159:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eab3600/0xb4b2209fbdacfe23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.051189:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.051202:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465560960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.051206:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7705 00000100:00100000:0.0:1746147249.051235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.051505:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465561216 00000100:00100000:1.0:1746147249.051507:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465561216 00010000:00010000:1.0:1746147249.051517:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 32 pid: 8480 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.051529:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7706 00000100:00100000:1.0:1746147249.051532:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465561216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.051539:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.051546:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 32 pid: 8480 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.051552:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 32 pid: 8480 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.051560:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdacfd6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0ac expref: 32 pid: 8480 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.051567:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.051568:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.051570:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.051575:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.051591:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.051601:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465561216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.051605:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7706 00010000:00010000:0.0:1746147249.051613:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051620:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051632:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051638:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051643:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051647:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f62a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147249.051649:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051654:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051661:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.051666:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f62a00/0xb4b2209fbdacfe2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.051694:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465559552:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14004us (14114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.051699:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15165 00000100:00100000:0.0:1746147249.063547:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465560192:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12957us (13148us total) trans 17179873908 rc 0/0 00000100:00100000:0.0:1746147249.063553:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2483 00002000:00100000:0.0:1746147249.063559:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1323007) req@ffff88009f045c00 x1830967465560192/t17179873908(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/448 e 0 to 0 dl 1746147260 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.063564:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830967465560192 ext(1048576->1323007) 00010000:00010000:0.0:1746147249.063570:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 31 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.063577:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009aa1fc00/0xb4b2209fbdacfd74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec0b3 expref: 31 pid: 21080 timeout: 736 lvb_type: 0 00002000:00010000:0.0:1746147249.063584:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f045c00 00000100:00100000:0.0:1746147249.064881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.067369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147249.067782:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.067789:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.067804:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.067810:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.067976:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.067987:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942ea200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147249.067990:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.067997:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.068007:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.068012:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942ea200/0xb4b2209fbdacfe1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.068058:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465559296:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 30868us (31133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.068065:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15164 00000100:00100000:0.0:1746147249.070251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.074203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.074333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.074355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.074404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.074426:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465561856 00000100:00100000:0.0:1746147249.074432:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465561856 00010000:00010000:0.0:1746147249.074458:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da55a00/0xb4b2209fbdacfd0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec07b expref: 25 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.074486:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7709 00000100:00100000:0.0:1746147249.074494:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465561984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.074510:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.074516:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf7f expref: 316 pid: 14048 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.074526:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf7f expref: 316 pid: 14048 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.074544:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009342ba00/0xb4b2209fbdacfb98 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebf7f expref: 316 pid: 14048 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.074566:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147249.074571:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.074580:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.074619:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465562240 00000100:00100000:1.0:1746147249.074623:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465562240 00000100:00100000:1.0:1746147249.074654:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4712 00000100:00100000:1.0:1746147249.074660:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:7642:x1830967465562240:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147249.074814:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:7642:x1830967465562240:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 154us (616us total) trans 8589945317 rc 0/0 00000100:00100000:1.0:1746147249.074821:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4712 00000100:00100000:0.0:1746147249.074888:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465561984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 395us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.074894:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7709 00000100:00100000:0.0:1746147249.074990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.075040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.075077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.075089:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465562880 00000100:00100000:0.0:1746147249.075092:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465562880 00010000:00010000:0.0:1746147249.075103:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 23 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.075153:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465562752 00000100:00100000:1.0:1746147249.075156:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465562752 00000100:00100000:1.0:1746147249.075180:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4713 00000100:00100000:1.0:1746147249.075185:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:7641:x1830967465562752:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147249.075251:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:7641:x1830967465562752:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 65us (210us total) trans 8589945318 rc 0/0 00000100:00100000:1.0:1746147249.075257:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4713 00000100:00100000:0.0:1746147249.075347:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7713 00000100:00100000:0.0:1746147249.075354:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465562880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.075360:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.075365:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 24 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.075373:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 24 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.075384:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660800/0xb4b2209fbdacf999 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ebe2f expref: 24 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.075392:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147249.075395:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.075400:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.075413:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465562880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 61us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.075418:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7713 00000100:00100000:0.0:1746147249.077493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.077576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.077735:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465563008 00000100:00100000:1.0:1746147249.077744:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465563008 00010000:00010000:1.0:1746147249.078106:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec020 expref: 315 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.078143:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7715 00000100:00100000:1.0:1746147249.078149:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1957:x1830967465563008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.078160:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.078188:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec020 expref: 315 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.078805:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec020 expref: 315 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.078823:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941c7600/0xb4b2209fbdacfc86 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec020 expref: 315 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.078836:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.078842:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.078848:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe31 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.078854:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe31 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.078883:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.079289:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967465563008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1138us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.079296:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7715 00000004:00010000:0.0:1746147249.116436:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f044380 reply state ffff88009f5a5800 transno 8589945319 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe31 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147249.116449:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746147249.116458:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945299 is committed 00000001:00080000:1.0:1746147249.116466:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945298 is committed 00000001:00080000:1.0:1746147249.116471:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945318 is committed 00000001:00080000:1.0:1746147249.116476:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945317 is committed 00000001:00080000:1.0:1746147249.116498:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945319 is committed 00000004:00080000:1.0:1746147249.116501:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2464 committed 00000004:00080000:1.0:1746147249.116507:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2454 committed 00000004:00080000:1.0:1746147249.116512:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2453 committed 00000004:00080000:1.0:1746147249.116513:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2452 committed 00000004:00080000:1.0:1746147249.116515:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2451 committed 00000004:00080000:1.0:1746147249.116517:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2463 committed 00000004:00080000:1.0:1746147249.116518:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2450 committed 00000004:00080000:1.0:1746147249.116519:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2462 committed 00000004:00080000:1.0:1746147249.116520:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2449 committed 00000004:00080000:1.0:1746147249.116521:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2461 committed 00000004:00080000:1.0:1746147249.116523:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2460 committed 00000004:00080000:1.0:1746147249.116524:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2459 committed 00000004:00080000:1.0:1746147249.116526:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2448 committed 00000004:00080000:1.0:1746147249.116528:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2447 committed 00000004:00080000:1.0:1746147249.116530:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2458 committed 00000004:00080000:1.0:1746147249.116531:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2457 committed 00010000:00080000:0.0:1746147249.116531:0:14049:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:1.0:1746147249.116532:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2446 committed 00000100:00100000:0.0:1746147249.116545:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31658:x1830967465561728:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 46049us (46299us total) trans 8589945319 rc 0/0 00000100:00100000:0.0:1746147249.116553:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11338 00000100:00100000:1.0:1746147249.116698:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116737:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.116769:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116783:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.116798:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147249.116802:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.116824:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.116850:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116861:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.116872:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116883:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.116894:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147249.116897:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.116910:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.118181:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466978176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.118208:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466978432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.118243:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466978048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.118259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.118283:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466978560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.118297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147249.118318:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df79f80/2, rc 0, transno 17179873911 00000100:00100000:0.0:1746147249.118325:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.118332:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c85f100/2, rc 0, transno 17179873912 00000100:00100000:0.0:1746147249.118334:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.118339:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df79500/2, rc 0, transno 17179873909 00000100:00100000:0.0:1746147249.118342:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.118346:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df78a80/2, rc 0, transno 17179873910 00000100:00100000:0.0:1746147249.118348:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466977536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.118407:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466979072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.118421:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.118810:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.118812:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.118826:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466978944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.118830:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.118842:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147249.118843:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df7a300/2, rc 0, transno 17179873913 00000100:00100000:1.0:1746147249.118847:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.118853:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c85c700/2, rc 0, transno 17179873914 00000100:00100000:1.0:1746147249.118856:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.118858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.118864:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466978304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.118866:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466978688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.118878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.118889:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466978816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.118897:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.118905:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466977152 00000100:00100000:1.0:1746147249.118907:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466977152 00000100:00100000:1.0:1746147249.118918:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466978432 00000100:00100000:1.0:1746147249.118919:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466978432 00000100:00100000:1.0:1746147249.118925:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466977664 00000100:00100000:1.0:1746147249.118926:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466977664 00000100:00100000:1.0:1746147249.118931:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466978944 00000100:00100000:1.0:1746147249.118932:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466978944 00000100:00100000:1.0:1746147249.118952:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466978176 00000100:00100000:1.0:1746147249.118954:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466978176 00000100:00100000:1.0:1746147249.118958:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466978304 00000100:00100000:1.0:1746147249.118960:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466978304 00000100:00100000:1.0:1746147249.118964:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466978688 00000100:00100000:1.0:1746147249.118966:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466978688 00000100:00100000:1.0:1746147249.118972:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15174 00000100:00100000:1.0:1746147249.118976:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3294:x1830967466978560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.119029:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.119078:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3294:x1830967466978560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (780us total) trans 21474841277 rc 0/0 00000100:00100000:1.0:1746147249.119083:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15174 00000100:00100000:1.0:1746147249.119092:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15175 00000100:00100000:1.0:1746147249.119095:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3294:x1830967466979072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.119158:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3294:x1830967466979072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (736us total) trans 17179873915 rc 0/0 00000100:00100000:1.0:1746147249.119162:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15175 00000100:00100000:1.0:1746147249.119184:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15177 00000100:00100000:1.0:1746147249.119188:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466978432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.119266:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967466978432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (453us total) trans 21474841278 rc 0/0 00000100:00100000:1.0:1746147249.119270:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15177 00000100:00100000:1.0:1746147249.119277:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15179 00000100:00100000:1.0:1746147249.119281:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466978944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.119354:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967466978944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (510us total) trans 21474841279 rc 0/0 00000100:00100000:1.0:1746147249.119360:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15179 00000100:00100000:1.0:1746147249.119370:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15182 00000100:00100000:1.0:1746147249.119374:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830967466978688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147249.119447:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:1.0:1746147249.119450:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147249.119452:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147249.119454:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147249.119456:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:1.0:1746147249.119476:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967466978688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (578us total) trans 21474841281 rc 0/0 00000100:00100000:1.0:1746147249.119488:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15182 00000004:00080000:0.0:1746147249.119625:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e1880/2, rc 0, transno 21474841278 00000100:00100000:0.0:1746147249.119629:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466978432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.119636:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2300/2, rc 0, transno 21474841279 00000100:00100000:0.0:1746147249.119638:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466978944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.119652:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4fae300/2, rc 0, transno 17179873915 00000100:00100000:0.0:1746147249.119654:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466979072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.119660:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e3100/2, rc 0, transno 21474841277 00000100:00100000:0.0:1746147249.119662:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466978560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.119673:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c0e00/2, rc 0, transno 21474841281 00000100:00100000:0.0:1746147249.119675:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466978688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.119684:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e3480/2, rc 0, transno 21474841280 00000100:00100000:0.0:1746147249.119686:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466978304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.119691:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2d80/2, rc 0, transno 21474841282 00000100:00100000:0.0:1746147249.119694:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466978816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.119699:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df7b100/2, rc 0, transno 17179873916 00000100:00100000:0.0:1746147249.119701:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.119706:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f66bb80/2, rc 0, transno 17179873917 00000100:00100000:0.0:1746147249.119709:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466977664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.120117:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e2300/2, rc 0, transno 21474841283 00000100:00100000:0.0:1746147249.120121:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466978048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.120286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.120441:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465563264 00000100:00100000:0.0:1746147249.120445:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465563264 00000100:00100000:0.0:1746147249.120479:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11339 00000100:00100000:0.0:1746147249.120484:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31658:x1830967465563264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147249.120497:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.120509:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec10e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.120544:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.120555:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.120568:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147249.120571:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147249.120573:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942ebe00, rc 0) 00000100:00100000:0.0:1746147249.121180:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31658:x1830967465563264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 694us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.121185:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11339 00000004:00080000:0.0:1746147249.121212:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b52e0700/2, rc 0, transno 21474841284 00000100:00100000:0.0:1746147249.121215:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466978176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.124489:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465563392 00000100:00100000:0.0:1746147249.124501:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465563392 00000100:00100000:0.0:1746147249.124558:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11340 00000100:00100000:0.0:1746147249.124566:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31658:x1830967465563392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147249.124586:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.124607:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ea600/0xb4b2209fbdacfe3f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec115 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.124693:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb200/0xb4b2209fbdacfe46 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.124705:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb200/0xb4b2209fbdacfe46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.124715:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb200/0xb4b2209fbdacfe46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147249.124740:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147249.124743:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147249.124772:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb200/0xb4b2209fbdacfe46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.124794:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ea600/0xb4b2209fbdacfe3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec115 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.124815:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb200/0xb4b2209fbdacfe46 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec115 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.124822:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:0.0:1746147249.124824:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147249.124827:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942eb200, rc 0) 00000100:00100000:0.0:1746147249.124877:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31658:x1830967465563392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 312us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.124883:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11340 00000100:00100000:0.0:1746147249.130658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.130694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.130718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.130746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.131215:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15184 00000100:00100000:1.0:1746147249.131224:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465563520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147249.131238:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147249.131253:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d43800/0xb4b2209fbdacfe54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec11c expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147249.131272:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417af, atime: 0x681417ae, ctime: 0x681417af, blocks: 0x7c9 00010000:00010000:1.0:1746147249.131286:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.131288:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.131295:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d43800/0xb4b2209fbdacfe54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec11c expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.131307:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d43800/0xb4b2209fbdacfe54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec11c expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.131316:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d43800, rc 0) 00000100:00100000:1.0:1746147249.131619:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465563520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 397us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.131625:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15184 00000100:00100000:0.0:1746147249.132680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.132730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.141712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.141794:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465564416 00000100:00100000:1.0:1746147249.141806:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465564416 00000100:00100000:1.0:1746147249.141880:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7169 00000100:00100000:1.0:1746147249.141889:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465564416:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147249.141917:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.141928:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.141930:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.141934:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.141981:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.143247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.143280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.151377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.151416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.151449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.151472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.152812:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465565440 00000100:00100000:1.0:1746147249.152820:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465565440 00000100:00100000:1.0:1746147249.152979:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465565568 00000100:00100000:1.0:1746147249.152982:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465565568 00000100:00100000:1.0:1746147249.153002:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465565952 00000100:00100000:1.0:1746147249.153003:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465565952 00000100:00100000:1.0:1746147249.153018:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7172 00000100:00100000:1.0:1746147249.153025:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465565312:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147249.153062:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.153075:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.153077:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.153082:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.153094:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.153485:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7173 00000100:00100000:0.0:1746147249.153493:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465565440:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147249.153514:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.153521:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.153523:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.153526:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.153534:0:1351:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.156693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147249.164672:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.164691:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.164699:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.164710:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d43c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147249.164714:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.164721:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.164740:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.164746:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d43c00/0xb4b2209fbdacfe77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.164844:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465564416:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 22952us (23138us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147249.164854:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7169 00010000:00010000:1.0:1746147249.176764:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.176781:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.176790:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.176796:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d42c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147249.176800:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.176808:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.176826:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.176833:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d42c00/0xb4b2209fbdacfe8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.176921:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465565312:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 23890us (25549us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147249.176932:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7172 00010000:00010000:1.0:1746147249.180930:0:1351:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.180964:0:1351:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.180972:0:1351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.180979:0:1351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f361600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147249.180983:0:1351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.180991:0:1351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.181009:0:1351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.181014:0:1351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdacfe93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.181085:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465565440:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 27589us (29664us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147249.181094:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7173 00000100:00100000:0.0:1746147249.198432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.205594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.205681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.205892:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465566720 00000100:00100000:1.0:1746147249.205896:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465566720 00000100:00100000:1.0:1746147249.205977:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15191 00000100:00100000:1.0:1746147249.205985:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465566720:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147249.206323:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147249.206326:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:1.0:1746147249.206328:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147247 -> 1746147248 00002000:00010000:1.0:1746147249.206476:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:1.0:1746147249.206479:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147249.206512:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465566720:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 528us (831us total) trans 21474841285 rc 0/0 00000100:00100000:1.0:1746147249.206518:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15191 00000100:00100000:0.0:1746147249.206797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.206815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.206917:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15193 00000100:00100000:1.0:1746147249.206923:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465567104:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147249.207013:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:1.0:1746147249.207017:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147247 -> 1746147248 00002000:00010000:1.0:1746147249.207019:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147247 -> 1746147248 00002000:00010000:1.0:1746147249.207021:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147247 -> 1746147248 00002000:00010000:1.0:1746147249.207022:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746147249.207039:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465567104:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 116us (222us total) trans 17179873919 rc 0/0 00000100:00100000:1.0:1746147249.207045:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15193 00000100:00100000:1.0:1746147249.207308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.207345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.209350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.209436:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465567488 00000100:00100000:1.0:1746147249.209441:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465567488 00000100:00100000:1.0:1746147249.209479:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4714 00000100:00100000:1.0:1746147249.209484:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31658:x1830967465567488:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:1.0:1746147249.209532:0:14051:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x39b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2600/0xb4b2209fbdacfdf9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec107 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.209572:0:14051:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147249.209582:0:14051:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.209588:0:14051:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147249.209614:0:14051:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.209623:0:14051:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 9 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.209636:0:14051:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14051:1830967466979200:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.210094:0:14051:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.211543:0:14051:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14051:1830967466979200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.211565:0:14051:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000100:00100000:0.0:1746147249.211821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.212024:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465567616 00000100:00100000:1.0:1746147249.212030:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465567616 00010000:00010000:1.0:1746147249.212061:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 10 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.212096:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7716 00000100:00100000:1.0:1746147249.212102:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465567616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.212115:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.212120:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 10 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.212128:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 10 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.212148:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebe00/0xb4b2209fbdacfe38 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec10e expref: 10 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.212287:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.212293:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147249.212304:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147249.212311:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147249.212349:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.212387:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465567616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 285us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.212394:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7716 00010000:00010000:0.0:1746147249.212489:0:14051:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00010000:00010000:0.0:1746147249.212495:0:14051:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000040:00080000:0.0:1746147249.213564:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3332, 88 off278704 00000004:00080000:0.0:1746147249.213572:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636200634482ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147249.215565:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3338, 88 off279232 00000004:00080000:0.0:1746147249.215575:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636202637281ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147249.215602:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3339, 88 off279320 00000004:00080000:0.0:1746147249.215607:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636202669421ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147249.215621:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3333, 88 off278792 00000004:00080000:0.0:1746147249.215624:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636202686908ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147249.215784:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3334, 88 off278880 00000004:00080000:0.0:1746147249.215788:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636202850866ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147249.215796:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3340, 88 off279408 00000004:00080000:0.0:1746147249.215798:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636202860864ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.216390:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3341, 88 off279496 00000004:00080000:1.0:1746147249.216395:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636203457829ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.216416:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3342, 88 off279584 00000004:00080000:1.0:1746147249.216420:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636203482619ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.216428:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3335, 88 off278968 00000004:00080000:1.0:1746147249.216431:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636203493299ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.216449:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3343, 88 off279672 00000004:00080000:1.0:1746147249.216452:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636203515214ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.216462:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3336, 88 off279056 00000004:00080000:1.0:1746147249.216465:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636203527644ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.216472:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3344, 88 off279760 00000004:00080000:1.0:1746147249.216532:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636203594156ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.216545:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3337, 88 off279144 00000004:00080000:1.0:1746147249.216549:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636203611914ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.216611:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3338, 88 off279232 00000004:00080000:1.0:1746147249.216614:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636203677124ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.216620:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3339, 88 off279320 00000004:00080000:1.0:1746147249.216623:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636203686135ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.216629:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3340, 88 off279408 00000004:00080000:1.0:1746147249.216631:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636203694166ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.216637:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3345, 88 off279848 00000004:00080000:1.0:1746147249.216640:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636203702449ns, next at 607576201812ns, rc = 0 00000004:00010000:1.0:1746147249.238624:0:14051:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880132e10700 reply state ffff88012c80dc00 transno 8589945321 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43a00/0xb4b2209fbdacfeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000100:00100000:1.0:1746147249.238638:0:14051:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147249.238649:0:14051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012c8a4e00) 00010000:00010000:1.0:1746147249.238652:0:14051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147249.238660:0:14051:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2600/0xb4b2209fbdacfdf9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec107 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.238771:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31658:x1830967465567488:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 29285us (29424us total) trans 8589945321 rc 0/0 00000100:00100000:1.0:1746147249.238781:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4714 00000001:00080000:1.0:1746147249.238820:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945321 is committed 00000004:00080000:1.0:1746147249.238825:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2472 committed 00000004:00080000:1.0:1746147249.238831:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2463 committed 00000004:00080000:1.0:1746147249.238836:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2462 committed 00000004:00080000:1.0:1746147249.238838:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2461 committed 00000004:00080000:1.0:1746147249.238840:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2460 committed 00000004:00080000:1.0:1746147249.238842:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2471 committed 00000004:00080000:1.0:1746147249.238844:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2459 committed 00000004:00080000:1.0:1746147249.238845:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2470 committed 00000004:00080000:1.0:1746147249.238846:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2458 committed 00000004:00080000:1.0:1746147249.238848:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2469 committed 00000004:00080000:1.0:1746147249.238849:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2468 committed 00000004:00080000:1.0:1746147249.238851:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2467 committed 00000004:00080000:1.0:1746147249.238854:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2457 committed 00000004:00080000:1.0:1746147249.238856:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2456 committed 00000004:00080000:1.0:1746147249.238858:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2466 committed 00000004:00080000:1.0:1746147249.238859:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2465 committed 00000004:00080000:1.0:1746147249.238861:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2455 committed 00000100:00100000:0.0:1746147249.239426:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466979328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.239471:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.239512:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466979840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.239528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.239540:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466980352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.239555:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.239566:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466980864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.239832:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466979456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.239864:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15197 00000100:00100000:1.0:1746147249.239870:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3295:x1830967466979840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.240233:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147249.240273:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a5880/2, rc 0, transno 17179873921 00000100:00100000:0.0:1746147249.240280:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466980352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.240291:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466979584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.240307:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240316:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.240327:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240333:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.240346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240354:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466981120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.240365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240376:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147249.240380:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466979712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.240392:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240401:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.240411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240419:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.240430:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240436:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466981248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.240447:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.240465:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466980864 00000100:00100000:0.0:1746147249.240468:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466980864 00000100:00100000:0.0:1746147249.240478:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466979584 00000100:00100000:0.0:1746147249.240480:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466979584 00000100:00100000:0.0:1746147249.240486:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466980096 00000100:00100000:0.0:1746147249.240487:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466980096 00000100:00100000:0.0:1746147249.240492:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466980608 00000100:00100000:0.0:1746147249.240494:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466980608 00000100:00100000:0.0:1746147249.240499:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466981120 00000100:00100000:0.0:1746147249.240500:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466981120 00000100:00100000:0.0:1746147249.240505:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466979712 00000100:00100000:0.0:1746147249.240506:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466979712 00000100:00100000:0.0:1746147249.240512:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466980224 00000100:00100000:0.0:1746147249.240513:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466980224 00000100:00100000:0.0:1746147249.240518:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466980736 00000100:00100000:0.0:1746147249.240520:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466980736 00000100:00100000:0.0:1746147249.240524:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466981248 00000100:00100000:0.0:1746147249.240526:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466981248 00000100:00100000:0.0:1746147249.240533:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15199 00000100:00100000:0.0:1746147249.240537:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3295:x1830967466980864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.240620:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3295:x1830967466980864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (386us total) trans 17179873922 rc 0/0 00000100:00100000:0.0:1746147249.240625:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15199 00000100:00100000:0.0:1746147249.240634:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15200 00000100:00100000:0.0:1746147249.240638:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3293:x1830967466979584:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.240653:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e977800/2, rc 0, transno 17179873922 00000100:00100000:0.0:1746147249.240657:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466980864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.240746:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3295:x1830967466979840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 876us (1216us total) trans 21474841288 rc 0/0 00000100:00100000:1.0:1746147249.240751:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15197 00000100:00100000:1.0:1746147249.240760:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15201 00000100:00100000:1.0:1746147249.240764:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3293:x1830967466980096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.240838:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3293:x1830967466980096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (510us total) trans 21474841290 rc 0/0 00000100:00100000:1.0:1746147249.240843:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15201 00000100:00100000:1.0:1746147249.240852:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15203 00000100:00100000:1.0:1746147249.240856:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967466981120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.240930:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967466981120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (563us total) trans 17179873924 rc 0/0 00000100:00100000:1.0:1746147249.240935:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15203 00000100:00100000:1.0:1746147249.240964:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15205 00000100:00100000:1.0:1746147249.240968:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3293:x1830967466980224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.241042:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3293:x1830967466980224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (630us total) trans 21474841292 rc 0/0 00000100:00100000:1.0:1746147249.241050:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15205 00000100:00100000:1.0:1746147249.241059:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15207 00000100:00100000:1.0:1746147249.241063:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967466981248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.241132:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967466981248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (684us total) trans 17179873926 rc 0/0 00000100:00100000:1.0:1746147249.241137:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15207 00000100:00100000:1.0:1746147249.241177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.241195:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466979968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.241211:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.241220:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466980480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.241233:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.241241:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466980992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.241253:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.241263:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147249.241266:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466981376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.241280:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.241294:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466979968 00000100:00100000:1.0:1746147249.241297:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466979968 00000100:00100000:1.0:1746147249.241308:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466980480 00000100:00100000:1.0:1746147249.241310:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466980480 00000100:00100000:1.0:1746147249.241316:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466981376 00000100:00100000:1.0:1746147249.241317:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466981376 00000004:00080000:0.0:1746147249.241541:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a4e00/2, rc 0, transno 21474841291 00000100:00100000:0.0:1746147249.241546:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466979712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.241552:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a4700/2, rc 0, transno 21474841292 00000100:00100000:0.0:1746147249.241555:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.241560:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974000/2, rc 0, transno 17179873925 00000100:00100000:0.0:1746147249.241564:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.241569:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974e00/2, rc 0, transno 17179873926 00000100:00100000:0.0:1746147249.241571:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466981248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.241576:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a5500/2, rc 0, transno 21474841290 00000100:00100000:0.0:1746147249.241579:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.241583:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e977100/2, rc 0, transno 17179873923 00000100:00100000:0.0:1746147249.241585:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466980608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.241590:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e975500/2, rc 0, transno 17179873924 00000100:00100000:0.0:1746147249.241593:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466981120:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147249.241665:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147249.241668:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.241670:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.241672:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.241674:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147249.241693:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3293:x1830967466979584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1054us (1385us total) trans 21474841295 rc 0/0 00000100:00100000:1.0:1746147249.241882:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15210 00000100:00100000:1.0:1746147249.241889:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967466980480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147249.241974:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147249.241976:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:1.0:1746147249.241979:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147248 -> 1746147248 00002000:00010000:1.0:1746147249.241981:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:1.0:1746147249.241983:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147249.241998:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830967466980480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (764us total) trans 17179873928 rc 0/0 00000100:00100000:1.0:1746147249.242002:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15210 00000004:00080000:1.0:1746147249.242024:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe1ed80/2, rc 0, transno 21474841293 00000100:00100000:1.0:1746147249.242027:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466979456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147249.242033:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a5c00/2, rc 0, transno 21474841294 00000100:00100000:1.0:1746147249.242035:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466979968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147249.242041:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974a80/2, rc 0, transno 17179873928 00000100:00100000:1.0:1746147249.242043:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466980480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.242048:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e977480/2, rc 0, transno 17179873927 00000100:00100000:1.0:1746147249.242050:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466980992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.242079:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e975180/2, rc 0, transno 17179873929 00000100:00100000:1.0:1746147249.242082:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466981376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.242341:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15200 00000004:00080000:0.0:1746147249.242447:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a6300/2, rc 0, transno 21474841295 00000100:00100000:0.0:1746147249.242450:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466979584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.242465:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe1dc00/2, rc 0, transno 21474841289 00000100:00100000:0.0:1746147249.242467:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466979328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.242473:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a4a80/2, rc 0, transno 21474841288 00000100:00100000:0.0:1746147249.242476:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466979840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.247080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.264054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.264111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.271599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.271642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.271679:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.271718:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465568896 00000100:00100000:0.0:1746147249.271721:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465568896 00000100:00100000:0.0:1746147249.271751:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465569024 00000100:00100000:0.0:1746147249.271753:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465569024 00000100:00100000:0.0:1746147249.271771:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15214 00000100:00100000:0.0:1746147249.271776:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31669:x1830967465569024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147249.271783:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.271791:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942eb000/0xb4b2209fbdacff11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec169 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.271812:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.271814:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.272542:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942eb000/0xb4b2209fbdacff11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec169 expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.272611:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942eb000/0xb4b2209fbdacff11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec169 expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.272616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147249.272624:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942eb000, rc 0) 00000100:00100000:0.0:1746147249.272645:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31669:x1830967465569024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 869us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.272652:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15214 00000100:00100000:0.0:1746147249.279310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.279348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.279382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.279384:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465569408 00000100:00100000:1.0:1746147249.279394:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465569408 00000100:00100000:0.0:1746147249.279422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147249.279430:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfef5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec154 expref: 304 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.279455:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465569536 00000100:00100000:1.0:1746147249.279457:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465569536 00000100:00100000:0.0:1746147249.279461:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465569664 00000100:00100000:0.0:1746147249.279465:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465569664 00010000:00010000:1.0:1746147249.279467:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51f200/0xb4b2209fbdacfeee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec14d expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.279487:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7717 00000100:00100000:0.0:1746147249.279490:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11347 00000100:00100000:1.0:1746147249.279495:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1956:x1830967465569408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147249.279496:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31670:x1830967465569664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147249.279508:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.279513:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfef5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec154 expref: 305 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.279514:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147249.279522:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfef5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec154 expref: 305 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.279530:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb400/0xb4b2209fbdacff34 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec177 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.279540:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab2a00/0xb4b2209fbdacfef5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec154 expref: 306 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.279556:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:1.0:1746147249.279561:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51fe00/0xb4b2209fbdacff1f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.279567:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51fe00/0xb4b2209fbdacff1f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.279572:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147249.279581:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb400/0xb4b2209fbdacff34 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec177 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.279591:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942eb400/0xb4b2209fbdacff34 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec177 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.279605:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:0.0:1746147249.279608:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147249.279610:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942eb400, rc 0) 00000100:00100000:1.0:1746147249.279612:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1956:x1830967465569408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.279618:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7717 00000100:00100000:0.0:1746147249.279633:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31670:x1830967465569664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 138us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.279635:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7718 00000100:00100000:1.0:1746147249.279639:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465569536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147249.279639:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11347 00010000:00010000:1.0:1746147249.279645:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.279650:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51f200/0xb4b2209fbdacfeee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec14d expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.279658:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51f200/0xb4b2209fbdacfeee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec14d expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.279668:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51f200/0xb4b2209fbdacfeee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec14d expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.279677:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:1.0:1746147249.279680:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51fe00/0xb4b2209fbdacff1f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.279687:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51fe00/0xb4b2209fbdacff1f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.279691:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e51fe00/0xb4b2209fbdacff1f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.279697:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdacff2d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147249.279702:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdacff2d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147249.279706:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdacff2d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147249.279726:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.279740:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465569536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.279746:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7718 00000100:00100000:0.0:1746147249.291325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.297237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.299235:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465570432 00000100:00100000:0.0:1746147249.299247:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465570432 00002000:00100000:0.0:1746147249.299299:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800936dc700 x1830967465570432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.299310:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830967465570432 ext(0->1048575) 00002000:00010000:0.0:1746147249.299316:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:0.0:1746147249.299400:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7178 00000100:00100000:0.0:1746147249.299409:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465570432:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147249.303421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.315570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.316644:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465570432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17235us (19414us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147249.316652:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7178 00002000:00100000:0.0:1746147249.316660:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800936dc700 x1830967465570432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/440 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.316669:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830967465570432 ext(0->1048575) 00002000:00010000:0.0:1746147249.316673:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:0.0:1746147249.320304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.320335:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465570816 00000100:00100000:0.0:1746147249.320343:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465570816 00000100:00100000:0.0:1746147249.320386:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11349 00000100:00100000:0.0:1746147249.320394:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31669:x1830967465570816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147249.320418:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.320435:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec18c expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.320490:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacff50 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.320499:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 10 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.320516:0:16361:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacff50 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.320526:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 10 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.320537:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:0.0:1746147249.320540:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147249.320543:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 10 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.320549:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942ebc00, rc 0) 00000100:00100000:0.0:1746147249.320591:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31669:x1830967465570816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 197us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.320597:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11349 00000100:00100000:0.0:1746147249.325346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.332959:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465571072 00000100:00100000:1.0:1746147249.332969:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465571072 00000100:00100000:0.0:1746147249.333051:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11350 00000100:00100000:0.0:1746147249.333060:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31670:x1830967465571072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147249.333081:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.333099:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec19a expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.333154:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec19a expref: 307 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.333178:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec19a expref: 307 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.333191:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:0.0:1746147249.333194:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147249.333198:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.333205:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194a00, rc 0) 00000100:00100000:0.0:1746147249.333251:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+307:31670:x1830967465571072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 192us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.333257:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11350 00000001:00080000:1.0:1746147249.345570:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945327 is committed 00000004:00080000:1.0:1746147249.345581:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2480 committed 00000004:00080000:1.0:1746147249.345589:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2472 committed 00000004:00080000:1.0:1746147249.345595:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2471 committed 00000004:00080000:1.0:1746147249.345596:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2470 committed 00000004:00080000:1.0:1746147249.345598:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2469 committed 00000004:00080000:1.0:1746147249.345600:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2479 committed 00000004:00080000:1.0:1746147249.345601:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2468 committed 00000004:00080000:1.0:1746147249.345608:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2478 committed 00000004:00080000:1.0:1746147249.345610:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2467 committed 00000004:00080000:1.0:1746147249.345612:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2477 committed 00000004:00080000:1.0:1746147249.345613:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2476 committed 00000004:00080000:1.0:1746147249.345615:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2475 committed 00000004:00080000:1.0:1746147249.345616:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2466 committed 00000004:00080000:1.0:1746147249.345619:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2465 committed 00000004:00080000:1.0:1746147249.345621:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2474 committed 00000004:00080000:1.0:1746147249.345622:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2473 committed 00000004:00080000:1.0:1746147249.345623:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2464 committed 00000001:00080000:1.0:1746147249.345633:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945322 is committed 00000001:00080000:1.0:1746147249.345641:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945325 is committed 00010000:00010000:0.0:1746147249.346234:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3400/0xb4b2209fbdacff50 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec17e expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346246:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:0.0:1746147249.346249:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147249.346253:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346262:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346268:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346274:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec19a expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346279:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec19a expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346286:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec19a expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.346308:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194a00/0xb4b2209fbdacff6c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec19a expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.346319:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466982656:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147249.346445:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942ebc00/0xb4b2209fbdacff5e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec18c expref: 7 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.346455:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466982784:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147249.346486:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.347220:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466981888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.347266:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.347288:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466982400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.347305:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.347317:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.347330:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.347342:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.347354:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.347377:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147249.347382:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466982272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.347398:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.347410:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.348496:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15220 00000100:00100000:0.0:1746147249.348506:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3296:x1830967466983680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.348635:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3296:x1830967466983680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (1277us total) trans 17179873931 rc 0/0 00000100:00100000:0.0:1746147249.348641:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15220 00000100:00100000:0.0:1746147249.348656:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15221 00000100:00100000:0.0:1746147249.348662:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3296:x1830967466982272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147249.348770:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746147249.348771:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147249.348773:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.348775:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.348777:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.348779:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147249.349031:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349041:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3296:x1830967466982272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 378us (1640us total) trans 21474841297 rc 0/0 00000100:00100000:0.0:1746147249.349048:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15221 00000100:00100000:1.0:1746147249.349050:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349057:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466984064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349060:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466983552 00000100:00100000:0.0:1746147249.349064:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466983552 00000100:00100000:1.0:1746147249.349068:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.349079:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466984064 00000100:00100000:0.0:1746147249.349082:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466984064 00000004:00080000:1.0:1746147249.349088:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df480/2, rc 0, transno 17179873930 00000100:00100000:0.0:1746147249.349094:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15223 00000100:00100000:1.0:1746147249.349096:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466981888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349099:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967466983552:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.349104:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1c00/2, rc 0, transno 21474841296 00000100:00100000:1.0:1746147249.349107:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466982400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147249.349112:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dce00/2, rc 0, transno 17179873931 00000100:00100000:1.0:1746147249.349115:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.349121:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1f80/2, rc 0, transno 21474841297 00000100:00100000:1.0:1746147249.349123:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466982272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.349138:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.349151:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349156:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.349178:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349185:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.349195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349200:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.349210:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349220:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746147249.349224:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.349237:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.349242:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3296:x1830967466983552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (189us total) trans 17179873932 rc 0/0 00000100:00100000:1.0:1746147249.349243:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.349249:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15223 00000100:00100000:1.0:1746147249.349254:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349259:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349263:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466982016 00000100:00100000:0.0:1746147249.349267:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466982016 00000100:00100000:1.0:1746147249.349269:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.349275:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349279:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466982528 00000100:00100000:0.0:1746147249.349281:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466982528 00000100:00100000:1.0:1746147249.349289:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.349292:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466983296 00000100:00100000:0.0:1746147249.349294:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466983296 00000100:00100000:0.0:1746147249.349303:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466983808 00000100:00100000:0.0:1746147249.349305:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466983808 00000100:00100000:1.0:1746147249.349308:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466982144 00000100:00100000:1.0:1746147249.349311:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466982144 00000100:00100000:0.0:1746147249.349313:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466982912 00000100:00100000:0.0:1746147249.349315:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466982912 00000100:00100000:1.0:1746147249.349324:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466983424 00000100:00100000:0.0:1746147249.349325:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466983936 00000100:00100000:1.0:1746147249.349326:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466983424 00000100:00100000:0.0:1746147249.349327:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466983936 00000100:00100000:1.0:1746147249.349336:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15224 00000100:00100000:1.0:1746147249.349341:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3296:x1830967466984064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349341:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15225 00000100:00100000:0.0:1746147249.349346:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3293:x1830967466982016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.349447:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3296:x1830967466984064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (377us total) trans 17179873933 rc 0/0 00002000:00010000:0.0:1746147249.349448:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746147249.349452:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15224 00002000:00010000:0.0:1746147249.349452:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349454:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349455:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349458:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147249.349463:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15226 00000100:00100000:1.0:1746147249.349467:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3293:x1830967466982528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.349492:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3293:x1830967466982016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (339us total) trans 17179873934 rc 0/0 00000100:00100000:0.0:1746147249.349499:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15225 00000100:00100000:0.0:1746147249.349514:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15227 00000100:00100000:0.0:1746147249.349520:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3293:x1830967466983296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.349562:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3293:x1830967466982528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (383us total) trans 21474841299 rc 0/0 00000100:00100000:1.0:1746147249.349571:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15226 00000100:00100000:1.0:1746147249.349582:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15228 00000100:00100000:1.0:1746147249.349586:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3293:x1830967466983808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.349631:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3293:x1830967466983296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (433us total) trans 21474841300 rc 0/0 00000100:00100000:0.0:1746147249.349637:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15227 00000100:00100000:0.0:1746147249.349651:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15229 00000100:00100000:0.0:1746147249.349657:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3293:x1830967466982144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.349711:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3293:x1830967466983808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (498us total) trans 17179873935 rc 0/0 00000100:00100000:1.0:1746147249.349717:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15228 00000100:00100000:1.0:1746147249.349727:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15230 00000100:00100000:1.0:1746147249.349731:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3293:x1830967466982912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147249.349748:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147249.349751:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349752:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349754:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349756:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147249.349778:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3293:x1830967466982144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (539us total) trans 21474841301 rc 0/0 00000100:00100000:0.0:1746147249.349784:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15229 00000100:00100000:0.0:1746147249.349801:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15231 00000100:00100000:0.0:1746147249.349807:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3293:x1830967466983424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.349817:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3293:x1830967466982912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (561us total) trans 21474841302 rc 0/0 00000100:00100000:1.0:1746147249.349823:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15230 00000100:00100000:1.0:1746147249.349832:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15232 00000100:00100000:1.0:1746147249.349836:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3293:x1830967466983936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147249.349917:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147249.349921:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349923:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349924:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147248 -> 1746147248 00002000:00010000:0.0:1746147249.349927:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746147249.349951:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147249.349958:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466984192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.349982:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.349983:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3293:x1830967466983424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (710us total) trans 17179873936 rc 0/0 00000100:00100000:0.0:1746147249.349989:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15231 00000100:00100000:1.0:1746147249.350001:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466984192 00000100:00100000:1.0:1746147249.350003:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466984192 00000100:00100000:1.0:1746147249.350018:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15233 00000100:00100000:1.0:1746147249.350022:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3295:x1830967466984192:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.350028:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1500/2, rc 0, transno 21474841301 00000100:00100000:0.0:1746147249.350034:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.350045:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df7b480/2, rc 0, transno 21474841302 00000100:00100000:0.0:1746147249.350048:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.350057:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddf80/2, rc 0, transno 17179873936 00000100:00100000:0.0:1746147249.350060:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.350066:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dfb80/2, rc 0, transno 17179873934 00000100:00100000:0.0:1746147249.350069:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.350076:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df79180/2, rc 0, transno 21474841299 00000100:00100000:0.0:1746147249.350078:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466982528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.350084:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047b80/2, rc 0, transno 21474841300 00000100:00100000:0.0:1746147249.350087:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.350094:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e586d80/2, rc 0, transno 17179873935 00000100:00100000:0.0:1746147249.350096:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.350108:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3295:x1830967466984192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (124us total) trans 17179873938 rc 0/0 00000100:00100000:1.0:1746147249.350113:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15233 00000004:00080000:0.0:1746147249.350118:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddc00/2, rc 0, transno 17179873932 00000100:00100000:0.0:1746147249.350123:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.350131:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d5dca80/2, rc 0, transno 17179873938 00000004:00080000:0.0:1746147249.350132:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584000/2, rc 0, transno 17179873933 00000100:00100000:0.0:1746147249.350134:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466984064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.350136:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466984192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.350189:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3293:x1830967466983936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 352us (899us total) trans 17179873937 rc 0/0 00000100:00100000:1.0:1746147249.350195:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15232 00000004:00080000:0.0:1746147249.350202:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e587800/2, rc 0, transno 17179873937 00000100:00100000:0.0:1746147249.350205:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466983936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.350745:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 21474841303 00000100:00100000:1.0:1746147249.350748:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147249.351280:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df7aa00/2, rc 0, transno 21474841298 00000100:00100000:1.0:1746147249.351283:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466983040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.355310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.355364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.364787:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.364901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.369118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.369991:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465571968 00000100:00100000:0.0:1746147249.369996:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465571968 00002000:00100000:0.0:1746147249.370022:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880091078700 x1830967465571968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.370031:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091078700 with x1830967465571968 ext(1048576->2097151) 00002000:00010000:0.0:1746147249.370036:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091078700 00000100:00100000:0.0:1746147249.370048:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7180 00000100:00100000:0.0:1746147249.370052:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465571968:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147249.375694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.375744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.375784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.375885:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465572096 00000100:00100000:1.0:1746147249.375894:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465572096 00010000:00010000:1.0:1746147249.375925:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942eb000/0xb4b2209fbdacff11 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec169 expref: 20 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.375990:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7721 00000100:00100000:1.0:1746147249.375999:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465572352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.376012:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.376035:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d43800/0xb4b2209fbdacfe54 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec11c expref: 14 pid: 4444 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.376046:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d43800/0xb4b2209fbdacfe54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec11c expref: 14 pid: 4444 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.376075:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.376134:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465572352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 134us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.376144:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7721 00000100:00100000:1.0:1746147249.376176:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7722 00000100:00100000:1.0:1746147249.376183:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465572096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.376194:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.376205:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942eb000/0xb4b2209fbdacff11 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec169 expref: 20 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.376213:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942eb000/0xb4b2209fbdacff11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec169 expref: 20 pid: 21080 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.376226:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.376250:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465572096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.376256:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7722 00000100:00100000:0.0:1746147249.386713:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465571584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21556us (21926us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147249.386725:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7179 00002000:00100000:0.0:1746147249.386736:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a4fad500 x1830967465571584/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/440 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.386745:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad500 with x1830967465571584 ext(1048576->2097151) 00002000:00010000:0.0:1746147249.386751:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad500 00000100:00100000:0.0:1746147249.391647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.398265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.398298:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465573120 00000100:00100000:0.0:1746147249.398306:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465573120 00002000:00100000:0.0:1746147249.398344:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (1007616->1011711) req@ffff8800a4fac000 x1830967465573120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.398353:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967465573120 ext(1007616->1011711) 00002000:00010000:0.0:1746147249.398358:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fac000 00000100:00100000:0.0:1746147249.398395:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7182 00000100:00100000:0.0:1746147249.398402:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465573120:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147249.398549:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465573120:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 147us (292us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147249.398556:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7182 00002000:00100000:0.0:1746147249.398561:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (1007616->1011711) req@ffff8800a4fac000 x1830967465573120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/4536 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.398568:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967465573120 ext(1007616->1011711) 00002000:00010000:0.0:1746147249.398571:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fac000 00000100:00100000:0.0:1746147249.404511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.404583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.413983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.416620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.433727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.437890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.439419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.443015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.443063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.446345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.448384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.455300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.455345:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465575040 00000100:00100000:1.0:1746147249.455353:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465575040 00002000:00100000:1.0:1746147249.455390:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (98304->102399) req@ffff880132e12680 x1830967465575040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.455399:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967465575040 ext(98304->102399) 00002000:00010000:1.0:1746147249.455403:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:1.0:1746147249.455418:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7187 00000100:00100000:1.0:1746147249.455424:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465575040:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147249.455565:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465575040:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 141us (267us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147249.455571:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7187 00002000:00100000:1.0:1746147249.455576:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (98304->102399) req@ffff880132e12680 x1830967465575040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/4536 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.455582:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967465575040 ext(98304->102399) 00002000:00010000:1.0:1746147249.455584:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147249.461101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.461135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.461188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.463285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.468422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.468700:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.468758:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465575808 00000100:00100000:1.0:1746147249.468766:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465575808 00000100:00100000:1.0:1746147249.469043:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465575936 00000100:00100000:1.0:1746147249.469046:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465575936 00000100:00100000:1.0:1746147249.480632:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465576192 00000100:00100000:1.0:1746147249.480640:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465576192 00002000:00100000:1.0:1746147249.480682:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880093435880 x1830967465576192/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.480701:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093435880 with x1830967465576192 ext(2097152->3145727) 00002000:00010000:1.0:1746147249.480706:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093435880 00000100:00100000:1.0:1746147249.480732:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465576448 00000100:00100000:1.0:1746147249.480734:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465576448 00002000:00100000:1.0:1746147249.480747:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880093434a80 x1830967465576448/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.480754:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093434a80 with x1830967465576448 ext(3145728->4194303) 00002000:00010000:1.0:1746147249.480756:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093434a80 00000100:00100000:1.0:1746147249.480765:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465577472 00000100:00100000:1.0:1746147249.480766:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465577472 00002000:00100000:1.0:1746147249.480775:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880093436a00 x1830967465577472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.480781:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093436a00 with x1830967465577472 ext(3145728->4194303) 00002000:00010000:1.0:1746147249.480784:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093436a00 00000100:00100000:1.0:1746147249.480791:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7189 00000100:00100000:1.0:1746147249.480797:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465576832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147249.481350:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7193 00000100:00100000:1.0:1746147249.481355:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465577216:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147249.481511:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7194 00000100:00100000:1.0:1746147249.481515:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465577472:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147249.527319:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465577216:12345-192.168.203.36@tcp:3:cat.0 Request processed in 45952us (46675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147249.527332:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7193 00002000:00100000:1.0:1746147249.527344:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880093434380 x1830967465577216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/440 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.527354:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093434380 with x1830967465577216 ext(2097152->3145727) 00002000:00010000:1.0:1746147249.527360:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093434380 00000100:00100000:1.0:1746147249.530854:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465576832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 50046us (50477us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147249.530867:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7189 00002000:00100000:1.0:1746147249.530879:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880093435c00 x1830967465576832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/440 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.530889:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093435c00 with x1830967465576832 ext(3145728->4194303) 00002000:00010000:1.0:1746147249.530895:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093435c00 00000100:00100000:0.0:1746147249.539689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.543494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.544277:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465578368 00000100:00100000:0.0:1746147249.544285:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465578368 00002000:00100000:0.0:1746147249.544321:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e6f0380 x1830967465578368/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147249.544330:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0380 with x1830967465578368 ext(4194304->4976639) 00002000:00010000:0.0:1746147249.544335:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0380 00000100:00100000:0.0:1746147249.544361:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7197 00000100:00100000:0.0:1746147249.544367:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465578368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147249.556783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.567657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.578401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.586570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.592662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.630106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.635737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.643994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.650781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.653527:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1830967466985984:0@lo:400:kworker.0 00000100:00100000:1.0:1746147249.653580:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.653609:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147249.653614:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830967466986112:0@lo:400:kworker.0 00000100:00100000:0.0:1746147249.653632:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b57d6275-d138-4373-818f-9bad59bb9e6f:3294:1830967466985856:0@lo:400:kworker.0 00000100:00100000:1.0:1746147249.653633:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.653663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.653680:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466985984 00000100:00100000:1.0:1746147249.653685:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466985984 00000100:00100000:0.0:1746147249.653693:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147249.653698:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830967466986240:0@lo:400:kworker.0 00000100:00100000:0.0:1746147249.653716:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.653721:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466986112 00000100:00100000:1.0:1746147249.653723:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466986112 00000100:00100000:0.0:1746147249.653735:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466986240 00000100:00100000:0.0:1746147249.653737:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466986240 00000100:00100000:1.0:1746147249.653738:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1746147249.653743:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830967466985984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147249.653752:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1746147249.653756:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830967466986112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147249.653778:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830967466986112:12345-0@lo:400:kworker.0 Request processed in 22us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.653784:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1746147249.653798:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746147249.653802:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830967466986240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147249.653824:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830967466986240:12345-0@lo:400:kworker.0 Request processed in 22us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.653829:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746147249.653861:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830967466986240:0@lo:400:kworker.0 00000100:00100000:1.0:1746147249.653933:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830967466985984:12345-0@lo:400:kworker.0 Request processed in 189us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.653952:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1746147249.653976:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830967466986112:0@lo:400:kworker.0 00000100:00100000:1.0:1746147249.653982:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1830967466985984:0@lo:400:kworker.0 00000100:00100000:1.0:1746147249.654156:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b57d6275-d138-4373-818f-9bad59bb9e6f:3294:1830967466985856:0@lo:400:kworker.0 00000100:00100000:0.0:1746147249.666886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.670630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.672200:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466986496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147249.673708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.673750:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465580800 00000100:00100000:1.0:1746147249.673757:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465580800 00002000:00100000:1.0:1746147249.673796:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (929792->933887) req@ffff8801307edc00 x1830967465580800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.673805:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307edc00 with x1830967465580800 ext(929792->933887) 00002000:00010000:1.0:1746147249.673811:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307edc00 00000100:00100000:1.0:1746147249.673836:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7200 00000100:00100000:1.0:1746147249.673846:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465580800:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147249.674027:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465580800:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 182us (323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147249.674034:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7200 00002000:00100000:1.0:1746147249.674039:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (929792->933887) req@ffff8801307edc00 x1830967465580800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/4536 e 0 to 0 dl 1746147260 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.674046:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307edc00 with x1830967465580800 ext(929792->933887) 00002000:00010000:1.0:1746147249.674048:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307edc00 00000100:00100000:0.0:1746147249.694499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.704235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.704397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.706800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.706836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.707235:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7726 00000100:00100000:1.0:1746147249.707252:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465581696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.707268:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.707277:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdacff2d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec170 expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.707291:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdacff2d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec170 expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.707309:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdacff2d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec170 expref: 10 pid: 16361 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.707333:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:1.0:1746147249.707338:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.707345:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.707351:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.707372:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147249.707726:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147249.707733:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147249.707865:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465581696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 619us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.707876:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7726 00000100:00100000:0.0:1746147249.712131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.715595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.720046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.720126:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465582208 00000100:00100000:1.0:1746147249.720135:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465582208 00010000:00010000:1.0:1746147249.720180:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec211 expref: 9 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.720687:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7727 00000100:00100000:1.0:1746147249.720695:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465582208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.720707:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.720712:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec211 expref: 9 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.720722:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec211 expref: 9 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.720740:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a950800/0xb4b2209fbdad0014 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec211 expref: 9 pid: 14049 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.720755:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:1.0:1746147249.720760:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0029 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.720768:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0029 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.720773:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0029 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147249.720792:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.720829:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465582208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.720834:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7727 00000100:00100000:0.0:1746147249.723863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.727384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.730263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.735916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.738871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.738908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.738957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.739388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.739622:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465583360 00000100:00100000:1.0:1746147249.739627:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465583360 00000100:00100000:1.0:1746147249.739649:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465583616 00000100:00100000:1.0:1746147249.739651:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465583616 00000100:00100000:1.0:1746147249.739660:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465582976 00000100:00100000:1.0:1746147249.739662:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465582976 00000100:00100000:1.0:1746147249.739681:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15251 00000100:00100000:1.0:1746147249.739689:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465583104:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147249.739734:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.739753:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.739761:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.739768:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.739774:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.739775:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.739779:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.739810:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.739821:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 23 pid: 8481 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.739834:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466987392:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.739908:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.739915:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 32 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.739923:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466987520:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.739970:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.739978:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 16 pid: 17548 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.739986:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466987648:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.740004:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.740028:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15252 00000100:00100000:1.0:1746147249.740035:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465583360:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147249.740056:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad0068 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740066:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e51f400/0xb4b2209fbdacfe69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec131 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740073:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740080:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 34 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740086:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.740087:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.740089:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad0068 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740104:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 34 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740112:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 34 pid: 8478 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.740121:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466987776:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.740149:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740173:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 22 pid: 4444 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.740181:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466987904:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.740207:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e51f400/0xb4b2209fbdacfe69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec131 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740215:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e51f400/0xb4b2209fbdacfe69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec131 expref: 14 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.740224:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466988032:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.740240:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183e300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.740257:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15253 00000100:00100000:1.0:1746147249.740262:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465583616:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147249.740277:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740287:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740293:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740300:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740306:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.740307:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.740309:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.740322:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740329:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.740336:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466988160:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.740360:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740367:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.740374:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466988288:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.740397:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.740404:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.740415:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466988416:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.740427:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147249.740493:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.740515:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465583232 00000100:00100000:0.0:1746147249.740518:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465583232 00000100:00100000:0.0:1746147249.740537:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15254 00000100:00100000:0.0:1746147249.740541:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465582976:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147249.740556:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.740566:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 34 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.740572:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147249.740574:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147249.740575:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.740590:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 34 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.740597:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 34 pid: 4444 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.740604:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466988544:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.740624:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147249.740657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.752629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.752643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.752686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.752707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.752730:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465583872 00000100:00100000:0.0:1746147249.752737:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465583872 00010000:00010000:0.0:1746147249.752767:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 18 pid: 17548 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.752789:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584256 00000100:00100000:0.0:1746147249.752790:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584256 00010000:00010000:0.0:1746147249.752799:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e51f400/0xb4b2209fbdacfe69 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec131 expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.752812:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584128 00000100:00100000:1.0:1746147249.752814:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584000 00000100:00100000:0.0:1746147249.752814:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584128 00000100:00100000:1.0:1746147249.752817:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584000 00010000:00010000:0.0:1746147249.752821:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 35 pid: 8478 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.752829:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 33 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.752831:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7729 00000100:00100000:0.0:1746147249.752836:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1957:x1830967465583872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147249.752839:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7730 00000100:00100000:1.0:1746147249.752843:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1957:x1830967465584256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.752847:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.752849:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.752864:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e51f400/0xb4b2209fbdacfe69 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec131 expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.752864:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 18 pid: 17548 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.752873:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e51f400/0xb4b2209fbdacfe69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec131 expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.752873:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 18 pid: 17548 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.752890:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147249.752891:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.752921:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1957:x1830967465584256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.752921:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1957:x1830967465583872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.752926:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7729 00000100:00100000:1.0:1746147249.753131:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7730 00000100:00100000:1.0:1746147249.753184:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7731 00000100:00100000:1.0:1746147249.753189:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465584128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.753195:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147249.753202:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 35 pid: 8478 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.753210:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 35 pid: 8478 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.753221:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b45600/0xb4b2209fbdacff8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1bd expref: 35 pid: 8478 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.753222:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7732 00000100:00100000:0.0:1746147249.753229:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465584000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.753232:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147249.753234:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.753242:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 33 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.753246:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465584128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 58us (586us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147249.753249:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 33 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.753251:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7731 00010000:00010000:0.0:1746147249.753259:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.753272:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465584000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.753276:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466987392:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147249.753277:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7732 00010000:00010000:1.0:1746147249.753284:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360400/0xb4b2209fbdacff65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec193 expref: 32 pid: 21080 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.753294:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466987520:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.753302:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e600/0xb4b2209fbdacfe5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec123 expref: 17 pid: 17548 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.753302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.753314:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465583744 00000100:00100000:0.0:1746147249.753317:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465583744 00000100:00100000:1.0:1746147249.753323:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466987648:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147249.753326:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 24 pid: 8481 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.753336:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.753338:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7733 00000100:00100000:0.0:1746147249.753342:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465583744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.753347:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.753353:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 24 pid: 8481 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.753361:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 24 pid: 8481 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.753372:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360a00/0xb4b2209fbdacff57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec185 expref: 24 pid: 8481 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.753392:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.753394:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.753398:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.753405:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.753437:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.753452:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465583744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.753456:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7733 00000100:00100000:0.0:1746147249.753557:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466988544:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147249.753566:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.753578:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466988160:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.753586:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466988288:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.753591:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466988416:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.753604:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.753616:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.753621:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.753628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.753637:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584384 00010000:00010000:1.0:1746147249.753639:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.753640:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584384 00010000:00010000:1.0:1746147249.753645:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.753648:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.753651:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.753657:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f195000 already unused, calling callback (ffffffffa07dcd70) 00000100:00100000:0.0:1746147249.753659:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7734 00010000:00010000:1.0:1746147249.753660:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.753663:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465584384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.753667:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.753668:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.753676:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.753679:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.753683:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.753684:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f195000/0xb4b2209fbdad0061 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.753692:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b45800/0xb4b2209fbdacffab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d9 expref: 32 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.753702:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.753717:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465583104:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14030us (14855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.753717:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465584384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.753722:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15251 00000100:00100000:0.0:1746147249.753722:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7734 00000100:00100000:0.0:1746147249.753746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.753762:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584640 00000100:00100000:1.0:1746147249.753765:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584640 00000100:00100000:0.0:1746147249.753768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:1.0:1746147249.753785:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (802816->933887) req@ffff88012c9f0700 x1830967465584640/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/0 e 0 to 0 dl 1746147260 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.753792:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0700 with x1830967465584640 ext(802816->933887) 00010000:00010000:1.0:1746147249.753798:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 34 pid: 4444 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.753805:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 34 pid: 4444 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746147249.753810:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f0700 00000100:00100000:1.0:1746147249.753895:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2486 00000100:00100000:1.0:1746147249.753901:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465584640:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147249.753969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.753979:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584512 00000100:00100000:0.0:1746147249.753982:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584512 00010000:00010000:0.0:1746147249.753991:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.754002:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584768 00000100:00100000:0.0:1746147249.754003:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584768 00010000:00010000:0.0:1746147249.754010:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.754019:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7735 00000100:00100000:0.0:1746147249.754023:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465584512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.754028:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.754035:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754041:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754055:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdacfe70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec13f expref: 16 pid: 8480 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746147249.754061:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7736 00010000:00010000:0.0:1746147249.754063:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.754066:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465584768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147249.754072:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147249.754073:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465584512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.754077:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7735 00010000:00010000:1.0:1746147249.754079:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.754086:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.754095:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b45000/0xb4b2209fbdacffb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1e7 expref: 23 pid: 17530 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746147249.754101:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.754103:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.754105:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.754111:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.754122:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147249.754135:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465584768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.754140:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7736 00010000:00010000:1.0:1746147249.754154:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.754173:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.754350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.754363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.754374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.754382:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465585280 00000100:00100000:0.0:1746147249.754384:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465585280 00010000:00010000:0.0:1746147249.754394:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8000/0xb4b2209fbdacfe62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec138 expref: 15 pid: 8481 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.754406:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465585408 00000100:00100000:0.0:1746147249.754408:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465585408 00010000:00010000:0.0:1746147249.754414:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 23 pid: 4444 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.754424:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465585024 00000100:00100000:0.0:1746147249.754425:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465585024 00010000:00010000:0.0:1746147249.754432:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eab2600/0xb4b2209fbdacff81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1af expref: 22 pid: 11147 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.754440:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7737 00000100:00100000:0.0:1746147249.754444:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1959:x1830967465585280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.754450:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.754461:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8000/0xb4b2209fbdacfe62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec138 expref: 15 pid: 8481 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754468:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8000/0xb4b2209fbdacfe62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec138 expref: 15 pid: 8481 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754478:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8000/0xb4b2209fbdacfe62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec138 expref: 15 pid: 8481 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754487:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.754500:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465585280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.754505:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7737 00000100:00100000:0.0:1746147249.754524:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7738 00000100:00100000:0.0:1746147249.754528:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465585408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.754533:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.754540:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 23 pid: 4444 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.754547:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 23 pid: 4444 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.754557:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b44200/0xb4b2209fbdacff96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1c4 expref: 23 pid: 4444 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.754568:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.754569:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.754571:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad0068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.754577:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad0068 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.754588:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.754599:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465585408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.754603:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7738 00000100:00100000:0.0:1746147249.754623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.754631:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465585536 00000100:00100000:0.0:1746147249.754634:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465585536 00010000:00010000:0.0:1746147249.754641:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b44c00/0xb4b2209fbdacffa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d2 expref: 36 pid: 4445 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.754652:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7740 00000100:00100000:0.0:1746147249.754656:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465585536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.754661:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.754667:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b44c00/0xb4b2209fbdacffa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d2 expref: 36 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754674:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b44c00/0xb4b2209fbdacffa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d2 expref: 36 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754687:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b44c00/0xb4b2209fbdacffa4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1d2 expref: 36 pid: 4445 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.754694:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.754991:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465585536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 332us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.754996:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7740 00000100:00100000:0.0:1746147249.755028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.755039:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465584896 00000100:00100000:0.0:1746147249.755042:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465584896 00010000:00010000:0.0:1746147249.755052:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eab3e00/0xb4b2209fbdacff7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1a8 expref: 31 pid: 11147 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746147249.755065:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7741 00000100:00100000:0.0:1746147249.755069:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465584896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.755074:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.755082:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eab3e00/0xb4b2209fbdacff7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1a8 expref: 31 pid: 11147 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.755089:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eab3e00/0xb4b2209fbdacff7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1a8 expref: 31 pid: 11147 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.755100:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eab3e00/0xb4b2209fbdacff7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec1a8 expref: 31 pid: 11147 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746147249.755112:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.755125:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465584896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.755130:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7741 00000100:00100000:0.0:1746147249.755187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.755199:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465585152 00000100:00100000:0.0:1746147249.755202:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465585152 00010000:00010000:0.0:1746147249.755212:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdacfe4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec12a expref: 15 pid: 17548 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746147249.755223:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7742 00000100:00100000:0.0:1746147249.755227:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465585152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147249.755233:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147249.755240:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdacfe4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec12a expref: 15 pid: 17548 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.755247:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdacfe4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec12a expref: 15 pid: 17548 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.755257:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdacfe4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec12a expref: 15 pid: 17548 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746147249.755265:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.755266:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.755269:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f62400/0xb4b2209fbdad007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.755279:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f62400/0xb4b2209fbdad007d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.755292:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147249.755306:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967465585152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (120us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147249.755670:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.755677:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.755683:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.755684:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7742 00010000:00010000:1.0:1746147249.755687:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eab3000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147249.755690:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.755695:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.755703:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.755709:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eab3000/0xb4b2209fbdad006f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.755739:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465583616:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15476us (16781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.755745:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15253 00000100:00100000:1.0:1746147249.759392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.761408:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465584640:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7504us (7657us total) trans 17179873941 rc 0/0 00000100:00100000:1.0:1746147249.761421:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2486 00002000:00100000:1.0:1746147249.761429:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (802816->933887) req@ffff88012c9f0700 x1830967465584640/t17179873941(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:625/0 lens 488/448 e 0 to 0 dl 1746147260 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147249.761437:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0700 with x1830967465584640 ext(802816->933887) 00010000:00010000:1.0:1746147249.761443:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 35 pid: 4444 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746147249.761454:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f63a00/0xb4b2209fbdacfff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->933887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec20a expref: 35 pid: 4444 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746147249.761463:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f0700 00000100:00100000:0.0:1746147249.764436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147249.766076:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766085:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766104:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766110:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766116:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766122:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b45200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147249.766125:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766137:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766146:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147249.766150:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b45200/0xb4b2209fbdad0076 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147249.766199:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465582976:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 25656us (26809us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.766207:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15254 00000100:00100000:0.0:1746147249.770714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.775845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.775914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.775960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.776028:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147249.814122:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945330 is committed 00000001:00080000:0.0:1746147249.814140:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945328 is committed 00000001:00080000:0.0:1746147249.814147:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945336 is committed 00000004:00080000:0.0:1746147249.814151:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2488 committed 00000004:00080000:0.0:1746147249.814169:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2481 committed 00000004:00080000:0.0:1746147249.814176:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2480 committed 00000004:00080000:0.0:1746147249.814178:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2479 committed 00000004:00080000:0.0:1746147249.814179:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2478 committed 00000004:00080000:0.0:1746147249.814181:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2487 committed 00000004:00080000:0.0:1746147249.814182:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2477 committed 00000004:00080000:0.0:1746147249.814184:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2486 committed 00000004:00080000:0.0:1746147249.814186:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2476 committed 00000004:00080000:0.0:1746147249.814187:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2485 committed 00000004:00080000:0.0:1746147249.814188:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2484 committed 00000004:00080000:0.0:1746147249.814190:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2483 committed 00000004:00080000:0.0:1746147249.814191:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2475 committed 00000004:00080000:0.0:1746147249.814192:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2474 committed 00000004:00080000:0.0:1746147249.814194:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2482 committed 00000004:00080000:0.0:1746147249.814195:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2481 committed 00000004:00080000:0.0:1746147249.814196:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2473 committed 00000001:00080000:0.0:1746147249.815868:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945333 is committed 00000001:00080000:0.0:1746147249.815875:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945332 is committed 00000100:00100000:0.0:1746147249.816114:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466990208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.817106:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466989952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.818234:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818319:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466990080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.818339:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818357:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466990336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.818374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.818380:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466990720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.818391:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466990848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.818405:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818418:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466991360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.818433:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818444:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466991872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.818459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818486:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466990208 00000100:00100000:1.0:1746147249.818494:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466990208 00000100:00100000:0.0:1746147249.818497:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.818517:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466991232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.818525:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466990080 00000100:00100000:1.0:1746147249.818527:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466990080 00000100:00100000:0.0:1746147249.818533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818536:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466990336 00000100:00100000:1.0:1746147249.818537:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466990336 00000100:00100000:0.0:1746147249.818543:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466991744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.818544:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466991360 00000100:00100000:1.0:1746147249.818545:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466991360 00000100:00100000:1.0:1746147249.818554:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466990720 00000100:00100000:0.0:1746147249.818554:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.818555:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466990720 00000100:00100000:1.0:1746147249.818564:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466991744 00000100:00100000:1.0:1746147249.818566:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466991744 00000100:00100000:1.0:1746147249.818576:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15258 00000100:00100000:1.0:1746147249.818581:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3295:x1830967466989952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.818678:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15259 00000100:00100000:0.0:1746147249.818688:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3296:x1830967466990080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.818800:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3295:x1830967466989952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (526us total) trans 21474841304 rc 0/0 00000100:00100000:1.0:1746147249.818806:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15258 00000100:00100000:1.0:1746147249.818818:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15261 00000100:00100000:1.0:1746147249.818823:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967466990848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.818911:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3296:x1830967466990080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (570us total) trans 21474841306 rc 0/0 00000100:00100000:1.0:1746147249.818918:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3294:x1830967466990848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (511us total) trans 21474841307 rc 0/0 00000100:00100000:0.0:1746147249.818918:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15259 00000100:00100000:1.0:1746147249.818925:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15261 00000100:00100000:0.0:1746147249.818964:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15263 00000100:00100000:1.0:1746147249.818971:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15264 00000100:00100000:0.0:1746147249.818972:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3294:x1830967466991872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.818975:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3293:x1830967466990720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.819042:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3293:x1830967466990720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (545us total) trans 21474841308 rc 0/0 00000100:00100000:1.0:1746147249.819045:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15264 00000100:00100000:1.0:1746147249.819053:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15266 00000100:00100000:1.0:1746147249.819056:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3293:x1830967466991744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.819078:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3294:x1830967466991872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (616us total) trans 17179873943 rc 0/0 00000100:00100000:0.0:1746147249.819083:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15263 00000004:00080000:0.0:1746147249.819117:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f1c00/2, rc 0, transno 21474841308 00000100:00100000:1.0:1746147249.819119:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3293:x1830967466991744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (564us total) trans 17179873945 rc 0/0 00000100:00100000:1.0:1746147249.819123:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15266 00000100:00100000:0.0:1746147249.819123:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466990720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147249.819132:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e91b800/2, rc 0, transno 17179873944 00000100:00100000:0.0:1746147249.819140:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466991232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.819147:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919c00/2, rc 0, transno 17179873945 00000100:00100000:0.0:1746147249.819150:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466991744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.819179:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f1500/2, rc 0, transno 21474841306 00000100:00100000:1.0:1746147249.819184:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466990080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.819190:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466990592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.819205:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147249.819213:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2a00/2, rc 0, transno 21474841309 00000100:00100000:1.0:1746147249.819216:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466991104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.819217:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466990208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.819226:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.819233:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466991616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.819241:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.819251:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147249.819252:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466991616 00000100:00100000:1.0:1746147249.819254:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466992000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.819257:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466991616 00000100:00100000:1.0:1746147249.819262:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.819277:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466992000 00000100:00100000:0.0:1746147249.819279:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466992000 00000100:00100000:1.0:1746147249.819281:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15268 00000100:00100000:1.0:1746147249.819284:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3296:x1830967466991104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.819290:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15269 00000100:00100000:0.0:1746147249.819295:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3296:x1830967466991616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.819352:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3296:x1830967466991104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (125us total) trans 17179873946 rc 0/0 00000100:00100000:1.0:1746147249.819356:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15268 00000100:00100000:1.0:1746147249.819363:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15270 00000100:00100000:1.0:1746147249.819366:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830967466992000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.819380:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3296:x1830967466991616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (136us total) trans 17179873947 rc 0/0 00000100:00100000:1.0:1746147249.819419:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3296:x1830967466992000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (155us total) trans 17179873948 rc 0/0 00000100:00100000:0.0:1746147249.819585:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15269 00000100:00100000:1.0:1746147249.819688:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15270 00000004:00080000:1.0:1746147249.819711:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e918700/2, rc 0, transno 17179873948 00000100:00100000:1.0:1746147249.819715:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466992000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.819725:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2300/2, rc 0, transno 21474841310 00000100:00100000:1.0:1746147249.819727:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466990592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147249.819732:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f1f80/2, rc 0, transno 17179873946 00000100:00100000:1.0:1746147249.819735:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466991104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.819741:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919f80/2, rc 0, transno 17179873947 00000100:00100000:1.0:1746147249.819744:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466991616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.819760:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3800/2, rc 0, transno 21474841304 00000100:00100000:1.0:1746147249.819763:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466989952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.819768:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466990464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.819786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.819806:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466990976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.819818:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.819834:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466991488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.819847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.819879:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466991488 00000100:00100000:0.0:1746147249.819882:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466991488 00000100:00100000:1.0:1746147249.819889:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15272 00000100:00100000:1.0:1746147249.819895:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3295:x1830967466990976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.819902:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15273 00000100:00100000:0.0:1746147249.819907:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3295:x1830967466991488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.820005:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+69:3295:x1830967466990976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (184us total) trans 17179873949 rc 0/0 00000100:00100000:1.0:1746147249.820014:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15272 00000100:00100000:0.0:1746147249.820019:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3295:x1830967466991488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (170us total) trans 17179873950 rc 0/0 00000100:00100000:0.0:1746147249.820025:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15273 00000004:00080000:1.0:1746147249.820035:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2680/2, rc 0, transno 21474841311 00000100:00100000:1.0:1746147249.820039:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466990464:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147249.820045:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3480/2, rc 0, transno 17179873949 00000100:00100000:1.0:1746147249.820047:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466990976:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147249.820053:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e91a680/2, rc 0, transno 17179873950 00000100:00100000:1.0:1746147249.820055:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466991488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.827985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.832812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.842628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.842667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.842695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.842710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.842725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.846099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.847780:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465587200 00000100:00100000:0.0:1746147249.847784:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465587200 00000100:00100000:0.0:1746147249.847812:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465587328 00000100:00100000:0.0:1746147249.847815:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465587328 00000100:00100000:0.0:1746147249.848051:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15274 00000100:00100000:0.0:1746147249.848059:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465586944:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147249.848073:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.848087:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec249 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147249.848105:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417b1, atime: 0x681417b1, ctime: 0x681417b1, blocks: 0x7c9 00010000:00010000:0.0:1746147249.848119:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.848120:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.848127:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147249.848138:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147249.848150:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a951a00, rc 0) 00000100:00100000:1.0:1746147249.848380:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15278 00000100:00100000:1.0:1746147249.848386:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465587456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147249.848391:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147249.848397:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec265 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147249.848406:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417b0, atime: 0x681417b0, ctime: 0x681417b0, blocks: 0x1641 00010000:00010000:1.0:1746147249.848412:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.848413:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.848416:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.848423:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147249.848428:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194800, rc 0) 00000100:00100000:0.0:1746147249.848919:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465586944:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 859us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.848925:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15274 00000100:00100000:0.0:1746147249.848948:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15279 00000100:00100000:0.0:1746147249.848953:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465587584:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147249.848959:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147249.848966:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a951c00/0xb4b2209fbdad00ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec26c expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147249.848979:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417b0, atime: 0x681417b0, ctime: 0x681417b0, blocks: 0x1029 00010000:00010000:0.0:1746147249.848987:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.848988:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147249.848993:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a951c00/0xb4b2209fbdad00ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec26c expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147249.849002:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a951c00/0xb4b2209fbdad00ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec26c expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147249.849014:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a951c00, rc 0) 00000100:00100000:0.0:1746147249.849031:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465587584:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 78us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147249.849036:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15279 00000100:00100000:1.0:1746147249.850901:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465587456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2514us (8174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.851001:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15278 00000100:00100000:0.0:1746147249.872373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.872446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.872527:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465587968 00000100:00100000:1.0:1746147249.872538:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465587968 00000100:00100000:1.0:1746147249.872599:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465588096 00000100:00100000:1.0:1746147249.872602:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465588096 00000100:00100000:1.0:1746147249.872621:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7201 00000100:00100000:1.0:1746147249.872628:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1958:x1830967465587968:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147249.872663:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.872678:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.872680:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147249.872686:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.872698:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.893727:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.893744:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.894240:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.894248:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f195800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147249.894252:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.894260:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.894307:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.894363:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f195800/0xb4b2209fbdad00d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.894465:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:1958:x1830967465587968:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 21832us (22531us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147249.894475:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7201 00000100:00100000:0.0:1746147249.952812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.952845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.952877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.952902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.952915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.953007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147249.953035:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465589888 00000100:00100000:0.0:1746147249.953043:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465589888 00000100:00100000:0.0:1746147249.953078:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465590144 00000100:00100000:0.0:1746147249.953080:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465590144 00000100:00100000:0.0:1746147249.953091:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465590400 00000100:00100000:0.0:1746147249.953093:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465590400 00000100:00100000:0.0:1746147249.953102:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465589760 00000100:00100000:0.0:1746147249.953103:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465589760 00000100:00100000:0.0:1746147249.953111:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465590016 00000100:00100000:0.0:1746147249.953113:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465590016 00000100:00100000:0.0:1746147249.953118:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465590272 00000100:00100000:0.0:1746147249.953120:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465590272 00000100:00100000:0.0:1746147249.953129:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15280 00000100:00100000:0.0:1746147249.953137:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465589888:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:1.0:1746147249.953220:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15281 00000100:00100000:1.0:1746147249.953227:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465590144:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147249.953338:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147249.953338:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147249.953341:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953341:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953343:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953343:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953345:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953345:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953346:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:0.0:1746147249.953346:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147249.953392:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465589888:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 255us (584us total) trans 21474841312 rc 0/0 00000100:00100000:0.0:1746147249.953398:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15280 00000100:00100000:0.0:1746147249.953412:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15282 00000100:00100000:0.0:1746147249.953418:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465590400:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147249.953482:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147249.953484:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953486:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953493:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953495:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147249.953776:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465590144:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 548us (928us total) trans 17179873951 rc 0/0 00000100:00100000:0.0:1746147249.953776:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465590400:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 356us (897us total) trans 21474841313 rc 0/0 00000100:00100000:1.0:1746147249.953781:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15281 00000100:00100000:0.0:1746147249.953783:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15282 00000100:00100000:1.0:1746147249.953791:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15284 00000100:00100000:0.0:1746147249.953793:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15285 00000100:00100000:1.0:1746147249.953795:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465590016:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:0.0:1746147249.953797:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465590272:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147249.953855:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147249.953857:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953859:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953860:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147249.953861:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953862:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147248 -> 1746147249 00002000:00010000:0.0:1746147249.953862:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00002000:00010000:1.0:1746147249.953864:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953867:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147248 -> 1746147249 00002000:00010000:1.0:1746147249.953869:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147249.953879:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465590272:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 81us (873us total) trans 17179873953 rc 0/0 00000100:00100000:1.0:1746147249.953880:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465590016:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 86us (965us total) trans 21474841314 rc 0/0 00000100:00100000:0.0:1746147249.953884:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15285 00000100:00100000:1.0:1746147249.953886:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15284 00000100:00100000:0.0:1746147249.955558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.955609:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465590656 00000100:00100000:1.0:1746147249.955616:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465590656 00000100:00100000:1.0:1746147249.955656:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4723 00000100:00100000:1.0:1746147249.955662:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31679:x1830967465590656:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:1.0:1746147249.955743:0:16234:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x39b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdad0053 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec234 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.955787:0:16234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3800/0xb4b2209fbdad0110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16234 initiator: MDT0 00010000:00010000:1.0:1746147249.955799:0:16234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5764a00/0xb4b2209fbdad0092 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec23b expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.955806:0:16234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3800/0xb4b2209fbdad0110 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16234 initiator: MDT0 00010000:00010000:1.0:1746147249.955834:0:16234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5764a00/0xb4b2209fbdad0092 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec23b expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.955843:0:16234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5764a00/0xb4b2209fbdad0092 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec23b expref: 9 pid: 14049 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746147249.955853:0:16234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16234:1830967466992128:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147249.955959:0:16234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147249.956991:0:16234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16234:1830967466992128:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147249.957009:0:16234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3800/0xb4b2209fbdad0110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00000100:00100000:0.0:1746147249.957168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147249.957487:0:16234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3800/0xb4b2209fbdad0110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00010000:00010000:0.0:1746147249.957743:0:16234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3800/0xb4b2209fbdad0110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00000040:00080000:1.0:1746147249.958507:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3359, 88 off281080 00000004:00080000:1.0:1746147249.958514:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945576225ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958583:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3362, 88 off281344 00000004:00080000:1.0:1746147249.958588:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945650994ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958615:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3363, 88 off281432 00000004:00080000:1.0:1746147249.958618:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945680486ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958625:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3360, 88 off281168 00000004:00080000:1.0:1746147249.958628:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945690790ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958634:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3361, 88 off281256 00000004:00080000:1.0:1746147249.958637:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945699913ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958644:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3364, 88 off281520 00000004:00080000:1.0:1746147249.958646:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945708649ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958652:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3365, 88 off281608 00000004:00080000:1.0:1746147249.958654:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945716938ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958660:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3366, 88 off281696 00000004:00080000:1.0:1746147249.958663:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945725624ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958669:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3362, 88 off281344 00000004:00080000:1.0:1746147249.958672:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945734935ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958678:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3367, 88 off281784 00000004:00080000:1.0:1746147249.958681:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945743493ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958686:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3363, 88 off281432 00000004:00080000:1.0:1746147249.958689:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945751473ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958694:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3368, 88 off281872 00000004:00080000:1.0:1746147249.958697:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945760266ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147249.958704:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3364, 88 off281520 00000004:00080000:1.0:1746147249.958706:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945769323ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958712:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3365, 88 off281608 00000004:00080000:1.0:1746147249.958715:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945778059ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958721:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3366, 88 off281696 00000004:00080000:1.0:1746147249.958724:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945786656ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958730:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3367, 88 off281784 00000004:00080000:1.0:1746147249.958734:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636945796814ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147249.958741:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3369, 88 off281960 00000004:00080000:1.0:1746147249.958744:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636945806370ns, next at 607576201812ns, rc = 0 00000004:00010000:1.0:1746147249.976267:0:16234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880134f84700 reply state ffff88012d3cbc00 transno 8589945338 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eab3800/0xb4b2209fbdad0110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00000100:00100000:1.0:1746147249.976282:0:16234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147249.976292:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473200) 00010000:00010000:1.0:1746147249.976295:0:16234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147249.976304:0:16234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdad0053 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec234 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147249.976415:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31679:x1830967465590656:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 20751us (20859us total) trans 8589945338 rc 0/0 00000100:00100000:1.0:1746147249.976425:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4723 00000001:00080000:0.0:1746147249.976741:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945338 is committed 00000004:00080000:0.0:1746147249.976747:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2496 committed 00000004:00080000:0.0:1746147249.976753:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2490 committed 00000004:00080000:0.0:1746147249.976760:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2489 committed 00000004:00080000:0.0:1746147249.976762:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2488 committed 00000004:00080000:0.0:1746147249.976764:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2487 committed 00000004:00080000:0.0:1746147249.976766:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2495 committed 00000004:00080000:0.0:1746147249.976767:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2486 committed 00000004:00080000:0.0:1746147249.976769:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2494 committed 00000004:00080000:0.0:1746147249.976770:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2485 committed 00000004:00080000:0.0:1746147249.976772:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2493 committed 00000004:00080000:0.0:1746147249.976778:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2492 committed 00000004:00080000:0.0:1746147249.976779:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2491 committed 00000004:00080000:0.0:1746147249.976781:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2484 committed 00000004:00080000:0.0:1746147249.976783:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2483 committed 00000004:00080000:0.0:1746147249.976784:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2490 committed 00000004:00080000:0.0:1746147249.976786:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2489 committed 00000004:00080000:0.0:1746147249.976788:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2482 committed 00000100:00100000:0.0:1746147249.976901:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466992640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.976967:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977003:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466993152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.977019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977035:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147249.977041:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466992256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.977056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977070:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466992768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.977091:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466992384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.977620:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977636:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466992896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.977651:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977664:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466993408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.977678:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977684:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466993920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.977695:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977702:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147249.977706:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466993536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.977922:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977931:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466994048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.977960:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.977978:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466992384 00000100:00100000:0.0:1746147249.977981:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466992384 00000100:00100000:0.0:1746147249.977993:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466992896 00000100:00100000:0.0:1746147249.977994:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466992896 00000100:00100000:0.0:1746147249.977999:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466993408 00000100:00100000:0.0:1746147249.978000:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466993408 00000100:00100000:0.0:1746147249.978006:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466993920 00000100:00100000:0.0:1746147249.978008:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466993920 00000100:00100000:0.0:1746147249.978013:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466993536 00000100:00100000:0.0:1746147249.978014:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466993536 00000100:00100000:0.0:1746147249.978020:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466994048 00000100:00100000:0.0:1746147249.978021:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466994048 00000100:00100000:0.0:1746147249.978027:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466993024 00000100:00100000:0.0:1746147249.978029:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466993024 00000100:00100000:0.0:1746147249.978037:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15287 00000100:00100000:0.0:1746147249.978042:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3295:x1830967466993152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.978141:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466993280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.978146:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3295:x1830967466993152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (1125us total) trans 17179873955 rc 0/0 00000100:00100000:0.0:1746147249.978168:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15287 00000100:00100000:1.0:1746147249.978177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147249.978180:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466993280 00000100:00100000:0.0:1746147249.978182:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466993280 00000100:00100000:1.0:1746147249.978193:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466993792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.978193:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15289 00000100:00100000:0.0:1746147249.978197:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3294:x1830967466992512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.978209:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.978218:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147249.978222:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466993664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.978235:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.978242:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466994176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147249.978254:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.978273:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466993664 00002000:00010000:0.0:1746147249.978273:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00000100:00100000:1.0:1746147249.978276:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466993664 00002000:00010000:0.0:1746147249.978276:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147249.978278:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147249.978280:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147249.978282:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746147249.978289:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15291 00000100:00100000:1.0:1746147249.978294:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+75:3293:x1830967466992896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.978308:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3294:x1830967466992512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (1225us total) trans 17179873957 rc 0/0 00000100:00100000:0.0:1746147249.978315:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15289 00000100:00100000:0.0:1746147249.978327:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15293 00000100:00100000:0.0:1746147249.978332:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3293:x1830967466993920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147249.978419:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147249.978422:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147249.978424:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147249.978425:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147249.978427:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147249.978457:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:3293:x1830967466993920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (760us total) trans 21474841316 rc 0/0 00000100:00100000:0.0:1746147249.978464:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15293 00000100:00100000:0.0:1746147249.978478:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15296 00000100:00100000:0.0:1746147249.978483:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3294:x1830967466993024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.978514:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3293:x1830967466992896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (861us total) trans 17179873959 rc 0/0 00000100:00100000:1.0:1746147249.978520:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15291 00000100:00100000:1.0:1746147249.978532:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15297 00000100:00100000:1.0:1746147249.978537:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:3296:x1830967466993280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.978569:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3294:x1830967466993024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (545us total) trans 17179873960 rc 0/0 00000100:00100000:0.0:1746147249.978575:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15296 00000100:00100000:0.0:1746147249.978586:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15300 00000100:00100000:0.0:1746147249.978591:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3296:x1830967466994176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147249.978613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147249.978616:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147249.978619:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:1.0:1746147249.978620:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:1.0:1746147249.978622:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:1.0:1746147249.978624:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147249.978647:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:3296:x1830967466993280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (470us total) trans 21474841319 rc 0/0 00000004:00080000:0.0:1746147249.978650:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f85880/2, rc 0, transno 17179873954 00000100:00100000:1.0:1746147249.978655:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15297 00000100:00100000:0.0:1746147249.978659:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466992640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.978667:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f30700/2, rc 0, transno 17179873955 00000100:00100000:0.0:1746147249.978669:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466993152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.978679:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f86680/2, rc 0, transno 17179873956 00000100:00100000:0.0:1746147249.978682:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466992256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.978716:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147249.978722:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466994304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147249.978742:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147249.978746:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+69:3296:x1830967466994176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (490us total) trans 21474841322 rc 0/0 00000100:00100000:1.0:1746147249.978752:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15300 00000100:00100000:1.0:1746147249.978760:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466994304 00000004:00080000:0.0:1746147249.978761:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f84e00/2, rc 0, transno 17179873961 00000100:00100000:1.0:1746147249.978763:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466994304 00000100:00100000:0.0:1746147249.978764:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466992768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.978778:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15302 00000100:00100000:1.0:1746147249.978782:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3295:x1830967466994304:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147249.978872:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f32a00/2, rc 0, transno 17179873962 00000100:00100000:0.0:1746147249.978876:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466994304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147249.979072:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3295:x1830967466994304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (328us total) trans 17179873962 rc 0/0 00000100:00100000:1.0:1746147249.979077:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15302 00002000:00010000:1.0:1746147249.979111:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147249.979114:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:1.0:1746147249.979116:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:1.0:1746147249.979117:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:1.0:1746147249.979119:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147249.979404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.979438:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3293:x1830967466992384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1091us (1711us total) trans 17179873958 rc 0/0 00000100:00100000:1.0:1746147249.979443:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15290 00000100:00100000:1.0:1746147249.979458:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465590912 00000100:00100000:1.0:1746147249.979461:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465590912 00000100:00100000:1.0:1746147249.979481:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11360 00000100:00100000:1.0:1746147249.979487:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:31679:x1830967465590912:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147249.979504:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147249.979520:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec273 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.979563:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec273 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.979580:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec273 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147249.979670:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147249.979673:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147249.979675:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dcc800, rc 0) 00000100:00100000:1.0:1746147249.979713:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31679:x1830967465590912:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 226us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147249.979718:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11360 00000100:00100000:0.0:1746147249.984535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147249.984755:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465591168 00000100:00100000:1.0:1746147249.984765:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465591168 00000100:00100000:1.0:1746147249.984815:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4724 00000100:00100000:1.0:1746147249.984821:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31679:x1830967465591168:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147249.985121:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31679:x1830967465591168:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 298us (594us total) trans 8589945339 rc 0/0 00000100:00100000:1.0:1746147249.985128:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4724 00000100:00100000:0.0:1746147250.005896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.006328:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465591424 00000100:00100000:1.0:1746147250.006339:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465591424 00000100:00100000:1.0:1746147250.006420:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11361 00000100:00100000:1.0:1746147250.006429:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+300:31686:x1830967465591424:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.006454:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.006472:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad011e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec27a expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.006574:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006586:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006598:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006611:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006616:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006620:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006722:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006728:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006734:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147250.006742:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147250.006829:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006835:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006840:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006845:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129dcda00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.006849:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006855:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006865:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147250.006868:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.006871:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006876:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcda00/0xb4b2209fbdad0125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006892:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006896:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006901:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006904:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129dcdc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.006906:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006910:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006915:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6600) 00010000:00010000:1.0:1746147250.006916:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.006918:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006922:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcdc00/0xb4b2209fbdad012c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.006983:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad011e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec27a expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.006994:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec27a expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.007000:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.007001:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147250.007003:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dcde00, rc 0) 00000100:00100000:1.0:1746147250.007054:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31686:x1830967465591424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 627us (1168us total) trans 8589945340 rc 0/0 00000100:00100000:1.0:1746147250.007061:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11361 00000100:00100000:1.0:1746147250.010458:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465591552 00000100:00100000:1.0:1746147250.010468:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465591552 00000100:00100000:1.0:1746147250.010532:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15303 00000100:00100000:1.0:1746147250.010539:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:31686:x1830967465591552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.010563:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.010581:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec281 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.010610:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.010612:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.010619:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.010633:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.010647:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dcda00, rc 0) 00000100:00100000:1.0:1746147250.010694:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:31686:x1830967465591552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 156us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.010700:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15303 00000100:00100000:0.0:1746147250.011733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.011921:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465591808 00000100:00100000:1.0:1746147250.011927:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465591808 00000100:00100000:1.0:1746147250.011979:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465592064 00000100:00100000:1.0:1746147250.011982:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465592064 00000100:00100000:1.0:1746147250.012015:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11362 00000100:00100000:1.0:1746147250.012021:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31689:x1830967465591808:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147250.012039:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.012053:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc000/0xb4b2209fbdad0148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec288 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.012813:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.012822:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec27a expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.012907:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a951800/0xb4b2209fbdad0164 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147250.012911:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.012925:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a951800/0xb4b2209fbdad0164 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147250.012972:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec27a expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.012983:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad0133 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec27a expref: 303 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.012995:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994432:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.013083:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.015922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.016038:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994432:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.016057:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.021576:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.021585:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147250.021603:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147250.021744:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc000/0xb4b2209fbdad0148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec288 expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.021777:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec288 expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.021784:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.021786:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147250.021789:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd84000, rc 0) 00000100:00100000:1.0:1746147250.021827:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31689:x1830967465591808:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9805us (10581us total) trans 8589945342 rc 0/0 00000100:00100000:1.0:1746147250.021833:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11362 00000100:00100000:1.0:1746147250.023927:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465592576 00000100:00100000:1.0:1746147250.024139:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465592576 00000100:00100000:1.0:1746147250.024201:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11364 00000100:00100000:1.0:1746147250.024209:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31691:x1830967465592576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.024231:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.024253:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84800/0xb4b2209fbdad0180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec296 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.024860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147250.025053:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025083:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025093:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025107:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025112:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025116:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025248:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84e00/0xb4b2209fbdad0195 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025256:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84e00/0xb4b2209fbdad0195 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025263:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84e00/0xb4b2209fbdad0195 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147250.025271:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147250.025372:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025378:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025384:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025396:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd84a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.025399:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025409:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025423:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147250.025426:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.025429:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025434:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad0187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025450:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025455:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025464:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025468:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd84c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.025470:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025479:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025484:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6100) 00010000:00010000:1.0:1746147250.025486:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.025488:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025492:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad018e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.025535:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84800/0xb4b2209fbdad0180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec296 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.025553:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84e00/0xb4b2209fbdad0195 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec296 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.025559:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.025560:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147250.025563:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd84e00, rc 0) 00000100:00100000:1.0:1746147250.025616:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31691:x1830967465592576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1408us (1860us total) trans 8589945343 rc 0/0 00000100:00100000:1.0:1746147250.025623:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11364 00000100:00100000:0.0:1746147250.039230:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465592960 00000100:00100000:0.0:1746147250.039239:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465592960 00000100:00100000:0.0:1746147250.039446:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15304 00000100:00100000:0.0:1746147250.039456:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31691:x1830967465592960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.039475:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.039491:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec29d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.039517:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.039519:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.039527:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.039542:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.039552:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e51f600, rc 0) 00000100:00100000:0.0:1746147250.039597:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31691:x1830967465592960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 143us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.039602:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15304 00000100:00100000:0.0:1746147250.057100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.057195:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.057274:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465593344 00000100:00100000:1.0:1746147250.057285:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465593344 00000100:00100000:1.0:1746147250.057358:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15305 00000100:00100000:1.0:1746147250.057367:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:31686:x1830967465593344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.057385:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.057403:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2a4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.057430:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.057432:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.057440:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2a4 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.057457:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2a4 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.057468:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd85000, rc 0) 00000100:00100000:1.0:1746147250.057516:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:31686:x1830967465593344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.057522:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15305 00000100:00080000:1.0:1746147250.057552:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147250.064425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.064509:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465593472 00000100:00100000:1.0:1746147250.064519:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465593472 00000100:00100000:1.0:1746147250.064567:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11365 00000100:00100000:1.0:1746147250.064574:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31686:x1830967465593472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.064598:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.064621:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2ab expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.064681:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.064694:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.064711:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.064714:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147250.064717:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd85200, rc 0) 00000100:00100000:1.0:1746147250.064779:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31686:x1830967465593472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 205us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.064785:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11365 00000100:00100000:0.0:1746147250.078030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.078104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.078154:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465593984 00000100:00100000:1.0:1746147250.078171:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465593984 00000100:00100000:1.0:1746147250.078221:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11366 00000100:00100000:1.0:1746147250.078228:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31687:x1830967465593984:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147250.078249:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.078253:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147250.078275:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84e00/0xb4b2209fbdad0195 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec296 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.078295:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.078299:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147250.078310:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85400/0xb4b2209fbdad01b8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2b2 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.078352:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.078363:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec273 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.078370:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.078376:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.078403:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.078414:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 303 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.078424:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994560:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.078497:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec273 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.078505:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec273 expref: 7 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.078511:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994688:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.078529:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183e900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.093038:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994560:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.093216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.093322:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994688:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.093351:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147250.093985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.094013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.094235:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465594240 00000100:00100000:1.0:1746147250.094241:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465594240 00010000:00010000:1.0:1746147250.094271:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 304 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.094294:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465594368 00000100:00100000:1.0:1746147250.094296:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465594368 00010000:00010000:1.0:1746147250.094315:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcc800/0xb4b2209fbdad0117 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec273 expref: 8 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.094328:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7752 00000100:00100000:1.0:1746147250.094333:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967465594240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.094346:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.094351:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 304 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.094361:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 304 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.094380:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85200/0xb4b2209fbdad01b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ab expref: 304 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.094397:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.094402:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.094408:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.094415:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.094448:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967465594240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.094455:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7752 00000100:00100000:1.0:1746147250.105457:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465594496 00000100:00100000:1.0:1746147250.105467:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465594496 00000100:00100000:1.0:1746147250.105518:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11367 00000100:00100000:1.0:1746147250.105525:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31691:x1830967465594496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.105541:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.105556:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2c0 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.105598:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.105605:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.105618:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.105627:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.105636:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.105639:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147250.105641:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.105651:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd85800, rc 0) 00000100:00100000:1.0:1746147250.105715:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31691:x1830967465594496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 190us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.105720:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11367 00000100:00100000:0.0:1746147250.107263:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465594752 00000100:00100000:0.0:1746147250.107270:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465594752 00000100:00100000:0.0:1746147250.107321:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11368 00000100:00100000:0.0:1746147250.107327:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31686:x1830967465594752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.107339:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.107351:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2ce expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.107389:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ce expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.107398:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ce expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.107406:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.107408:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147250.107411:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.107416:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ed3a00, rc 0) 00000100:00100000:0.0:1746147250.107451:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31686:x1830967465594752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.107456:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11368 00010000:00010000:0.0:1746147250.144481:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b2 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144499:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.144502:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147250.144506:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144514:0:14125:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144520:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144526:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ce expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144531:0:14125:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ce expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144535:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ce expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.144563:0:14125:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ed3a00/0xb4b2209fbdad01db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ce expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.144572:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994816:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147250.144640:0:14125:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.144649:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466994944:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147250.144663:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000001:00080000:0.0:1746147250.144676:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945343 is committed 00000001:00080000:0.0:1746147250.144689:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945342 is committed 00000001:00080000:0.0:1746147250.144694:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945339 is committed 00000001:00080000:0.0:1746147250.144698:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945344 is committed 00000004:00080000:0.0:1746147250.144701:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2504 committed 00000004:00080000:0.0:1746147250.144707:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2499 committed 00000004:00080000:0.0:1746147250.144711:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2498 committed 00000004:00080000:0.0:1746147250.144713:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2497 committed 00000004:00080000:0.0:1746147250.144714:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2496 committed 00000004:00080000:0.0:1746147250.144715:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2503 committed 00000004:00080000:0.0:1746147250.144717:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2495 committed 00000004:00080000:0.0:1746147250.144718:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2502 committed 00000004:00080000:0.0:1746147250.144719:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2494 committed 00000004:00080000:0.0:1746147250.144721:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2501 committed 00000004:00080000:0.0:1746147250.144722:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2500 committed 00000004:00080000:0.0:1746147250.144723:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2499 committed 00000004:00080000:0.0:1746147250.144724:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2493 committed 00000004:00080000:0.0:1746147250.144726:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2492 committed 00000004:00080000:0.0:1746147250.144728:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2498 committed 00000004:00080000:0.0:1746147250.144729:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2497 committed 00000004:00080000:0.0:1746147250.144730:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2491 committed 00000100:00100000:0.0:1746147250.144971:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466995072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.144999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145014:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466995584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145026:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145035:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466996096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145048:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145057:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466996608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145068:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145081:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147250.145085:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466995200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145097:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145105:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466995712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145116:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145124:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466996224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145134:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145142:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466996736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145154:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145182:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466995328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145196:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145206:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466995840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145216:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145224:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466996352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145241:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466996864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145258:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746147250.145262:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466995456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145278:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145288:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466995968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.145300:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145306:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466996480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145318:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145324:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466996992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.145334:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.145352:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995072 00000100:00100000:0.0:1746147250.145357:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995072 00000100:00100000:0.0:1746147250.145378:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995584 00000100:00100000:0.0:1746147250.145379:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995584 00000100:00100000:0.0:1746147250.145385:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996096 00000100:00100000:0.0:1746147250.145386:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996096 00000100:00100000:0.0:1746147250.145393:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996608 00000100:00100000:0.0:1746147250.145394:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996608 00000100:00100000:0.0:1746147250.145400:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995200 00000100:00100000:0.0:1746147250.145401:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995200 00000100:00100000:0.0:1746147250.145406:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995712 00000100:00100000:0.0:1746147250.145407:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995712 00000100:00100000:0.0:1746147250.145412:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996224 00000100:00100000:0.0:1746147250.145414:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996224 00000100:00100000:0.0:1746147250.145418:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996736 00000100:00100000:0.0:1746147250.145420:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996736 00000100:00100000:0.0:1746147250.145425:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995328 00000100:00100000:0.0:1746147250.145426:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995328 00000100:00100000:0.0:1746147250.145431:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995840 00000100:00100000:0.0:1746147250.145432:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995840 00000100:00100000:0.0:1746147250.145438:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996352 00000100:00100000:0.0:1746147250.145440:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996352 00000100:00100000:0.0:1746147250.145445:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996864 00000100:00100000:0.0:1746147250.145447:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996864 00000100:00100000:0.0:1746147250.145452:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995456 00000100:00100000:0.0:1746147250.145454:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995456 00000100:00100000:0.0:1746147250.145460:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466995968 00000100:00100000:0.0:1746147250.145462:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466995968 00000100:00100000:0.0:1746147250.145467:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996480 00000100:00100000:0.0:1746147250.145468:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996480 00000100:00100000:0.0:1746147250.145473:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466996992 00000100:00100000:0.0:1746147250.145475:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466996992 00000100:00100000:0.0:1746147250.145482:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15308 00000100:00100000:0.0:1746147250.145487:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3293:x1830967466995072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147250.145747:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147250.145750:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.145752:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.145755:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.145757:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147250.148384:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3293:x1830967466995072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2890us (3378us total) trans 21474841323 rc 0/0 00000100:00100000:0.0:1746147250.148394:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15308 00000100:00100000:0.0:1746147250.148419:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15309 00000100:00100000:0.0:1746147250.148425:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3293:x1830967466995584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.148582:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3293:x1830967466995584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (3554us total) trans 21474841324 rc 0/0 00000100:00100000:0.0:1746147250.148587:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15309 00000100:00100000:0.0:1746147250.148595:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15310 00000100:00100000:0.0:1746147250.148599:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+84:3293:x1830967466996096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147250.148684:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147250.148687:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.148689:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.148691:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.148693:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:0.0:1746147250.148716:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3293:x1830967466996096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (3666us total) trans 17179873963 rc 0/0 00000100:00100000:0.0:1746147250.148720:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15310 00000100:00100000:0.0:1746147250.148729:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15311 00000100:00100000:0.0:1746147250.148733:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+84:3293:x1830967466996608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.148802:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3293:x1830967466996608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (3732us total) trans 17179873964 rc 0/0 00000100:00100000:0.0:1746147250.148806:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15311 00000100:00100000:0.0:1746147250.148813:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15312 00000100:00100000:0.0:1746147250.148817:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3293:x1830967466995200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147250.149144:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147250.149147:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.149148:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.149150:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.149151:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147250.149179:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3293:x1830967466995200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 361us (4081us total) trans 21474841325 rc 0/0 00000100:00100000:0.0:1746147250.149183:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15312 00000100:00100000:0.0:1746147250.149191:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15313 00000100:00100000:0.0:1746147250.149195:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3293:x1830967466995712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147250.149725:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147250.149728:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147250.149730:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147250.149731:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147250.149734:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147250.149755:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3293:x1830967466995712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 559us (4638us total) trans 21474841326 rc 0/0 00000100:00100000:0.0:1746147250.149760:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15313 00000100:00100000:0.0:1746147250.149770:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15314 00000100:00100000:0.0:1746147250.149774:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+84:3293:x1830967466996224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147250.150655:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147250.150658:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.150660:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.150662:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.150663:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147250.151517:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466997120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147250.151548:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147250.154061:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465594880 00000100:00100000:1.0:1746147250.154071:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465594880 00000100:00100000:1.0:1746147250.154107:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465595008 00000100:00100000:1.0:1746147250.154109:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465595008 00000100:00100000:1.0:1746147250.154126:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4725 00000100:00100000:1.0:1746147250.154132:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31691:x1830967465594880:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147250.154246:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31691:x1830967465594880:12345-192.168.203.36@tcp:49:cat.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.154252:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4725 00000100:00100000:1.0:1746147250.154306:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465595136 00000100:00100000:1.0:1746147250.154309:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465595136 00000100:00100000:1.0:1746147250.154326:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11369 00000100:00100000:1.0:1746147250.154331:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31689:x1830967465595136:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147250.154339:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.154352:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad01e2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2d5 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.154383:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad01e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2d5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.154656:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84c00/0xb4b2209fbdad01e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2d5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.154672:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.154675:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147250.154677:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd84c00, rc 0) 00000100:00100000:1.0:1746147250.154695:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31689:x1830967465595136:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 364us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.154700:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11369 00000100:00100000:0.0:1746147250.156749:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3293:x1830967466996224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6968us (11607us total) trans 17179873965 rc 0/0 00000100:00100000:0.0:1746147250.156758:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15314 00000100:00100000:0.0:1746147250.157116:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466997120 00000100:00100000:0.0:1746147250.157121:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466997120 00000100:00100000:0.0:1746147250.157140:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15315 00000100:00100000:0.0:1746147250.157145:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3293:x1830967466996736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.157313:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3293:x1830967466996736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (12156us total) trans 17179873966 rc 0/0 00000100:00100000:0.0:1746147250.157318:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15315 00000100:00100000:0.0:1746147250.157328:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15316 00000100:00100000:0.0:1746147250.157333:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3295:x1830967466995328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147250.157523:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147250.157527:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.157529:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.157531:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.157532:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147250.157558:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3295:x1830967466995328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (12360us total) trans 21474841327 rc 0/0 00000100:00100000:0.0:1746147250.157563:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15316 00000100:00100000:0.0:1746147250.157572:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15317 00000100:00100000:0.0:1746147250.157576:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3295:x1830967466995840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.157654:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3295:x1830967466995840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (12436us total) trans 21474841328 rc 0/0 00000100:00100000:0.0:1746147250.157659:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15317 00000100:00100000:0.0:1746147250.157670:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15318 00000100:00100000:0.0:1746147250.157674:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830967466996352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147250.157741:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147250.157744:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.157745:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.157747:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147249 -> 1746147249 00002000:00010000:0.0:1746147250.157749:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746147250.157767:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3295:x1830967466996352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (12530us total) trans 17179873967 rc 0/0 00000100:00100000:0.0:1746147250.157772:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15318 00000100:00100000:0.0:1746147250.157781:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15319 00000100:00100000:0.0:1746147250.157785:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830967466996864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.157859:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3295:x1830967466996864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (12606us total) trans 17179873968 rc 0/0 00000100:00100000:0.0:1746147250.157864:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15319 00000100:00100000:0.0:1746147250.157874:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15320 00000100:00100000:0.0:1746147250.157878:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3295:x1830967466995456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.157982:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3295:x1830967466995456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (12703us total) trans 21474841329 rc 0/0 00000100:00100000:0.0:1746147250.157988:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15320 00000100:00100000:0.0:1746147250.157998:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15321 00000100:00100000:0.0:1746147250.158002:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3295:x1830967466995968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.158076:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3295:x1830967466995968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (12775us total) trans 21474841330 rc 0/0 00000100:00100000:0.0:1746147250.158081:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15321 00000100:00100000:0.0:1746147250.158091:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15322 00000100:00100000:0.0:1746147250.158095:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830967466996480:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147250.161084:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134ed7b80/2, rc 0, transno 17179873965 00000100:00100000:1.0:1746147250.161093:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466996224:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147250.161104:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d78a80/2, rc 0, transno 17179873966 00000100:00100000:1.0:1746147250.161106:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466996736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147250.164630:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046d80/2, rc 0, transno 17179873971 00000100:00100000:1.0:1746147250.164636:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466997120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.170396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.170418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.170443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.170479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.170497:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465596160 00000100:00100000:0.0:1746147250.170503:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465596160 00010000:00010000:0.0:1746147250.170535:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a951c00/0xb4b2209fbdad00ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec26c expref: 18 pid: 8480 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.170555:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7754 00000100:00100000:0.0:1746147250.170561:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1957:x1830967465596160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.170571:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.170589:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a951c00/0xb4b2209fbdad00ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec26c expref: 18 pid: 8480 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.170599:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a951c00/0xb4b2209fbdad00ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec26c expref: 18 pid: 8480 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.170620:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.170622:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.170627:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.170634:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.170661:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.170671:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466997376:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147250.170726:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00080000:0.0:1746147250.170737:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147250.176086:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466997376:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147250.176098:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.176123:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465596160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5561us (5678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.176130:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7754 00000100:00100000:0.0:1746147250.178092:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466997504:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.178104:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466997632:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.178126:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.178149:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dcd200, rc 0) 00000100:00100000:0.0:1746147250.178186:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31687:x1830967465596288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5743us (7705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.178193:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15326 00000100:00100000:0.0:1746147250.178665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.178716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.178733:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465596672 00000100:00100000:0.0:1746147250.178737:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465596672 00010000:00010000:0.0:1746147250.178756:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdad00a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec257 expref: 17 pid: 8481 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.178773:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7755 00000100:00100000:0.0:1746147250.178778:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465596672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.178788:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.178803:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdad00a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec257 expref: 17 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.178821:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdad00a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec257 expref: 17 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.178837:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e800/0xb4b2209fbdad00a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec257 expref: 17 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.178853:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.178870:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1957:x1830967465596672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.178875:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7755 00000100:00100000:0.0:1746147250.197956:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465596800 00000100:00100000:0.0:1746147250.197962:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465596800 00000100:00100000:0.0:1746147250.197999:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15327 00000100:00100000:0.0:1746147250.198006:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:31689:x1830967465596800:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147250.198018:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.198030:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2ea expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.198052:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.198059:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.198061:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.198064:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.198087:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.198097:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 16 pid: 4444 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.198112:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466997760:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.198630:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.205407:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465596928 00000100:00100000:1.0:1746147250.205413:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465596928 00000100:00100000:1.0:1746147250.205446:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15328 00000100:00100000:1.0:1746147250.205453:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31691:x1830967465596928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.205467:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.205484:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad01fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2f1 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.205504:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.205510:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.205516:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147250.205519:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad01fe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f1 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.205603:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466997760:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.205621:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.205631:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064800, rc 0) 00010000:00010000:1.0:1746147250.205635:0:17530:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.205643:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd84a00/0xb4b2209fbdad01fe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f1 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.205650:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd84a00, rc 0) 00000100:00100000:1.0:1746147250.205768:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31691:x1830967465596928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 315us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.205774:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15328 00000100:00100000:0.0:1746147250.205849:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:31689:x1830967465596800:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7843us (8271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.205854:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15327 00000100:00100000:1.0:1746147250.209490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.209530:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.209579:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465597056 00000100:00100000:0.0:1746147250.209585:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465597056 00010000:00010000:0.0:1746147250.209617:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 17 pid: 4444 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.209638:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7756 00000100:00100000:0.0:1746147250.209644:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465597056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.209653:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.209678:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 17 pid: 4444 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.209687:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 17 pid: 4444 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.209709:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f194800/0xb4b2209fbdad00c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec265 expref: 17 pid: 4444 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.209719:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.209721:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.209726:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.209734:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.209757:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.209767:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466998016:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147250.209827:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.209840:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465597184 00000100:00100000:0.0:1746147250.209842:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465597184 00000100:00100000:0.0:1746147250.209859:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15329 00000100:00100000:0.0:1746147250.209863:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:31686:x1830967465597184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.209873:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.209881:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2f8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.209892:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.209893:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.209897:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 37 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.209905:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 37 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.209912:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369afc00, rc 0) 00000100:00100000:0.0:1746147250.209934:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:31686:x1830967465597184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.209957:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15329 00000100:00080000:1.0:1746147250.210170:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147250.214317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.220012:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466998016:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147250.220024:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.220055:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1957:x1830967465597056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10410us (10569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.220061:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7756 00000100:00100000:1.0:1746147250.220185:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465597824 00000100:00100000:1.0:1746147250.220189:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465597824 00002000:00100000:1.0:1746147250.220210:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4825088->4829183) req@ffff88009f668000 x1830967465597824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.220217:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668000 with x1830967465597824 ext(4825088->4829183) 00002000:00010000:1.0:1746147250.220221:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f668000 00000100:00100000:1.0:1746147250.220234:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7216 00000100:00100000:1.0:1746147250.220239:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465597824:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147250.220487:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465597824:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 247us (633us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147250.220493:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7216 00002000:00100000:1.0:1746147250.220498:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4825088->4829183) req@ffff88009f668000 x1830967465597824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.220504:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668000 with x1830967465597824 ext(4825088->4829183) 00002000:00010000:1.0:1746147250.220507:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f668000 00000100:00100000:1.0:1746147250.227105:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465598080 00000100:00100000:1.0:1746147250.227112:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465598080 00002000:00100000:1.0:1746147250.227140:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1900544->1904639) req@ffff88009f66aa00 x1830967465598080/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.227149:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66aa00 with x1830967465598080 ext(1900544->1904639) 00010000:00010000:1.0:1746147250.227167:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 24 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.227179:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 24 pid: 17530 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746147250.227186:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f66aa00 00000100:00100000:1.0:1746147250.227201:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2488 00000100:00100000:1.0:1746147250.227207:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465598080:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147250.227366:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465598080:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 159us (729us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147250.227373:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2488 00002000:00100000:1.0:1746147250.227378:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1900544->1904639) req@ffff88009f66aa00 x1830967465598080/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.227386:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66aa00 with x1830967465598080 ext(1900544->1904639) 00010000:00010000:1.0:1746147250.227390:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 24 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.227399:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 24 pid: 17530 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746147250.227545:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f66aa00 00000100:00100000:0.0:1746147250.230083:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465597440:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 15663us (15765us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147250.230092:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7215 00002000:00100000:0.0:1746147250.231382:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009b408380 x1830967465597440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.231391:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408380 with x1830967465597440 ext(1048576->2097151) 00002000:00010000:0.0:1746147250.231396:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b408380 00000100:00100000:0.0:1746147250.237029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.237056:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.238091:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465598336 00000100:00100000:0.0:1746147250.238099:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465598336 00002000:00100000:0.0:1746147250.238133:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1900544->2097151) req@ffff88009b408a80 x1830967465598336/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.238142:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408a80 with x1830967465598336 ext(1900544->2097151) 00010000:00010000:0.0:1746147250.238150:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 12 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.238173:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465598464 00010000:00010000:0.0:1746147250.238174:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129dcd200/0xb4b2209fbdad01f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2e3 expref: 12 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.238177:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465598464 00002000:00010000:0.0:1746147250.238181:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b408a80 00000100:00100000:0.0:1746147250.238199:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2489 00000100:00100000:0.0:1746147250.238206:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465598336:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147250.238466:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15330 00000100:00100000:1.0:1746147250.238475:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31687:x1830967465598464:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147250.238490:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.238502:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec2ff expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.238532:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5764e00/0xb4b2209fbdad00bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec25e expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.238733:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.238745:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.238746:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.238753:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->1302527] (req 1048576->1302527) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.238787:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.238796:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 36 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.238899:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466998272:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.239660:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5764e00/0xb4b2209fbdad00bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec25e expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.239669:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5764e00/0xb4b2209fbdad00bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec25e expref: 15 pid: 17548 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746147250.239678:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466998400:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.239706:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.243656:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466998272:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.243667:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466998400:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.243696:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->1302527] (req 1048576->1302527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.243710:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537e000, rc 0) 00000100:00100000:1.0:1746147250.243756:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31687:x1830967465598464:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5280us (6730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.243766:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15330 00000100:00100000:0.0:1746147250.246848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.250275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.250361:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465598592 00000100:00100000:1.0:1746147250.250369:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465598592 00010000:00010000:1.0:1746147250.250394:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 37 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.250429:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7759 00000100:00100000:1.0:1746147250.250436:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465598592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.250449:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.250468:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 37 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.250477:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 37 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.250495:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801369afc00/0xb4b2209fbdad0205 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2f8 expref: 37 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.250507:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.250509:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.250515:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.250522:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.250548:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.250559:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466998528:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147250.250639:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.252878:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.255140:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.255153:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466998528:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147250.255182:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.255209:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465598592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4773us (4941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.255217:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7759 00000100:00100000:0.0:1746147250.263495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.265152:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.265197:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465599616 00000100:00100000:1.0:1746147250.265202:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465599616 00002000:00100000:1.0:1746147250.265224:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b40ad80 x1830967465599616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.265231:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40ad80 with x1830967465599616 ext(3145728->4194303) 00002000:00010000:1.0:1746147250.265234:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40ad80 00000100:00100000:1.0:1746147250.265258:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7219 00000100:00100000:1.0:1746147250.265264:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465599616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.267484:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465600128 00000100:00100000:0.0:1746147250.267490:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465600128 00002000:00100000:0.0:1746147250.267514:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f732d80 x1830967465600128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.267522:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732d80 with x1830967465600128 ext(2097152->3145727) 00002000:00010000:0.0:1746147250.267525:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732d80 00000100:00100000:0.0:1746147250.267830:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7221 00000100:00100000:0.0:1746147250.267837:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967465600128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.276309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.276351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.279811:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967465599616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14542us (14655us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147250.279820:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7219 00002000:00100000:1.0:1746147250.279829:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b40ad80 x1830967465599616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.279838:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40ad80 with x1830967465599616 ext(3145728->4194303) 00002000:00010000:1.0:1746147250.279842:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40ad80 00000100:00100000:1.0:1746147250.302787:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465600128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34944us (35341us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147250.302795:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7221 00002000:00100000:1.0:1746147250.302802:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f732d80 x1830967465600128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.302809:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732d80 with x1830967465600128 ext(2097152->3145727) 00002000:00010000:1.0:1746147250.302813:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732d80 00000100:00100000:0.0:1746147250.327436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.328285:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465601024 00000100:00100000:1.0:1746147250.328292:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465601024 00000100:00100000:1.0:1746147250.328330:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15331 00000100:00100000:1.0:1746147250.328337:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967465601024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.328351:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.328364:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013120c200/0xb4b2209fbdad0213 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec306 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.328380:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.328382:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.328388:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013120c200/0xb4b2209fbdad0213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec306 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.328401:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013120c200/0xb4b2209fbdad0213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec306 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.328409:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013120c200, rc 0) 00000100:00100000:1.0:1746147250.328571:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465601024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 235us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.328577:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15331 00000100:00100000:0.0:1746147250.328602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.328639:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465601152 00000100:00100000:1.0:1746147250.328642:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465601152 00000100:00100000:1.0:1746147250.328655:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15332 00000100:00100000:1.0:1746147250.328658:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465601152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.328663:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.328670:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013120da00/0xb4b2209fbdad021a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec30d expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.328695:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466998784:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147250.328730:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.328765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.328788:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.328799:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465601280 00000100:00100000:1.0:1746147250.328802:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465601280 00000100:00100000:1.0:1746147250.328816:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465601408 00000100:00100000:1.0:1746147250.328818:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465601408 00000100:00100000:1.0:1746147250.328829:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15333 00000100:00100000:1.0:1746147250.328833:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465601280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.328839:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.328845:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013120cc00/0xb4b2209fbdad0221 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec314 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.328865:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466998912:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147250.328886:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.328898:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15334 00000100:00100000:1.0:1746147250.328902:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465601408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.328909:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.328916:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdad0228 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec31b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.328934:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466999040:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147250.328970:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32840 going to sleep for 11 seconds 00002000:00010000:0.0:1746147250.334601:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147249 -> 1746147250 00002000:00010000:0.0:1746147250.334608:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147249 -> 1746147250 00002000:00010000:0.0:1746147250.334610:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147249 -> 1746147250 00000100:00100000:0.0:1746147250.334630:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466998912:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147250.334654:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013120cc00/0xb4b2209fbdad0221 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec314 expref: 24 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.334667:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013120cc00/0xb4b2209fbdad0221 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec314 expref: 24 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.334676:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013120cc00, rc 0) 00000100:00100000:0.0:1746147250.334710:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465601280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5875us (5943us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147250.334717:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15333 00002000:00010000:0.0:1746147250.334798:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147249 -> 1746147250 00002000:00010000:0.0:1746147250.334801:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147249 -> 1746147250 00002000:00010000:0.0:1746147250.334803:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147249 -> 1746147250 00000100:00100000:0.0:1746147250.334811:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466998784:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147250.334825:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013120da00/0xb4b2209fbdad021a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec30d expref: 37 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.334837:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013120da00/0xb4b2209fbdad021a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec30d expref: 37 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.334844:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013120da00, rc 0) 00000100:00100000:0.0:1746147250.334862:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465601152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6203us (6261us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147250.334867:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15332 00002000:00010000:0.0:1746147250.334891:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147249 -> 1746147250 00002000:00010000:0.0:1746147250.334893:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147249 -> 1746147250 00002000:00010000:0.0:1746147250.334895:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147249 -> 1746147250 00000100:00100000:0.0:1746147250.334905:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466999040:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147250.334918:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdad0228 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec31b expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.334926:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdad0228 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec31b expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.334932:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1000, rc 0) 00000100:00100000:0.0:1746147250.338376:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465601408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9467us (9582us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147250.338385:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15334 00000100:00100000:1.0:1746147250.345072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.345768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.345796:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465601536 00000100:00100000:0.0:1746147250.345803:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465601536 00000100:00100000:0.0:1746147250.345847:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15335 00000100:00100000:0.0:1746147250.345854:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31691:x1830967465601536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.345869:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.345881:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec322 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.345903:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.345911:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.345912:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.345916:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.345977:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.345987:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 36 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.345998:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466999168:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.346050:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.350461:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466999168:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.350483:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.350497:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd84400, rc 0) 00000100:00100000:0.0:1746147250.350530:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31691:x1830967465601536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4676us (5464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.350537:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15335 00000100:00100000:0.0:1746147250.350976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.351001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.352260:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465602176 00000100:00100000:1.0:1746147250.352265:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465602176 00000100:00100000:1.0:1746147250.352294:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11370 00000100:00100000:1.0:1746147250.352299:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31696:x1830967465602176:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147250.352310:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.352322:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec329 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.352401:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352412:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352421:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352433:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352438:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352443:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352529:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352536:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352541:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147250.352548:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147250.352610:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352615:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352619:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352624:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5d1e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.352627:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352631:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352640:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147250.352642:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.352645:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352649:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad023d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352659:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352663:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352667:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352671:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5d0c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.352673:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352677:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352683:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9b00) 00010000:00010000:1.0:1746147250.352684:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.352686:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352690:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad0244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.352717:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec329 expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.352725:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec329 expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.352730:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.352732:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147250.352735:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1800, rc 0) 00000100:00100000:1.0:1746147250.352767:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31696:x1830967465602176:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 467us (1790us total) trans 8589945346 rc 0/0 00000100:00100000:1.0:1746147250.352772:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11370 00000100:00100000:0.0:1746147250.359651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.360234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.360255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.360270:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465602560 00000100:00100000:0.0:1746147250.360273:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465602560 00000100:00100000:0.0:1746147250.360292:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465602688 00000100:00100000:0.0:1746147250.360293:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465602688 00000100:00100000:0.0:1746147250.360305:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15336 00000100:00100000:0.0:1746147250.360309:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465602560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.360319:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.360332:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd85e00/0xb4b2209fbdad0259 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec330 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.360370:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466999296:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147250.360411:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.360425:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15337 00000100:00100000:0.0:1746147250.360430:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465602688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.360435:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.360441:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad0260 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec337 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.360458:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466999424:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147250.360474:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00002000:00010000:0.0:1746147250.367645:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2077 -> 2081 00000100:00100000:0.0:1746147250.367659:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466999296:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147250.367683:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd85e00/0xb4b2209fbdad0259 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec330 expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.367695:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd85e00/0xb4b2209fbdad0259 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec330 expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.367704:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd85e00, rc 0) 00000100:00100000:0.0:1746147250.367738:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465602560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7427us (7505us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147250.367745:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15336 00000100:00100000:0.0:1746147250.367782:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466999424:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147250.367794:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad0260 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec337 expref: 39 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.367802:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad0260 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec337 expref: 39 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.367809:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948d8400, rc 0) 00000100:00100000:0.0:1746147250.367823:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465602688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7393us (7568us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147250.367828:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15337 00000100:00100000:0.0:1746147250.374752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.378561:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465602816 00000100:00100000:0.0:1746147250.378571:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465602816 00000100:00100000:0.0:1746147250.378607:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15338 00000100:00100000:0.0:1746147250.378614:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:31686:x1830967465602816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.378628:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.378641:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad0267 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec33e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.378661:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.378663:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.378667:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad0267 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec33e expref: 39 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.378677:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad0267 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec33e expref: 39 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.378686:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e800, rc 0) 00000100:00100000:0.0:1746147250.378727:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:31686:x1830967465602816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 113us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.378732:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15338 00000100:00100000:0.0:1746147250.378835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.378880:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465602944 00000100:00100000:0.0:1746147250.378884:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465602944 00010000:00010000:0.0:1746147250.379819:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 39 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.379842:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7761 00000100:00100000:0.0:1746147250.379847:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967465602944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.379855:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.379870:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 39 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.379878:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 39 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.379892:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdad01f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ea expref: 39 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.379900:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.379902:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.379906:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.379913:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.379918:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.379919:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.379921:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad0267 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec33e expref: 38 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.379926:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad0267 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec33e expref: 38 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.379957:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad0267 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec33e expref: 38 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.379971:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466999552:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147250.380020:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.380026:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466999680:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147250.380038:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.387273:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.387300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.387321:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465603072 00000100:00100000:0.0:1746147250.387327:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465603072 00000100:00100000:0.0:1746147250.387357:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15339 00000100:00100000:0.0:1746147250.387363:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465603072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.387791:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.387807:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c7d400/0xb4b2209fbdad026e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec345 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.388732:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466999808:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147250.388833:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.390078:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466999552:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147250.390087:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466999680:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147250.390099:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.390120:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967465602944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10273us (11286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.390130:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7761 00000100:00100000:0.0:1746147250.410766:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465603328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21749us (23463us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147250.410772:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7224 00002000:00100000:0.0:1746147250.410778:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880094d7a680 x1830967465603328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.410785:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7a680 with x1830967465603328 ext(2097152->3145727) 00002000:00010000:0.0:1746147250.410788:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7a680 00000100:00100000:1.0:1746147250.415405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.421784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.422070:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465603968 00000100:00100000:0.0:1746147250.422077:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465603968 00000100:00100000:0.0:1746147250.422106:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15340 00000100:00100000:0.0:1746147250.422111:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31691:x1830967465603968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.422123:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.422134:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d56600/0xb4b2209fbdad0275 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec34c expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.422164:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.422171:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.422172:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.422176:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d56600/0xb4b2209fbdad0275 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec34c expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.422196:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.422209:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 14 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.422219:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466999936:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.422272:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.427251:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466999936:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.427273:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d56600/0xb4b2209fbdad0275 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec34c expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.427286:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d56600, rc 0) 00000100:00100000:0.0:1746147250.427320:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31691:x1830967465603968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5207us (5541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.427327:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15340 00000100:00100000:1.0:1746147250.429124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.429169:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465604096 00000100:00100000:1.0:1746147250.429176:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465604096 00002000:00100000:1.0:1746147250.429213:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (4145152->4194303) req@ffff88008d5ddf80 x1830967465604096/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.429221:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddf80 with x1830967465604096 ext(4145152->4194303) 00010000:00010000:1.0:1746147250.429229:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 15 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.429241:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 15 pid: 17530 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746147250.429247:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5ddf80 00000100:00100000:1.0:1746147250.429292:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2492 00000100:00100000:1.0:1746147250.429300:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465604096:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147250.433723:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465604096:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4418us (4598us total) trans 21474841332 rc 0/0 00000100:00100000:0.0:1746147250.433732:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2492 00002000:00100000:0.0:1746147250.433740:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (4145152->4194303) req@ffff88008d5ddf80 x1830967465604096/t21474841332(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/448 e 0 to 0 dl 1746147261 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.433748:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddf80 with x1830967465604096 ext(4145152->4194303) 00010000:00010000:0.0:1746147250.433756:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 17 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.433768:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 17 pid: 17530 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746147250.433774:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5ddf80 00000100:00100000:0.0:1746147250.444821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.444933:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465604224 00000100:00100000:1.0:1746147250.444962:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465604224 00010000:00010000:1.0:1746147250.444995:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 17 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.445033:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7762 00000100:00100000:1.0:1746147250.445043:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967465604224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.445055:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.445079:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 17 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.445091:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 17 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.445111:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129dcd600/0xb4b2209fbdad01e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2dc expref: 17 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.445124:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.445126:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.445133:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d56600/0xb4b2209fbdad0275 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec34c expref: 9 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.445142:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d56600/0xb4b2209fbdad0275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec34c expref: 9 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.445187:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d56600/0xb4b2209fbdad0275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec34c expref: 9 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.445200:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467000064:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147250.445271:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.447616:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467000064:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147250.447631:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.447659:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967465604224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2618us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.447666:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7762 00000100:00100000:0.0:1746147250.464401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.465016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.465035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.465057:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465604864 00000100:00100000:0.0:1746147250.465059:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465604864 00002000:00100000:0.0:1746147250.465074:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094d7ad80 x1830967465604864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.465081:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ad80 with x1830967465604864 ext(3145728->4194303) 00002000:00010000:0.0:1746147250.465084:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7ad80 00000100:00100000:0.0:1746147250.465092:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465604992 00000100:00100000:0.0:1746147250.465094:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465604992 00002000:00100000:0.0:1746147250.465102:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880094d7b100 x1830967465604992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.465107:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b100 with x1830967465604992 ext(3145728->4194303) 00002000:00010000:0.0:1746147250.465109:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7b100 00000100:00100000:0.0:1746147250.465117:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7227 00000100:00100000:0.0:1746147250.465121:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967465604864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147250.485310:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967465604864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20179us (20285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147250.485321:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7227 00002000:00100000:1.0:1746147250.485330:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094d7ad80 x1830967465604864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.485339:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ad80 with x1830967465604864 ext(3145728->4194303) 00002000:00010000:1.0:1746147250.485344:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7ad80 00000100:00100000:0.0:1746147250.489901:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465604992:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24671us (24855us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147250.489912:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7228 00002000:00100000:0.0:1746147250.489922:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880094d7b100 x1830967465604992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.489967:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b100 with x1830967465604992 ext(3145728->4194303) 00002000:00010000:0.0:1746147250.489972:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7b100 00000100:00100000:1.0:1746147250.495282:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465604480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30716us (30880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147250.495294:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7226 00002000:00100000:1.0:1746147250.495304:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880094d79c00 x1830967465604480/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.495313:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79c00 with x1830967465604480 ext(2097152->3145727) 00002000:00010000:1.0:1746147250.495318:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d79c00 00000100:00100000:0.0:1746147250.503033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.503100:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465605248 00000100:00100000:1.0:1746147250.503108:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465605248 00002000:00100000:1.0:1746147250.503145:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094d7b480 x1830967465605248/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.503163:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b480 with x1830967465605248 ext(4194304->4976639) 00002000:00010000:1.0:1746147250.503169:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7b480 00000100:00100000:1.0:1746147250.503202:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7229 00000100:00100000:1.0:1746147250.503210:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1958:x1830967465605248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.510372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.511182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.511212:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465605632 00000100:00100000:0.0:1746147250.511218:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465605632 00000100:00100000:0.0:1746147250.511262:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11371 00000100:00100000:0.0:1746147250.511268:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31699:x1830967465605632:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147250.511285:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.511297:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9600/0xb4b2209fbdad027c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec35a expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.511560:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511625:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511634:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147250.511640:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465605376 00000100:00100000:1.0:1746147250.511644:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465605376 00010000:00010000:0.0:1746147250.511647:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511652:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511657:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147250.511667:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15341 00000100:00100000:1.0:1746147250.511671:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:31696:x1830967465605376:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147250.511678:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.511687:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0291 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec353 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.511704:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 6 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.511716:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.511722:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2a4 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.511726:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.511730:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.511733:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0291 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec353 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.511746:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348800/0xb4b2209fbdad0298 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511753:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348800/0xb4b2209fbdad0298 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.511756:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2a4 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.511759:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348800/0xb4b2209fbdad0298 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147250.511765:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147250.511774:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2a4 expref: 17 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.511783:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467000192:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.511826:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511832:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511838:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511843:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4fa9400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147250.511845:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511851:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511859:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147250.511861:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.511862:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147250.511864:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.511869:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 9 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.511869:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdad0283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147250.511880:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467000320:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.511885:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511889:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511894:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511897:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5348600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147250.511900:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511904:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147250.511906:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 6 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.511909:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f000) 00010000:00010000:0.0:1746147250.511911:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.511913:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 6 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.511913:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147250.511917:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdad028a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147250.511919:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467000448:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.511934:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de180 going to sleep for 11 seconds 00010000:00010000:0.0:1746147250.511965:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9600/0xb4b2209fbdad027c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec35a expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.511975:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348800/0xb4b2209fbdad0298 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec35a expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.511981:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.511983:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147250.511986:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5348800, rc 0) 00000100:00100000:0.0:1746147250.512011:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31699:x1830967465605632:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 743us (829us total) trans 8589945349 rc 0/0 00000100:00100000:0.0:1746147250.512017:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11371 00000100:00100000:0.0:1746147250.512246:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1958:x1830967465605248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9037us (9220us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746147250.512253:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7229 00002000:00100000:0.0:1746147250.512260:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094d7b480 x1830967465605248/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.512268:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b480 with x1830967465605248 ext(4194304->4976639) 00002000:00010000:0.0:1746147250.512272:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7b480 00000100:00100000:1.0:1746147250.515080:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467000192:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.515321:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467000320:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.515345:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467000448:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.515477:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0291 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec353 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.515491:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1400, rc 0) 00000100:00100000:1.0:1746147250.516703:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:31696:x1830967465605376:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5027us (6334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.516711:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15341 00000100:00100000:0.0:1746147250.517426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.517550:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465605760 00000100:00100000:0.0:1746147250.517558:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465605760 00010000:00010000:0.0:1746147250.517596:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd85000/0xb4b2209fbdad01aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2a4 expref: 17 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.517641:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465605888 00000100:00100000:0.0:1746147250.517645:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465605888 00010000:00010000:0.0:1746147250.517661:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 7 pid: 8481 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.517681:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7764 00000100:00100000:0.0:1746147250.517688:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465605888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.517697:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.517722:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 7 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.517729:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 7 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.517746:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e51e400/0xb4b2209fbdad00b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec250 expref: 7 pid: 8481 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.517758:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.517792:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465605888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.517798:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7764 00000100:00100000:1.0:1746147250.522492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.522579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.522600:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465606144 00000100:00100000:1.0:1746147250.522606:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465606144 00000100:00100000:1.0:1746147250.522634:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15342 00000100:00100000:1.0:1746147250.522640:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465606144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.522653:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.522664:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad02a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec361 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.522681:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.522689:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad02a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec361 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.522698:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad02a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec361 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.522708:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1e00, rc 0) 00000100:00100000:1.0:1746147250.522750:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465606144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (171us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147250.522759:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15342 00000100:00100000:0.0:1746147250.522817:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465606016 00000100:00100000:0.0:1746147250.522820:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465606016 00010000:00010000:0.0:1746147250.522832:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 10 pid: 6881 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.522845:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7765 00000100:00100000:0.0:1746147250.522848:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465606016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.522857:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.522873:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 10 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.522881:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 10 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.522897:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a951400/0xb4b2209fbdad01c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b9 expref: 10 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.522905:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.522917:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465606016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.522922:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7765 00000100:00100000:0.0:1746147250.530387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.530453:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465606400 00000100:00100000:1.0:1746147250.530460:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465606400 00002000:00100000:1.0:1746147250.530496:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1310720->1314815) req@ffff88012c9f0000 x1830967465606400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.530504:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0000 with x1830967465606400 ext(1310720->1314815) 00002000:00010000:1.0:1746147250.530508:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0000 00000100:00100000:1.0:1746147250.530525:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7230 00000100:00100000:1.0:1746147250.530532:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465606400:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147250.530757:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465606400:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 225us (377us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147250.530763:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7230 00002000:00100000:1.0:1746147250.530768:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1310720->1314815) req@ffff88012c9f0000 x1830967465606400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.530775:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0000 with x1830967465606400 ext(1310720->1314815) 00002000:00010000:1.0:1746147250.530778:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0000 00000100:00100000:0.0:1746147250.531694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.540604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543438:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607296 00000100:00100000:0.0:1746147250.543444:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607296 00000100:00100000:0.0:1746147250.543489:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:0.0:1746147250.543495:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465607296:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.543542:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465607296:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.543547:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:0.0:1746147250.543571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543581:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607552 00000100:00100000:0.0:1746147250.543588:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607552 00000100:00100000:0.0:1746147250.543602:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:0.0:1746147250.543606:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465607552:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.543640:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465607552:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 32us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.543646:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:0.0:1746147250.543702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543783:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465606912 00000100:00100000:0.0:1746147250.543786:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465606912 00000100:00100000:0.0:1746147250.543811:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:0.0:1746147250.543817:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1957:x1830967465606912:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.543854:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1957:x1830967465606912:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 35us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.543859:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:0.0:1746147250.543898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.543989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.544024:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.544048:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607040 00000100:00100000:0.0:1746147250.544053:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607040 00000100:00100000:0.0:1746147250.544076:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607808 00000100:00100000:0.0:1746147250.544079:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607808 00000100:00100000:0.0:1746147250.544095:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607168 00000100:00100000:0.0:1746147250.544098:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607168 00000100:00100000:0.0:1746147250.544113:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607424 00000100:00100000:0.0:1746147250.544115:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607424 00000100:00100000:0.0:1746147250.544129:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465607680 00000100:00100000:0.0:1746147250.544131:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465607680 00000100:00100000:0.0:1746147250.544145:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:0.0:1746147250.544150:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967465607040:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.544199:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967465607040:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.544205:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:0.0:1746147250.544220:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:0.0:1746147250.544226:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465607808:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.544253:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465607808:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.544258:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:0.0:1746147250.544274:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:0.0:1746147250.544280:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465607168:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.544306:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465607168:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.544310:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:0.0:1746147250.544323:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:0.0:1746147250.544329:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465607424:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.544355:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465607424:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.544360:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:0.0:1746147250.544377:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:0.0:1746147250.544382:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465607680:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147250.544409:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465607680:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.544414:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:0.0:1746147250.546175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.549559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.556642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.556733:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465608320 00000100:00100000:1.0:1746147250.556740:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465608320 00010000:00010000:1.0:1746147250.556768:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013120c200/0xb4b2209fbdad0213 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec306 expref: 17 pid: 17530 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746147250.564425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.572288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.573576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.574964:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.574997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.575028:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465609216 00000100:00100000:1.0:1746147250.575031:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465609216 00000100:00100000:1.0:1746147250.575054:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15346 00000100:00100000:1.0:1746147250.575061:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465609216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.575070:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.575082:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad02e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec384 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.575097:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.575099:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.575107:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad02e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec384 expref: 17 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.575121:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdad02e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec384 expref: 17 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.575131:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1e00, rc 0) 00000100:00100000:1.0:1746147250.575189:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465609216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 126us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.575195:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15346 00000100:00100000:0.0:1746147250.590850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.590899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.590993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.592056:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465609600 00000100:00100000:1.0:1746147250.592064:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465609600 00002000:00100000:1.0:1746147250.592103:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880094403100 x1830967465609600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.592112:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094403100 with x1830967465609600 ext(0->1048575) 00002000:00010000:1.0:1746147250.592117:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094403100 00000100:00100000:1.0:1746147250.592142:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465609728 00000100:00100000:1.0:1746147250.592145:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465609728 00002000:00100000:1.0:1746147250.592171:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1310719) req@ffff880094403480 x1830967465609728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.592183:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094403480 with x1830967465609728 ext(1048576->1310719) 00002000:00010000:1.0:1746147250.592187:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094403480 00000100:00100000:1.0:1746147250.592210:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465609984 00000100:00100000:1.0:1746147250.592214:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465609984 00002000:00100000:1.0:1746147250.592226:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1101824->2097151) req@ffff880094403800 x1830967465609984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.592231:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094403800 with x1830967465609984 ext(1101824->2097151) 00002000:00010000:1.0:1746147250.592233:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094403800 00000100:00100000:1.0:1746147250.592253:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7232 00000100:00100000:1.0:1746147250.592260:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465609600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147250.593705:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7234 00000100:00100000:1.0:1746147250.593710:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967465609984:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.605244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.612261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.615234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.615983:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967465609984:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22271us (24990us total) trans 0 rc 995328/995328 00000100:00100000:1.0:1746147250.615991:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7234 00002000:00100000:1.0:1746147250.615996:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1101824->2097151) req@ffff880094403800 x1830967465609984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 995328/995328 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.616004:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094403800 with x1830967465609984 ext(1101824->2097151) 00002000:00010000:1.0:1746147250.616007:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094403800 00000100:00100000:0.0:1746147250.618759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.618830:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465610624 00000100:00100000:1.0:1746147250.618837:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465610624 00002000:00100000:1.0:1746147250.618863:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (2981888->2985983) req@ffff88012db2c700 x1830967465610624/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.618877:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c700 with x1830967465610624 ext(2981888->2985983) 00002000:00010000:1.0:1746147250.618881:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2c700 00000100:00100000:1.0:1746147250.618973:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7235 00000100:00100000:1.0:1746147250.618979:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465610624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147250.619390:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465610624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 410us (631us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147250.619396:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7235 00002000:00100000:1.0:1746147250.619402:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (2981888->2985983) req@ffff88012db2c700 x1830967465610624/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.619408:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c700 with x1830967465610624 ext(2981888->2985983) 00002000:00010000:1.0:1746147250.619411:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2c700 00000100:00100000:0.0:1746147250.627215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.627357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.627534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.634594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.634626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.634650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.635070:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465611264 00000100:00100000:1.0:1746147250.635073:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465611264 00000100:00100000:1.0:1746147250.635094:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4732 00000100:00100000:1.0:1746147250.635098:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+307:14478:x1830967465611264:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147250.635244:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+308:14478:x1830967465611264:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 145us (657us total) trans 8589945352 rc 0/0 00000100:00100000:1.0:1746147250.635249:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4732 00000100:00100000:1.0:1746147250.641900:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465611776 00000100:00100000:1.0:1746147250.641904:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465611776 00010000:00010000:1.0:1746147250.641918:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 11 pid: 21080 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.641968:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7771 00000100:00100000:1.0:1746147250.641976:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465611776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.642143:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.642172:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 11 pid: 21080 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.642181:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 11 pid: 21080 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.642210:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7772 00000100:00100000:0.0:1746147250.642217:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1957:x1830967465611648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.642224:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.642228:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec288 expref: 308 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.642235:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec288 expref: 308 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.642256:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd84000/0xb4b2209fbdad0172 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec288 expref: 308 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.642272:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.642276:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdad0308 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147250.642284:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdad0308 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147250.642289:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdad0308 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147250.642311:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.642339:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1957:x1830967465611648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.642344:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7772 00010000:00010000:1.0:1746147250.642877:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd84400/0xb4b2209fbdad022f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec322 expref: 11 pid: 21080 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.642888:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.642890:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.642894:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f964a00/0xb4b2209fbdad030f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec392 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.642901:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f964a00/0xb4b2209fbdad030f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec392 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.642924:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f964a00/0xb4b2209fbdad030f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec392 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.643176:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467002240:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147250.643231:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.645820:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467002240:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147250.647901:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.647958:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465611776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5978us (6116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.647966:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7771 00000100:00100000:0.0:1746147250.648021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.648095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.648108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.648197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.648738:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465612288 00000100:00100000:0.0:1746147250.648741:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465612288 00000100:00100000:0.0:1746147250.648758:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15351 00000100:00100000:0.0:1746147250.648762:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465612032:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147250.648772:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.648784:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095371a00/0xb4b2209fbdad031d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec3ae expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.648825:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467002368:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147250.648870:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.648884:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15352 00000100:00100000:0.0:1746147250.648889:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465612160:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147250.648896:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.648905:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095370400/0xb4b2209fbdad0324 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec3b5 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.648924:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467002496:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147250.648963:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.650592:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465612544 00000100:00100000:1.0:1746147250.650596:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465612544 00010000:00010000:1.0:1746147250.650609:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 10 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.650626:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7773 00000100:00100000:1.0:1746147250.650630:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465612544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.650636:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.650649:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 10 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.650657:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 10 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.650668:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.650669:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.650674:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.650679:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.650692:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.650701:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467002880:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147250.650739:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.651571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147250.652295:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147249 -> 1746147250 00000100:00100000:0.0:1746147250.652307:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467002368:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147250.652324:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095371a00/0xb4b2209fbdad031d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3ae expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.652334:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095371a00/0xb4b2209fbdad031d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3ae expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.652345:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095371a00, rc 0) 00010000:00010000:1.0:1746147250.652545:0:8480:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88012db2ed80 x1830967467002496) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 10 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.652561:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad020c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2ff expref: 10 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.652570:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467002496:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147250.652584:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095370400/0xb4b2209fbdad0324 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3b5 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.652591:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095370400/0xb4b2209fbdad0324 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3b5 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.652596:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370400, rc 0) 00000100:00100000:0.0:1746147250.653328:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465612032:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4563us (5231us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147250.653335:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15351 00000100:00100000:1.0:1746147250.653465:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465612160:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4576us (5355us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147250.653470:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15352 00000100:00100000:1.0:1746147250.654591:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467002880:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147250.654602:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.654619:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465612544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3988us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.654627:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7773 00000100:00100000:0.0:1746147250.654792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.654823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.668086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.668106:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465613696 00000100:00100000:1.0:1746147250.668113:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465613696 00010000:00010000:1.0:1746147250.668138:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdad0308 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec399 expref: 9 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.668180:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7774 00000100:00100000:1.0:1746147250.668186:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465613696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.668196:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.668201:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdad0308 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec399 expref: 9 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.668210:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdad0308 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec399 expref: 9 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.668227:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.668231:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c0400/0xb4b2209fbdad0347 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.668238:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c0400/0xb4b2209fbdad0347 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.668243:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c0400/0xb4b2209fbdad0347 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.668256:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.668286:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465613696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.668462:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7774 00000100:00100000:0.0:1746147250.673630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.675955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.675995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.677022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.678921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.679355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.679783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.679823:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465614592 00000100:00100000:0.0:1746147250.679826:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465614592 00000100:00100000:0.0:1746147250.679840:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465614720 00000100:00100000:0.0:1746147250.679841:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465614720 00000100:00100000:0.0:1746147250.679851:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15358 00000100:00100000:0.0:1746147250.679855:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465614592:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147250.679872:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130f08c00/0xb4b2209fbdad0386 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.679881:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.679887:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.679893:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.679897:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.679898:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.679900:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08c00/0xb4b2209fbdad0386 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680007:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680016:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 23 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.680023:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467003648:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.680056:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680063:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 8 pid: 6881 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.680070:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467003776:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.680091:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.680098:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 6 pid: 8480 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.680105:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467003904:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.680118:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.680131:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15359 00000100:00100000:0.0:1746147250.680137:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465614720:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147250.680165:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680174:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec353 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680179:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.680180:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147250.680182:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680196:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec353 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.680203:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad0291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec353 expref: 15 pid: 21080 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.680211:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467004032:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.680228:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.680290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.680317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.680335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.680359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.680404:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465614848 00000100:00100000:1.0:1746147250.680407:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465614848 00000100:00100000:1.0:1746147250.680420:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465614976 00000100:00100000:1.0:1746147250.680421:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465614976 00000100:00100000:1.0:1746147250.680426:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465615104 00000100:00100000:1.0:1746147250.680427:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465615104 00000100:00100000:1.0:1746147250.680432:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465615232 00000100:00100000:1.0:1746147250.680433:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465615232 00000100:00100000:1.0:1746147250.680440:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15360 00000100:00100000:1.0:1746147250.680445:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465614848:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147250.680458:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.680467:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad02b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec36f expref: 15 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.680472:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147250.680473:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147250.680475:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.680491:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad02b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec36f expref: 15 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.680498:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad02b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec36f expref: 15 pid: 17530 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.680504:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467004160:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147250.680561:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147250.684081:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467004032:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.684093:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.684190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.684595:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467004160:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.684607:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.688193:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465615488 00000100:00100000:0.0:1746147250.688200:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465615488 00010000:00010000:0.0:1746147250.688225:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 9 pid: 6881 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.688243:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465615616 00000100:00100000:0.0:1746147250.688244:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465615616 00010000:00010000:0.0:1746147250.688252:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 9 pid: 8480 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.688262:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465616000 00000100:00100000:0.0:1746147250.688264:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465616000 00010000:00010000:0.0:1746147250.688272:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 23 pid: 11147 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.688278:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465616256 00000100:00100000:0.0:1746147250.688280:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465616256 00010000:00010000:0.0:1746147250.688286:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 24 pid: 8481 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.688295:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7775 00000100:00100000:0.0:1746147250.688299:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465615488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.688308:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.688324:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 9 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688333:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 9 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688348:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e51f600/0xb4b2209fbdad01a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec29d expref: 9 pid: 6881 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688361:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.688386:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465615488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.688391:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7775 00000100:00100000:0.0:1746147250.688404:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7776 00000100:00100000:0.0:1746147250.688408:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465615616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.688413:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.688418:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 9 pid: 8480 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.688425:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 9 pid: 8480 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.688433:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a951a00/0xb4b2209fbdad00ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec249 expref: 9 pid: 8480 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746147250.688439:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.688448:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465615616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.688452:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7776 00000100:00100000:0.0:1746147250.688460:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7777 00000100:00100000:0.0:1746147250.688464:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465616000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.688468:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.688472:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 24 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688479:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 24 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688488:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dcda00/0xb4b2209fbdad0141 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec281 expref: 24 pid: 11147 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688494:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.688497:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.688500:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f08c00/0xb4b2209fbdad0386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.688506:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08c00/0xb4b2209fbdad0386 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.688521:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.688531:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465616000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.688535:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7777 00000100:00100000:0.0:1746147250.688556:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7778 00000100:00100000:0.0:1746147250.688560:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465616256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147250.688564:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.688571:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 22 pid: 8481 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688578:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 22 pid: 8481 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688587:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5e00/0xb4b2209fbdad0316 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3a0 expref: 22 pid: 8481 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.688594:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.688595:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.688598:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65800/0xb4b2209fbdad039b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.688603:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65800/0xb4b2209fbdad039b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.688866:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.688884:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465616256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 322us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.688889:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7778 00000100:00100000:0.0:1746147250.704031:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967465615744:12345-192.168.203.36@tcp:4:cat.0 Request processed in 15134us (15908us total) trans 21474841335 rc 0/0 00000100:00100000:0.0:1746147250.704037:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2496 00002000:00100000:0.0:1746147250.704043:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1101823) req@ffff88009f730a80 x1830967465615744/t21474841335(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/448 e 0 to 0 dl 1746147261 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.704048:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730a80 with x1830967465615744 ext(1048576->1101823) 00010000:00010000:0.0:1746147250.704053:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad02b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec36f expref: 20 pid: 17530 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.704061:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad02b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec36f expref: 20 pid: 17530 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746147250.704065:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f730a80 00000100:00100000:0.0:1746147250.705663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.706743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.708316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147250.708766:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708774:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708790:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708800:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708805:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708810:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b829e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147250.708812:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708817:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708825:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.708830:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad038d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.709469:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465614720:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 29330us (29684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.709475:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15359 00000100:00100000:0.0:1746147250.709803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147250.710475:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710482:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710498:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710504:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710510:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710516:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5d0200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147250.710518:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710525:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710534:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.710539:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0394 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.711616:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465614848:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 31170us (31325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.711622:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15360 00000100:00100000:1.0:1746147250.713319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.713548:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465617024 00000100:00100000:0.0:1746147250.713555:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465617024 00002000:00100000:0.0:1746147250.713584:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008d5dce00 x1830967465617024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.713593:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dce00 with x1830967465617024 ext(2097152->3145727) 00010000:00010000:0.0:1746147250.713600:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134f65c00/0xb4b2209fbdad037f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3ed expref: 21 pid: 8481 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.713612:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134f65c00/0xb4b2209fbdad037f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3ed expref: 21 pid: 8481 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746147250.713618:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5dce00 00000100:00100000:0.0:1746147250.713643:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2498 00000100:00100000:0.0:1746147250.713649:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465617024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147250.723868:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465617024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10213us (10545us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147250.723876:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2498 00002000:00100000:1.0:1746147250.723885:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008d5dce00 x1830967465617024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.723891:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dce00 with x1830967465617024 ext(2097152->3145727) 00010000:00010000:1.0:1746147250.723897:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134f65c00/0xb4b2209fbdad037f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3ed expref: 21 pid: 8481 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.723907:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134f65c00/0xb4b2209fbdad037f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3ed expref: 21 pid: 8481 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746147250.723912:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5dce00 00000100:00100000:0.0:1746147250.731204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.731258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.731332:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465617280 00000100:00100000:1.0:1746147250.731339:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465617280 00000100:00100000:1.0:1746147250.731374:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15364 00000100:00100000:1.0:1746147250.731380:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:31703:x1830967465617280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.731394:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.731410:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec3f4 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147250.731430:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417b2, atime: 0x681417b2, ctime: 0x681417b2, blocks: 0x1029 00010000:00010000:1.0:1746147250.731446:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.731447:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.731453:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3f4 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.731470:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3f4 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.731479:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1400, rc 0) 00000100:00100000:1.0:1746147250.731511:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:31703:x1830967465617280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 132us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.731516:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15364 00000100:00100000:0.0:1746147250.733547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.740436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.740653:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465617792 00000100:00100000:1.0:1746147250.740659:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465617792 00002000:00100000:1.0:1746147250.740693:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012df76a00 x1830967465617792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.740701:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76a00 with x1830967465617792 ext(2097152->3145727) 00002000:00010000:1.0:1746147250.740705:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76a00 00000100:00100000:1.0:1746147250.740734:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7238 00000100:00100000:1.0:1746147250.740741:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967465617792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.748197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.748235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.749030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.749881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.749970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.750466:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465618304 00000100:00100000:1.0:1746147250.750470:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465618304 00010000:00010000:1.0:1746147250.750482:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 15 pid: 14049 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.750493:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7786 00000100:00100000:1.0:1746147250.750497:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1959:x1830967465618048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.750502:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.750505:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec329 expref: 308 pid: 14048 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.750637:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec329 expref: 307 pid: 14048 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.750648:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1800/0xb4b2209fbdad024b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec329 expref: 307 pid: 14048 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.750669:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.750674:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147250.750681:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.750716:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1959:x1830967465618048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 217us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.751092:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7786 00000100:00100000:1.0:1746147250.751103:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7787 00000100:00100000:1.0:1746147250.751109:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465618432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147250.751109:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7788 00000100:00100000:0.0:1746147250.751113:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465618304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.751116:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.751119:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b2 expref: 14 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.751120:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147250.751123:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 14 pid: 14049 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.751126:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b2 expref: 14 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.751283:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 13 pid: 14049 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.751295:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85600/0xb4b2209fbdad01bf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2b2 expref: 13 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.751304:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.751307:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147250.751311:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.751347:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465618432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 237us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.751353:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7787 00010000:00010000:0.0:1746147250.751476:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd85800/0xb4b2209fbdad01d4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec2c0 expref: 11 pid: 14049 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746147250.751497:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.751499:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147250.751505:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147250.751510:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147250.751532:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147250.751547:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465618304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 433us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.751552:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7788 00000100:00100000:0.0:1746147250.753688:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967465617792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12945us (13252us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147250.753696:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7238 00002000:00100000:0.0:1746147250.753704:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012df76a00 x1830967465617792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.753718:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76a00 with x1830967465617792 ext(2097152->3145727) 00002000:00010000:0.0:1746147250.753721:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76a00 00000100:00100000:0.0:1746147250.767594:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465618560 00000100:00100000:0.0:1746147250.767602:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465618560 00000100:00100000:0.0:1746147250.767633:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15365 00000100:00100000:0.0:1746147250.767640:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:31703:x1830967465618560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.767652:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.767666:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5426c00/0xb4b2209fbdad03be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec3fb expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147250.767684:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417b2, atime: 0x681417b2, ctime: 0x681417b2, blocks: 0x163d 00010000:00010000:0.0:1746147250.767700:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.767701:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.767708:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5426c00/0xb4b2209fbdad03be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3fb expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.767720:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5426c00/0xb4b2209fbdad03be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3fb expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.767729:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5426c00, rc 0) 00000100:00100000:0.0:1746147250.767764:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+21:31703:x1830967465618560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 124us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.767769:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15365 00000100:00100000:0.0:1746147250.773698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.773720:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465618688 00000100:00100000:0.0:1746147250.773727:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465618688 00000100:00100000:0.0:1746147250.773788:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11378 00000100:00100000:0.0:1746147250.773795:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31703:x1830967465618688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.773812:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.773825:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec402 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.773868:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147250.773875:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec402 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.773888:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1000/0xb4b2209fbdad03b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147250.773897:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec402 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.773908:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.773911:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147250.773914:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec402 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.773920:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5426800, rc 0) 00000100:00100000:0.0:1746147250.773974:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31703:x1830967465618688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 178us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.773979:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11378 00000100:00100000:0.0:1746147250.780415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.780441:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465618944 00000100:00100000:0.0:1746147250.780448:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465618944 00000100:00100000:0.0:1746147250.780479:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11379 00000100:00100000:0.0:1746147250.780486:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31711:x1830967465618944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.780502:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.780515:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad03cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec409 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.780591:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.780600:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.780608:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.780617:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.780622:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.780627:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000001:00080000:0.0:1746147250.782740:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945349 is committed 00000001:00080000:0.0:1746147250.782749:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945352 is committed 00000001:00080000:0.0:1746147250.782757:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945355 is committed 00000001:00080000:0.0:1746147250.782761:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945353 is committed 00000001:00080000:0.0:1746147250.782766:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945356 is committed 00000004:00080000:0.0:1746147250.782769:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2512 committed 00000004:00080000:0.0:1746147250.782774:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2508 committed 00000004:00080000:0.0:1746147250.783575:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2507 committed 00000004:00080000:0.0:1746147250.783578:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2506 committed 00000004:00080000:0.0:1746147250.783579:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2505 committed 00000004:00080000:0.0:1746147250.783581:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2511 committed 00000004:00080000:0.0:1746147250.783582:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2504 committed 00000004:00080000:0.0:1746147250.783583:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2510 committed 00000004:00080000:0.0:1746147250.783585:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2503 committed 00000004:00080000:0.0:1746147250.783586:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2509 committed 00000004:00080000:0.0:1746147250.783587:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2508 committed 00000004:00080000:0.0:1746147250.783588:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2507 committed 00000004:00080000:0.0:1746147250.783589:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2502 committed 00000004:00080000:0.0:1746147250.783590:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2501 committed 00000004:00080000:0.0:1746147250.783591:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2506 committed 00000004:00080000:0.0:1746147250.783593:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2505 committed 00000004:00080000:0.0:1746147250.783594:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2500 committed 00000100:00100000:0.0:1746147250.784247:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147250.784258:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467005440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.784299:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.784335:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467005440 00000100:00100000:0.0:1746147250.784340:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467005440 00000100:00100000:0.0:1746147250.784362:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15366 00000100:00100000:0.0:1746147250.784366:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967467005440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.784522:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967467005440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (222us total) trans 21474841336 rc 0/0 00000100:00100000:0.0:1746147250.784527:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15366 00000100:00100000:0.0:1746147250.784554:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841322 gen 2 00000004:00080000:0.0:1746147250.784558:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb71f80, transno 21474841242 00000004:00080000:0.0:1746147250.784561:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb70e00, transno 21474841243 00000004:00080000:0.0:1746147250.784563:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb73100, transno 21474841244 00000004:00080000:0.0:1746147250.784565:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb70a80, transno 21474841245 00000004:00080000:0.0:1746147250.784567:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb72d80, transno 21474841246 00000004:00080000:0.0:1746147250.784569:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb71c00, transno 21474841247 00000004:00080000:0.0:1746147250.784571:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb71180, transno 21474841248 00000004:00080000:0.0:1746147250.784572:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb72680, transno 21474841249 00000004:00080000:0.0:1746147250.784574:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9c00, transno 21474841253 00000004:00080000:0.0:1746147250.784576:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8380, transno 21474841254 00000004:00080000:0.0:1746147250.784577:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9500, transno 21474841255 00000004:00080000:0.0:1746147250.784579:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8e00, transno 21474841256 00000004:00080000:0.0:1746147250.784581:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5ca680, transno 21474841257 00000004:00080000:0.0:1746147250.784583:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb72a00, transno 21474841258 00000004:00080000:0.0:1746147250.784585:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5caa00, transno 21474841259 00000004:00080000:0.0:1746147250.784586:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050a300, transno 21474841260 00000004:00080000:0.0:1746147250.784588:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fe680, transno 21474841261 00000004:00080000:0.0:1746147250.784590:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9ffb80, transno 21474841262 00000004:00080000:0.0:1746147250.784592:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fc000, transno 21474841263 00000004:00080000:0.0:1746147250.784593:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fc700, transno 21474841264 00000004:00080000:0.0:1746147250.784595:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fed80, transno 21474841265 00000004:00080000:0.0:1746147250.784596:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fc380, transno 21474841266 00000004:00080000:0.0:1746147250.784598:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fdf80, transno 21474841267 00000004:00080000:0.0:1746147250.784600:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fce00, transno 21474841268 00000004:00080000:0.0:1746147250.784602:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e3100, transno 21474841277 00000004:00080000:0.0:1746147250.784603:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e1880, transno 21474841278 00000004:00080000:0.0:1746147250.784606:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2300, transno 21474841279 00000004:00080000:0.0:1746147250.784607:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e3480, transno 21474841280 00000004:00080000:0.0:1746147250.784609:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c0e00, transno 21474841281 00000004:00080000:0.0:1746147250.784611:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2d80, transno 21474841282 00000004:00080000:0.0:1746147250.784613:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e2300, transno 21474841283 00000004:00080000:0.0:1746147250.784615:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e0700, transno 21474841284 00000004:00080000:0.0:1746147250.784618:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a4a80, transno 21474841288 00000004:00080000:0.0:1746147250.784621:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe1dc00, transno 21474841289 00000004:00080000:0.0:1746147250.784623:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a5500, transno 21474841290 00000004:00080000:0.0:1746147250.784625:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a4e00, transno 21474841291 00000004:00080000:0.0:1746147250.784627:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a4700, transno 21474841292 00000004:00080000:0.0:1746147250.784629:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe1ed80, transno 21474841293 00000004:00080000:0.0:1746147250.784631:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a5c00, transno 21474841294 00000004:00080000:0.0:1746147250.784633:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a6300, transno 21474841295 00000004:00080000:0.0:1746147250.784635:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1c00, transno 21474841296 00000004:00080000:0.0:1746147250.784637:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1f80, transno 21474841297 00000004:00080000:0.0:1746147250.784640:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df7aa00, transno 21474841298 00000004:00080000:0.0:1746147250.784642:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df79180, transno 21474841299 00000004:00080000:0.0:1746147250.784644:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047b80, transno 21474841300 00000004:00080000:0.0:1746147250.784646:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1500, transno 21474841301 00000004:00080000:0.0:1746147250.784648:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df7b480, transno 21474841302 00000004:00080000:0.0:1746147250.784650:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046300, transno 21474841303 00000004:00080000:0.0:1746147250.784652:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3800, transno 21474841304 00000004:00080000:0.0:1746147250.784654:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2d80, transno 21474841305 00000004:00080000:0.0:1746147250.784656:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f1500, transno 21474841306 00000004:00080000:0.0:1746147250.784658:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3100, transno 21474841307 00000004:00080000:0.0:1746147250.784660:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f1c00, transno 21474841308 00000004:00080000:0.0:1746147250.784661:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2a00, transno 21474841309 00000004:00080000:0.0:1746147250.784663:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2300, transno 21474841310 00000004:00080000:0.0:1746147250.784665:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2680, transno 21474841311 00000004:00080000:0.0:1746147250.784667:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f6a680, transno 21474841315 00000004:00080000:0.0:1746147250.784669:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f1500, transno 21474841316 00000004:00080000:0.0:1746147250.784671:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f6b100, transno 21474841317 00000004:00080000:0.0:1746147250.784672:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f3480, transno 21474841318 00000004:00080000:0.0:1746147250.784675:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4fad880, transno 21474841319 00000004:00080000:0.0:1746147250.784676:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f3100, transno 21474841320 00000004:00080000:0.0:1746147250.784679:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f1880, transno 21474841321 00000004:00080000:0.0:1746147250.784681:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f1180, transno 21474841322 00000100:00100000:0.0:1746147250.784687:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880134ed5c00 x1830967466995072/t21474841323(21474841323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147266 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147250.784694:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d5dc700/2, rc 0, transno 21474841336 00000100:00100000:0.0:1746147250.784697:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467005440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147250.785147:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 6 changes, 10 in progress, 1 in flight, 64 done 00010000:00010000:1.0:1746147250.785225:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785238:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785246:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147250.785255:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147250.785322:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785328:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785333:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785338:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f446000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.785340:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785346:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785358:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.785361:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147250.785364:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785368:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446000/0xb4b2209fbdad03e1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785380:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785385:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785389:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785392:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e559200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.785394:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785399:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785404:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147250.785406:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.785408:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785412:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559200/0xb4b2209fbdad03d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785418:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785423:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785427:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785430:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b26800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147250.785432:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785435:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785440:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f349500) 00010000:00010000:1.0:1746147250.785441:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147250.785442:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785446:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad03da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147250.785480:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad03cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec409 expref: 8 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.785486:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad03cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec409 expref: 8 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.785492:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b829e00, rc 0) 00000100:00100000:1.0:1746147250.785523:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31711:x1830967465618944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5038us (5115us total) trans 8589945357 rc 301/301 00000100:00100000:1.0:1746147250.785528:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11379 00000100:00100000:1.0:1746147250.785545:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467005824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.785569:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147250.785591:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467006336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.785606:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147250.785618:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147250.785622:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467005952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.785636:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147250.785661:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467005568 00000100:00100000:1.0:1746147250.785664:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467005568 00000100:00100000:1.0:1746147250.785678:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467005824 00000100:00100000:1.0:1746147250.785679:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467005824 00000100:00100000:1.0:1746147250.785687:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467006336 00000100:00100000:1.0:1746147250.785688:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467006336 00000100:00100000:1.0:1746147250.785696:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467005952 00000100:00100000:1.0:1746147250.785697:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467005952 00000100:00100000:1.0:1746147250.785706:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15367 00000100:00100000:1.0:1746147250.785710:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3295:x1830967467005568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.785796:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967467005568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1016us total) trans 21474841337 rc 0/0 00000100:00100000:1.0:1746147250.785801:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15367 00000100:00100000:1.0:1746147250.785811:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15368 00000100:00100000:1.0:1746147250.785815:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967467005824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.785892:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3293:x1830967467005824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (321us total) trans 21474841338 rc 0/0 00000100:00100000:1.0:1746147250.785897:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15368 00000100:00100000:1.0:1746147250.786000:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15369 00000100:00100000:1.0:1746147250.786006:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967467006336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.786083:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3293:x1830967467006336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (475us total) trans 21474841339 rc 0/0 00000100:00100000:1.0:1746147250.786089:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15369 00000100:00100000:1.0:1746147250.786098:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15370 00000100:00100000:1.0:1746147250.786102:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967467005952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147250.786190:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3293:x1830967467005952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (552us total) trans 21474841340 rc 0/0 00000100:00100000:1.0:1746147250.786195:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15370 00000004:00080000:1.0:1746147250.786220:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f32300/2, rc 0, transno 21474841340 00000100:00100000:1.0:1746147250.786223:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467005952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147250.786229:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f31880/2, rc 0, transno 21474841338 00000100:00100000:1.0:1746147250.786231:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467005824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147250.786236:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f31500/2, rc 0, transno 21474841339 00000100:00100000:1.0:1746147250.786239:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467006336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.788240:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467006720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788262:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.788272:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467007232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788283:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.788291:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147250.788294:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467006592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788304:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.788310:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467007104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.788333:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467006720 00000100:00100000:0.0:1746147250.788336:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467006720 00000100:00100000:0.0:1746147250.788350:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467007232 00000100:00100000:0.0:1746147250.788351:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467007232 00000100:00100000:0.0:1746147250.788356:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467006592 00000100:00100000:0.0:1746147250.788357:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467006592 00000100:00100000:0.0:1746147250.788362:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467007104 00000100:00100000:0.0:1746147250.788363:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467007104 00000100:00100000:0.0:1746147250.788370:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15378 00000100:00100000:0.0:1746147250.788374:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467006720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147250.788451:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147250.788453:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147250 -> 1746147250 00002000:00010000:0.0:1746147250.788455:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147250 -> 1746147250 00002000:00010000:0.0:1746147250.788457:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147250 -> 1746147250 00002000:00010000:0.0:1746147250.788459:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:0.0:1746147250.788533:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467006720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (269us total) trans 17179873978 rc 0/0 00000100:00100000:0.0:1746147250.788539:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15378 00000100:00100000:0.0:1746147250.788550:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15379 00000100:00100000:0.0:1746147250.788554:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467007232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788647:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467007232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (362us total) trans 17179873979 rc 0/0 00000100:00100000:0.0:1746147250.788652:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15379 00000100:00100000:0.0:1746147250.788661:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15380 00000100:00100000:0.0:1746147250.788665:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467006592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788733:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467006592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (427us total) trans 17179873980 rc 0/0 00000100:00100000:0.0:1746147250.788738:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15380 00000100:00100000:0.0:1746147250.788746:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15381 00000100:00100000:0.0:1746147250.788750:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467007104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147250.788815:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467007104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (493us total) trans 17179873981 rc 0/0 00000100:00100000:0.0:1746147250.788820:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15381 00000100:00100000:0.0:1746147250.788899:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873971 gen 2 00000004:00080000:0.0:1746147250.788903:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090508700, transno 17179873871 00000004:00080000:0.0:1746147250.788908:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b480, transno 17179873872 00000004:00080000:0.0:1746147250.788910:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090509880, transno 17179873873 00000004:00080000:0.0:1746147250.788912:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b800, transno 17179873874 00000004:00080000:0.0:1746147250.788914:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090508000, transno 17179873875 00000004:00080000:0.0:1746147250.788916:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090509c00, transno 17179873876 00000004:00080000:0.0:1746147250.788918:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb70380, transno 17179873877 00000004:00080000:0.0:1746147250.788920:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050ad80, transno 17179873878 00000004:00080000:0.0:1746147250.788922:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9180, transno 17179873879 00000004:00080000:0.0:1746147250.788924:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0e300, transno 17179873883 00000004:00080000:0.0:1746147250.788926:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0e680, transno 17179873884 00000004:00080000:0.0:1746147250.788928:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0c380, transno 17179873885 00000004:00080000:0.0:1746147250.788930:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009107ad80, transno 17179873886 00000004:00080000:0.0:1746147250.788932:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0ea00, transno 17179873887 00000004:00080000:0.0:1746147250.788933:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091079180, transno 17179873888 00000004:00080000:0.0:1746147250.788949:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0d880, transno 17179873889 00000004:00080000:0.0:1746147250.788951:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091079880, transno 17179873890 00000004:00080000:0.0:1746147250.788954:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f0e00, transno 17179873891 00000004:00080000:0.0:1746147250.788955:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e6f1c00, transno 17179873892 00000004:00080000:0.0:1746147250.788957:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5c700, transno 17179873893 00000004:00080000:0.0:1746147250.788959:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20bb80, transno 17179873894 00000004:00080000:0.0:1746147250.788962:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5e680, transno 17179873895 00000004:00080000:0.0:1746147250.788964:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b208e00, transno 17179873896 00000004:00080000:0.0:1746147250.788966:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5d180, transno 17179873897 00000004:00080000:0.0:1746147250.788968:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5ed80, transno 17179873898 00000004:00080000:0.0:1746147250.788970:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5f100, transno 17179873899 00000004:00080000:0.0:1746147250.788972:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcb100, transno 17179873900 00000004:00080000:0.0:1746147250.788975:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df79500, transno 17179873909 00000004:00080000:0.0:1746147250.788977:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df78a80, transno 17179873910 00000004:00080000:0.0:1746147250.788979:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df79f80, transno 17179873911 00000004:00080000:0.0:1746147250.788981:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c85f100, transno 17179873912 00000004:00080000:0.0:1746147250.788983:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df7a300, transno 17179873913 00000004:00080000:0.0:1746147250.788985:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c85c700, transno 17179873914 00000004:00080000:0.0:1746147250.788987:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4fae300, transno 17179873915 00000004:00080000:0.0:1746147250.788989:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df7b100, transno 17179873916 00000004:00080000:0.0:1746147250.788991:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f66bb80, transno 17179873917 00000004:00080000:0.0:1746147250.788994:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a5880, transno 17179873921 00000004:00080000:0.0:1746147250.788997:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977800, transno 17179873922 00000004:00080000:0.0:1746147250.788998:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977100, transno 17179873923 00000004:00080000:0.0:1746147250.789000:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975500, transno 17179873924 00000004:00080000:0.0:1746147250.789002:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974000, transno 17179873925 00000004:00080000:0.0:1746147250.789004:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974e00, transno 17179873926 00000004:00080000:0.0:1746147250.789006:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977480, transno 17179873927 00000004:00080000:0.0:1746147250.789008:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974a80, transno 17179873928 00000004:00080000:0.0:1746147250.789010:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975180, transno 17179873929 00000004:00080000:0.0:1746147250.789012:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df480, transno 17179873930 00000004:00080000:0.0:1746147250.789014:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dce00, transno 17179873931 00000004:00080000:0.0:1746147250.789016:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddc00, transno 17179873932 00000004:00080000:0.0:1746147250.789018:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e584000, transno 17179873933 00000004:00080000:0.0:1746147250.789020:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dfb80, transno 17179873934 00000004:00080000:0.0:1746147250.789021:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e586d80, transno 17179873935 00000004:00080000:0.0:1746147250.789024:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddf80, transno 17179873936 00000004:00080000:0.0:1746147250.789026:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e587800, transno 17179873937 00000004:00080000:0.0:1746147250.789028:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d5dca80, transno 17179873938 00000004:00080000:0.0:1746147250.789030:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919180, transno 17179873942 00000004:00080000:0.0:1746147250.789032:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e918a80, transno 17179873943 00000004:00080000:0.0:1746147250.789033:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e91b800, transno 17179873944 00000004:00080000:0.0:1746147250.789035:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919c00, transno 17179873945 00000004:00080000:0.0:1746147250.789037:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f1f80, transno 17179873946 00000004:00080000:0.0:1746147250.789039:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919f80, transno 17179873947 00000004:00080000:0.0:1746147250.789041:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e918700, transno 17179873948 00000004:00080000:0.0:1746147250.789043:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3480, transno 17179873949 00000004:00080000:0.0:1746147250.789045:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e91a680, transno 17179873950 00000004:00080000:0.0:1746147250.789048:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f85880, transno 17179873954 00000004:00080000:0.0:1746147250.789050:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f30700, transno 17179873955 00000004:00080000:0.0:1746147250.789052:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f86680, transno 17179873956 00000004:00080000:0.0:1746147250.789054:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f86300, transno 17179873957 00000004:00080000:0.0:1746147250.789056:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f84a80, transno 17179873958 00000004:00080000:0.0:1746147250.789058:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f30000, transno 17179873959 00000004:00080000:0.0:1746147250.789060:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f30380, transno 17179873960 00000004:00080000:0.0:1746147250.789062:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f84e00, transno 17179873961 00000004:00080000:0.0:1746147250.789063:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f32a00, transno 17179873962 00000004:00080000:0.0:1746147250.789065:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed7800, transno 17179873963 00000004:00080000:0.0:1746147250.789067:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d78700, transno 17179873964 00000004:00080000:0.0:1746147250.789069:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed7b80, transno 17179873965 00000004:00080000:0.0:1746147250.789071:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d78a80, transno 17179873966 00000004:00080000:0.0:1746147250.789072:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d78000, transno 17179873967 00000004:00080000:0.0:1746147250.789074:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d78e00, transno 17179873968 00000004:00080000:0.0:1746147250.789075:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d78380, transno 17179873969 00000004:00080000:0.0:1746147250.789077:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d79180, transno 17179873970 00000004:00080000:0.0:1746147250.789079:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046d80, transno 17179873971 00000100:00100000:0.0:1746147250.789085:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f733100 x1830967467006592/t17179873980(17179873980) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147266 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147250.789092:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f733100/2, rc 0, transno 17179873980 00000100:00100000:0.0:1746147250.789096:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467006592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147250.789106:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f733b80/2, rc 0, transno 17179873981 00000100:00100000:0.0:1746147250.789109:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467007104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147250.789114:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f731f80/2, rc 0, transno 17179873978 00000100:00100000:0.0:1746147250.789116:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467006720:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147250.789121:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094400700/2, rc 0, transno 17179873979 00000100:00100000:0.0:1746147250.789124:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467007232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147250.790784:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465619200 00000100:00100000:1.0:1746147250.790788:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465619200 00000100:00100000:1.0:1746147250.790817:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4734 00000100:00100000:1.0:1746147250.790822:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+301:31703:x1830967465619200:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147250.790866:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+301:31703:x1830967465619200:12345-192.168.203.36@tcp:49:cat.0 Request processed in 44us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.790871:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4734 00000100:00100000:1.0:1746147250.791444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.791499:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465619328 00000100:00100000:0.0:1746147250.791502:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465619328 00000100:00100000:0.0:1746147250.791520:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11382 00000100:00100000:0.0:1746147250.791524:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31711:x1830967465619328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.791530:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.791537:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49edc00/0xb4b2209fbdad0412 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec417 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.791572:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad0419 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.791579:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad0419 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.791585:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad0419 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:0.0:1746147250.791598:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147250.791601:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147250.791624:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad0419 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147250.791642:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49edc00/0xb4b2209fbdad0412 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec417 expref: 11 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.791652:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad0419 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec417 expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.791657:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147250.791659:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147250.791661:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5c1600, rc 0) 00000100:00100000:0.0:1746147250.791900:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31711:x1830967465619328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 374us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.791905:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11382 00000100:00100000:0.0:1746147250.795079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.795824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.797018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.798496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.798673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.799429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.800322:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620480 00000100:00100000:1.0:1746147250.800325:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620480 00000100:00100000:1.0:1746147250.800336:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620096 00000100:00100000:1.0:1746147250.800337:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620096 00000100:00100000:1.0:1746147250.800342:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620352 00000100:00100000:1.0:1746147250.800343:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620352 00000100:00100000:1.0:1746147250.800347:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620608 00000100:00100000:1.0:1746147250.800348:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620608 00000100:00100000:1.0:1746147250.800352:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620736 00000100:00100000:1.0:1746147250.800353:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620736 00000100:00100000:1.0:1746147250.800358:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620992 00000100:00100000:1.0:1746147250.800359:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620992 00000100:00100000:1.0:1746147250.800364:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465621248 00000100:00100000:1.0:1746147250.800365:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465621248 00000100:00100000:1.0:1746147250.800370:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465620864 00000100:00100000:1.0:1746147250.800371:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465620864 00000100:00100000:1.0:1746147250.800375:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465621120 00000100:00100000:1.0:1746147250.800376:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465621120 00000100:00100000:1.0:1746147250.800380:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465621376 00000100:00100000:1.0:1746147250.800381:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465621376 00000100:00100000:1.0:1746147250.800387:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15385 00000100:00100000:1.0:1746147250.800391:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465620480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.800399:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800405:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9600/0xb4b2209fbdad0466 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec448 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800416:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800417:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800421:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9600/0xb4b2209fbdad0466 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec448 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800430:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9600/0xb4b2209fbdad0466 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec448 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800436:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9600, rc 0) 00000100:00100000:1.0:1746147250.800453:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465620480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 62us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800457:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15385 00000100:00100000:1.0:1746147250.800467:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15386 00000100:00100000:1.0:1746147250.800471:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465620096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.800476:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800483:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec433 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147250.800492:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417b2, atime: 0x681417b2, ctime: 0x681417b2, blocks: 0x821 00010000:00010000:1.0:1746147250.800498:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800499:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800503:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec433 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800515:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec433 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800521:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9e00, rc 0) 00000100:00100000:1.0:1746147250.800534:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465620096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800538:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15386 00000100:00100000:1.0:1746147250.800546:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15387 00000100:00100000:1.0:1746147250.800550:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465620352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.800555:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800566:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdad0474 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec441 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147250.800575:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417b2, atime: 0x681417b2, ctime: 0x681417b2, blocks: 0x821 00010000:00010000:1.0:1746147250.800581:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800582:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800586:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdad0474 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec441 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800592:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8a00/0xb4b2209fbdad0474 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec441 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800598:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8a00, rc 0) 00000100:00100000:1.0:1746147250.800611:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465620352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 60us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800618:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15387 00000100:00100000:1.0:1746147250.800628:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15388 00000100:00100000:1.0:1746147250.800632:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465620608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.800637:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800642:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec44f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800649:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800650:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800654:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec44f expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800660:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec44f expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800666:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8800, rc 0) 00000100:00100000:1.0:1746147250.800676:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465620608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 45us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800680:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15388 00000100:00100000:1.0:1746147250.800686:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15389 00000100:00100000:1.0:1746147250.800689:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465620736:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147250.800694:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800698:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0482 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec456 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800705:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800706:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800709:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0482 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec456 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800715:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0482 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec456 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800720:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4a800, rc 0) 00000100:00100000:1.0:1746147250.800728:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465620736:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800732:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15389 00000100:00100000:1.0:1746147250.800737:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15390 00000100:00100000:1.0:1746147250.800740:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465620992:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147250.800744:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800747:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b800/0xb4b2209fbdad0489 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec464 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800754:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800755:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800757:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b800/0xb4b2209fbdad0489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec464 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800764:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b800/0xb4b2209fbdad0489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec464 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800768:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4b800, rc 0) 00000100:00100000:1.0:1746147250.800776:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465620992:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800782:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15390 00000100:00100000:1.0:1746147250.800788:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15391 00000100:00100000:1.0:1746147250.800791:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465621248:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147250.800795:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800800:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b200/0xb4b2209fbdad0490 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec472 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800807:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800808:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800812:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b200/0xb4b2209fbdad0490 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec472 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800818:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b200/0xb4b2209fbdad0490 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec472 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800825:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4b200, rc 0) 00000100:00100000:1.0:1746147250.800836:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465621248:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 44us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800840:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15391 00000100:00100000:1.0:1746147250.800848:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15392 00000100:00100000:1.0:1746147250.800853:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465620864:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147250.800857:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800861:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec45d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800869:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800870:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800874:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800881:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800886:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4a400, rc 0) 00000100:00100000:1.0:1746147250.800897:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465620864:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 45us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800901:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15392 00000100:00100000:1.0:1746147250.800907:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15393 00000100:00100000:1.0:1746147250.800911:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465621120:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147250.800915:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800919:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b400/0xb4b2209fbdad049e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec46b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800925:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800926:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800929:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b400/0xb4b2209fbdad049e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec46b expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800953:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b400/0xb4b2209fbdad049e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec46b expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.800959:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4b400, rc 0) 00000100:00100000:1.0:1746147250.800968:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465621120:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 56us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.800974:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15393 00000100:00100000:1.0:1746147250.800981:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15394 00000100:00100000:1.0:1746147250.800984:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465621376:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147250.800988:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.800992:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec479 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.800998:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.800999:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147250.801001:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec479 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.801008:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec479 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147250.801013:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4aa00, rc 0) 00000100:00100000:1.0:1746147250.801019:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465621376:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 35us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.801023:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15394 00000100:00100000:0.0:1746147250.826543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.826589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.826618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.826644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.826691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.826769:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465622784 00000100:00100000:1.0:1746147250.826773:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465622784 00002000:00100000:1.0:1746147250.826799:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009fe1dc00 x1830967465622784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.826807:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe1dc00 with x1830967465622784 ext(1048576->2097151) 00002000:00010000:1.0:1746147250.826810:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe1dc00 00000100:00100000:1.0:1746147250.826993:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7241 00000100:00100000:1.0:1746147250.827001:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465622528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.827320:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7243 00000100:00100000:0.0:1746147250.827328:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465622912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.827549:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7244 00000100:00100000:0.0:1746147250.827554:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465623040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147250.833693:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465623552 00000100:00100000:1.0:1746147250.833700:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465623552 00010000:00010000:1.0:1746147250.833727:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xb4b2209fbdad0427 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec425 expref: 8 pid: 14047 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.833747:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465623680 00000100:00100000:1.0:1746147250.833749:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465623680 00010000:00010000:1.0:1746147250.833756:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65600/0xb4b2209fbdad040b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec410 expref: 9 pid: 14048 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.833765:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465623808 00000100:00100000:1.0:1746147250.833766:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465623808 00010000:00010000:1.0:1746147250.833774:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec402 expref: 302 pid: 14125 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.833785:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7790 00000100:00100000:1.0:1746147250.833790:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465623552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.833800:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.833804:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xb4b2209fbdad0427 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec425 expref: 9 pid: 14047 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.833812:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xb4b2209fbdad0427 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec425 expref: 9 pid: 14047 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.833828:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.833832:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.833841:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.833845:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.833876:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465623552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.833882:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7790 00000100:00100000:1.0:1746147250.833898:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7791 00000100:00100000:1.0:1746147250.833901:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465623680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.833907:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.833910:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65600/0xb4b2209fbdad040b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec410 expref: 8 pid: 14048 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.833916:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65600/0xb4b2209fbdad040b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec410 expref: 8 pid: 14048 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.833924:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.833927:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.833931:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.833955:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.833969:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465623680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.833974:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7791 00000100:00100000:1.0:1746147250.834002:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7792 00000100:00100000:1.0:1746147250.834009:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1957:x1830967465623808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147250.834014:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147250.834017:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec402 expref: 302 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.834024:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5426800/0xb4b2209fbdad03c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec402 expref: 302 pid: 14125 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746147250.834033:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147250.834036:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.834041:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.834046:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147250.834058:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147250.834071:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1957:x1830967465623808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.834075:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7792 00000100:00100000:0.0:1746147250.848898:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465622912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21564us (22272us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147250.848910:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7243 00002000:00100000:0.0:1746147250.848921:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009fe1ed80 x1830967465622912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.848930:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe1ed80 with x1830967465622912 ext(0->1048575) 00002000:00010000:0.0:1746147250.848954:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe1ed80 00000100:00100000:1.0:1746147250.857959:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465623040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30381us (31289us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147250.857970:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7244 00002000:00100000:1.0:1746147250.857980:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8801312a5880 x1830967465623040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.857989:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5880 with x1830967465623040 ext(1048576->2097151) 00002000:00010000:1.0:1746147250.857995:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5880 00000100:00100000:0.0:1746147250.860965:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465622528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 33959us (34426us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147250.860975:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7241 00002000:00100000:0.0:1746147250.860984:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df75880 x1830967465622528/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.860993:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df75880 with x1830967465622528 ext(1048576->2097151) 00002000:00010000:0.0:1746147250.861001:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df75880 00000001:00080000:0.0:1746147250.868839:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945357 is committed 00000001:00080000:0.0:1746147250.868852:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945360 is committed 00000004:00080000:0.0:1746147250.868855:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2520 committed 00000004:00080000:0.0:1746147250.868860:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2517 committed 00000004:00080000:0.0:1746147250.868872:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2516 committed 00000004:00080000:0.0:1746147250.868873:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2515 committed 00000004:00080000:0.0:1746147250.868875:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2514 committed 00000004:00080000:0.0:1746147250.868876:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2519 committed 00000004:00080000:0.0:1746147250.868877:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2513 committed 00000004:00080000:0.0:1746147250.868879:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2518 committed 00000004:00080000:0.0:1746147250.868880:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2512 committed 00000004:00080000:0.0:1746147250.868881:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2517 committed 00000004:00080000:0.0:1746147250.868882:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2516 committed 00000004:00080000:0.0:1746147250.868884:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2515 committed 00000004:00080000:0.0:1746147250.868885:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2511 committed 00000004:00080000:0.0:1746147250.868886:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2510 committed 00000004:00080000:0.0:1746147250.868887:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2514 committed 00000004:00080000:0.0:1746147250.868889:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2513 committed 00000004:00080000:0.0:1746147250.868890:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2509 committed 00000001:00080000:0.0:1746147250.868897:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945359 is committed 00000100:00100000:0.0:1746147250.868987:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467008512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869017:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.869035:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467009024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.869064:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467008640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.869088:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467009152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869099:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.869107:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147250.869111:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467008768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869121:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.869131:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467009280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869141:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147250.869239:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15396 00000100:00100000:0.0:1746147250.869244:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3296:x1830967467009024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147250.869329:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147250.869332:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147250.869334:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147250.869335:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147250.869337:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147250.869359:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3296:x1830967467009024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (311us total) trans 21474841344 rc 0/0 00000100:00100000:0.0:1746147250.869364:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15396 00000100:00100000:0.0:1746147250.869375:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15399 00000100:00100000:0.0:1746147250.869378:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830967467009152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869442:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830967467009152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (342us total) trans 21474841346 rc 0/0 00000100:00100000:0.0:1746147250.869449:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15399 00000100:00100000:0.0:1746147250.869462:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15401 00000100:00100000:0.0:1746147250.869466:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3293:x1830967467009280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.869523:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830967467009280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (380us total) trans 21474841348 rc 0/0 00000100:00100000:0.0:1746147250.869527:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15401 00000004:00080000:0.0:1746147250.869560:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2300/2, rc 0, transno 21474841344 00000100:00100000:0.0:1746147250.869564:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467009024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147250.871145:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a4e00/2, rc 0, transno 21474841351 00000100:00100000:0.0:1746147250.871148:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467008512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147250.874438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.874466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.874639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.877041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.877077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.879869:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.890969:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465625600 00000100:00100000:0.0:1746147250.890972:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465625600 00000100:00100000:0.0:1746147250.890986:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15413 00000100:00100000:0.0:1746147250.890990:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31710:x1830967465625088:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147250.890998:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.891009:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdad04cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4aa expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.891028:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3f4 expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.891035:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec479 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.891042:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec44f expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.891047:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.891048:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147250.891051:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdad04cf lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2633728->3026943] (req 2633728->3026943) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4aa expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.891072:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec44f expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.891081:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec44f expref: 13 pid: 21080 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.891091:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467010688:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.891145:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec479 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147250.891168:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec479 expref: 8 pid: 21080 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746147250.891175:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467010816:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.891204:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3f4 expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.891211:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3f4 expref: 20 pid: 21080 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746147250.891219:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467011200:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147250.891233:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.898189:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465625856 00000100:00100000:0.0:1746147250.898193:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465625856 00002000:00100000:0.0:1746147250.898215:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b409880 x1830967465625856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.898223:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409880 with x1830967465625856 ext(1048576->2097151) 00002000:00010000:0.0:1746147250.898226:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b409880 00000100:00100000:0.0:1746147250.898238:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7245 00000100:00100000:0.0:1746147250.898242:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465625856:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147250.899455:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdad047b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec44f expref: 15 pid: 21080 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746147250.899470:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467010688:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.899480:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdad04a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec479 expref: 8 pid: 21080 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746147250.899488:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467010816:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.899498:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad03b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec3f4 expref: 21 pid: 21080 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746147250.899505:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467011200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147250.899521:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdad04cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4aa expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147250.899528:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1515c00, rc 0) 00000100:00100000:1.0:1746147250.899546:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31710:x1830967465625088:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8555us (8739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147250.899551:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15413 00000100:00100000:1.0:1746147250.903308:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465626752 00000100:00100000:1.0:1746147250.903316:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465626752 00002000:00100000:1.0:1746147250.903351:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094d79180 x1830967465626752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.903359:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79180 with x1830967465626752 ext(4194304->4976639) 00002000:00010000:1.0:1746147250.903365:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79180 00000100:00100000:1.0:1746147250.903384:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7246 00000100:00100000:1.0:1746147250.903390:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465626752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147250.913769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.913829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.913844:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465627008 00000100:00100000:0.0:1746147250.913848:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465627008 00002000:00100000:0.0:1746147250.913868:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2633728->2637823) req@ffff88012c9f3480 x1830967465627008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.913874:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3480 with x1830967465627008 ext(2633728->2637823) 00002000:00010000:0.0:1746147250.913876:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3480 00000100:00100000:0.0:1746147250.913886:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465627264 00000100:00100000:0.0:1746147250.913887:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465627264 00002000:00100000:0.0:1746147250.913894:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1085440->1089535) req@ffff88012c9f0e00 x1830967465627264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.913899:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967465627264 ext(1085440->1089535) 00002000:00010000:0.0:1746147250.913901:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:0.0:1746147250.913908:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7247 00000100:00100000:0.0:1746147250.913912:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465627008:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147250.914029:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465627008:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 116us (261us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147250.914034:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7247 00002000:00100000:0.0:1746147250.914038:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2633728->2637823) req@ffff88012c9f3480 x1830967465627008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.914044:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3480 with x1830967465627008 ext(2633728->2637823) 00002000:00010000:0.0:1746147250.914047:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3480 00000100:00100000:0.0:1746147250.914057:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7248 00000100:00100000:0.0:1746147250.914062:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465627264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147250.914148:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465626752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10757us (12059us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147250.914165:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7246 00002000:00100000:1.0:1746147250.914169:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094d79180 x1830967465626752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/440 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147250.914175:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79180 with x1830967465626752 ext(4194304->4976639) 00002000:00010000:1.0:1746147250.914178:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79180 00000100:00100000:0.0:1746147250.914205:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465627264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 142us (375us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147250.914213:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7248 00002000:00100000:0.0:1746147250.914217:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1085440->1089535) req@ffff88012c9f0e00 x1830967465627264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.914223:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967465627264 ext(1085440->1089535) 00002000:00010000:0.0:1746147250.914225:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:0.0:1746147250.920600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.921897:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465627776 00000100:00100000:0.0:1746147250.921902:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465627776 00002000:00100000:0.0:1746147250.921920:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3022848->3026943) req@ffff88009e6f1c00 x1830967465627776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.921926:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1c00 with x1830967465627776 ext(3022848->3026943) 00002000:00010000:0.0:1746147250.921929:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f1c00 00000100:00100000:0.0:1746147250.921971:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7250 00000100:00100000:0.0:1746147250.921977:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465627776:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147250.922058:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465627776:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 81us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147250.922064:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7250 00002000:00100000:0.0:1746147250.922068:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3022848->3026943) req@ffff88009e6f1c00 x1830967465627776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746147261 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.922074:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1c00 with x1830967465627776 ext(3022848->3026943) 00002000:00010000:0.0:1746147250.922076:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f1c00 00000100:00100000:0.0:1746147250.922736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.922792:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465627904 00000100:00100000:1.0:1746147250.922797:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465627904 00000100:00100000:1.0:1746147250.922830:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15418 00000100:00100000:1.0:1746147250.922835:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967465627904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147250.922844:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147250.922855:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdad04f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4cd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147250.922891:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467011584:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147250.923045:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.924290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.924621:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465628160 00000100:00100000:1.0:1746147250.924626:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465628160 00000100:00100000:1.0:1746147250.924663:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4739 00000100:00100000:1.0:1746147250.924668:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31710:x1830967465628160:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147250.925024:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31710:x1830967465628160:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 355us (734us total) trans 8589945361 rc 0/0 00000100:00100000:1.0:1746147250.925031:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4739 00000100:00100000:0.0:1746147250.930136:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465628416 00000100:00100000:0.0:1746147250.930142:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465628416 00000100:00100000:0.0:1746147250.930177:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15419 00000100:00100000:0.0:1746147250.930182:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967465628416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147250.930192:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147250.930205:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5764e00/0xb4b2209fbdad0500 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4d4 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147250.930238:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467011712:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147250.930277:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147250.930319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.930682:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465628800 00000100:00100000:1.0:1746147250.930686:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465628800 00000100:00100000:1.0:1746147250.930708:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4740 00000100:00100000:1.0:1746147250.930712:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+301:31713:x1830967465628800:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147250.930834:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31713:x1830967465628800:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 121us (513us total) trans 8589945362 rc 0/0 00000100:00100000:1.0:1746147250.930839:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4740 00000100:00100000:0.0:1746147250.951146:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147250.951694:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465629056 00000100:00100000:1.0:1746147250.951705:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465629056 00000100:00100000:1.0:1746147250.951758:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4741 00000100:00100000:1.0:1746147250.951765:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31703:x1830967465629056:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147250.951957:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31703:x1830967465629056:12345-192.168.203.36@tcp:35:cat.0 Request processed in 170us (799us total) trans 8589945363 rc 0/0 00000100:00100000:1.0:1746147250.951963:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4741 00000100:00100000:0.0:1746147250.954442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.959551:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467011840:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147250.959586:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1514400/0xb4b2209fbdad0507 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4db expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147250.959603:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1514400, rc 0) 00000100:00100000:0.0:1746147250.959671:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31711:x1830967465629184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4993us (5232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147250.959679:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15420 00000100:00100000:1.0:1746147250.960535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.979387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147250.983781:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465629696 00000100:00100000:0.0:1746147250.983787:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465629696 00002000:00100000:0.0:1746147250.983817:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880094d79880 x1830967465629696/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:626/0 lens 488/0 e 0 to 0 dl 1746147261 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147250.983832:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79880 with x1830967465629696 ext(1048576->2097151) 00002000:00010000:0.0:1746147250.983835:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79880 00000100:00100000:0.0:1746147250.983857:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7252 00000100:00100000:0.0:1746147250.983862:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465629696:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147251.001443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.001489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.001515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.001545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.001559:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465629952 00000100:00100000:1.0:1746147251.001571:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465629952 00000100:00100000:0.0:1746147251.001585:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465630208 00000100:00100000:0.0:1746147251.001591:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465630208 00002000:00100000:0.0:1746147251.001623:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c9f2300 x1830967465630208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.001624:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c9f2a00 x1830967465629952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.001633:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967465629952 ext(2097152->3145727) 00002000:00100000:0.0:1746147251.001633:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2300 with x1830967465630208 ext(3145728->4194303) 00002000:00010000:1.0:1746147251.001638:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2a00 00002000:00010000:0.0:1746147251.001638:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2300 00000100:00100000:1.0:1746147251.001666:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465630464 00000100:00100000:1.0:1746147251.001669:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465630464 00002000:00100000:1.0:1746147251.001686:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3538943) req@ffff88012c9f2680 x1830967465630464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 504/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.001692:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967465630464 ext(2097152->3538943) 00002000:00010000:1.0:1746147251.001696:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:0.0:1746147251.001962:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465630720 00000100:00100000:0.0:1746147251.001965:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465630720 00002000:00100000:0.0:1746147251.001980:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3538944->4194303) req@ffff88012c9f2d80 x1830967465630720/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.001987:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2d80 with x1830967465630720 ext(3538944->4194303) 00002000:00010000:0.0:1746147251.001990:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2d80 00000100:00100000:0.0:1746147251.002003:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7253 00000100:00100000:0.0:1746147251.002011:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465629952:12345-192.168.203.36@tcp:3:cat.0 00000100:00080000:0.0:1746147251.003062:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147251.003067:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147251.003682:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7256 00000100:00100000:0.0:1746147251.003694:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465630720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.003740:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465630208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.024853:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465629952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22831us (23409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.024868:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7253 00002000:00100000:1.0:1746147251.024882:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c9f2a00 x1830967465629952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.024892:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967465629952 ext(2097152->3145727) 00002000:00010000:1.0:1746147251.024899:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2a00 00000100:00100000:1.0:1746147251.026337:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465630208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23345us (24843us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.026345:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7254 00002000:00100000:1.0:1746147251.026352:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c9f2300 x1830967465630208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.026359:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2300 with x1830967465630208 ext(3145728->4194303) 00002000:00010000:1.0:1746147251.026363:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2300 00000100:00100000:0.0:1746147251.035923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.037981:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465630976 00000100:00100000:1.0:1746147251.037996:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465630976 00002000:00100000:1.0:1746147251.038046:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c9f3800 x1830967465630976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.038057:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3800 with x1830967465630976 ext(4194304->4976639) 00002000:00010000:1.0:1746147251.038064:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3800 00000100:00100000:1.0:1746147251.038098:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7257 00000100:00100000:1.0:1746147251.038106:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465630976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.052020:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465630976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13902us (16095us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746147251.052035:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7257 00002000:00100000:0.0:1746147251.052048:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c9f3800 x1830967465630976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.052057:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3800 with x1830967465630976 ext(4194304->4976639) 00002000:00010000:0.0:1746147251.052064:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3800 00000100:00100000:0.0:1746147251.059395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.062184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.062228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.062310:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465631488 00000100:00100000:1.0:1746147251.062319:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465631488 00000100:00100000:1.0:1746147251.062358:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11390 00000100:00100000:1.0:1746147251.062365:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31719:x1830967465631488:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147251.062387:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.062401:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad0531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4e9 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.062496:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062508:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062517:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062529:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062535:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062540:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062636:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062648:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062653:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147251.062662:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147251.062733:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062739:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062745:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062750:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485a200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.062754:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062760:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062770:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147251.062773:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147251.062776:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.062781:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0546 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063832:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063843:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063849:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063853:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485a800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.063856:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063861:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063868:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147251.063870:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147251.063873:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063878:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063885:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063889:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063894:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063898:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485b600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.063900:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063908:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063914:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f400) 00010000:00010000:1.0:1746147251.063915:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147251.063917:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063922:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad053f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.063970:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad0531 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4e9 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.063977:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad0531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4e9 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.063985:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485aa00, rc 0) 00000100:00100000:1.0:1746147251.064520:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31719:x1830967465631488:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2153us (2340us total) trans 8589945365 rc 301/301 00000100:00100000:1.0:1746147251.064527:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11390 00000100:00100000:0.0:1746147251.203410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.203500:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465632000 00000100:00100000:1.0:1746147251.203508:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465632000 00000100:00100000:1.0:1746147251.203553:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11391 00000100:00100000:1.0:1746147251.203559:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31727:x1830967465632000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147251.203577:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.203591:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ae00/0xb4b2209fbdad0554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4f0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.203679:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203690:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203699:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203709:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203714:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203720:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203801:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203808:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203814:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147251.203821:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147251.203878:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203884:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203892:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203896:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485a800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.203899:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203903:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203911:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147251.203913:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147251.203916:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203920:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad0569 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203934:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203962:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203966:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203970:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485aa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.203971:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203975:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203983:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147251.203984:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147251.203986:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203990:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485aa00/0xb4b2209fbdad055b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203995:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.203998:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.204002:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.204005:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485b600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.204007:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.204011:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.204015:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f100) 00010000:00010000:1.0:1746147251.204016:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147251.204018:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.204021:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b600/0xb4b2209fbdad0562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.204043:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ae00/0xb4b2209fbdad0554 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4f0 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.204050:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ae00/0xb4b2209fbdad0554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4f0 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.204055:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485ae00, rc 0) 00000100:00100000:1.0:1746147251.204096:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31727:x1830967465632000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 537us (693us total) trans 8589945367 rc 301/301 00000100:00100000:1.0:1746147251.204101:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11391 00000100:00100000:0.0:1746147251.208838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.208925:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465632256 00000100:00100000:1.0:1746147251.208933:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465632256 00000100:00100000:1.0:1746147251.209009:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11392 00000100:00100000:1.0:1746147251.209017:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31725:x1830967465632256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147251.209035:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.209049:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4f7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.209126:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209136:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209145:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209163:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209169:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209178:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209254:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209260:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209265:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147251.209271:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147251.209323:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209328:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209334:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209338:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485ac00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.209340:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209345:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209352:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147251.209354:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147251.209356:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209363:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdad058c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209377:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209380:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209384:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209387:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485b000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.209389:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209392:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209396:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147251.209398:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147251.209400:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209403:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485b000/0xb4b2209fbdad057e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209407:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209411:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209414:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209418:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485a600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147251.209420:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209424:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209428:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f800) 00010000:00010000:1.0:1746147251.209430:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147251.209431:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209435:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a600/0xb4b2209fbdad0585 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147251.209473:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0577 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4f7 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.209479:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad0577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4f7 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.209486:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485a200, rc 0) 00000100:00100000:1.0:1746147251.209521:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31725:x1830967465632256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 506us (689us total) trans 8589945368 rc 301/301 00000100:00100000:1.0:1746147251.209527:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11392 00000100:00100000:0.0:1746147251.212807:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465632384 00000100:00100000:0.0:1746147251.212816:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465632384 00000100:00100000:0.0:1746147251.212860:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11393 00000100:00100000:0.0:1746147251.212866:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31727:x1830967465632384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147251.212884:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.212898:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad059a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec4fe expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.212983:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147251.212997:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147251.213006:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147251.213025:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147251.213028:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147251.213039:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147251.213057:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad059a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.213084:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.213091:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147251.213093:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147251.213096:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537ee00, rc 0) 00000100:00100000:0.0:1746147251.213136:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31727:x1830967465632384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 271us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147251.213142:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11393 00000100:00100000:0.0:1746147251.214079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.219434:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465632640 00000100:00100000:0.0:1746147251.219442:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465632640 00000100:00100000:0.0:1746147251.219479:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465632768 00000100:00100000:0.0:1746147251.219481:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465632768 00000100:00100000:0.0:1746147251.219503:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15421 00000100:00100000:0.0:1746147251.219509:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465632640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147251.219522:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.219536:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec50c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.219554:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.219556:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.219562:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec50c expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.219576:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec50c expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.219585:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537e400, rc 0) 00000100:00100000:0.0:1746147251.219619:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465632640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147251.219625:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15421 00000100:00100000:0.0:1746147251.219640:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15422 00000100:00100000:0.0:1746147251.219644:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967465632768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147251.219651:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.219658:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537e800/0xb4b2209fbdad05bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec513 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147251.219689:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012096:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147251.219738:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.229822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.230662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.230682:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465633152 00000100:00100000:0.0:1746147251.230685:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465633152 00002000:00100000:0.0:1746147251.230711:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800a4fae300 x1830967465633152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.230719:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967465633152 ext(0->1048575) 00002000:00010000:0.0:1746147251.230723:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:0.0:1746147251.230749:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7258 00000100:00100000:0.0:1746147251.230755:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465633152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.234466:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012096:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147251.234496:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537e800/0xb4b2209fbdad05bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec513 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234514:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537e800/0xb4b2209fbdad05bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec513 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234530:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537e800, rc 0) 00000100:00100000:1.0:1746147251.234571:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967465632768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 14925us (15202us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147251.234579:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15422 00000100:00100000:1.0:1746147251.234601:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15423 00000100:00100000:1.0:1746147251.234610:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31719:x1830967465632896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147251.234621:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.234632:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec51a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.234649:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdad045f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec43a expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234657:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad04eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4bf expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234664:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b800/0xb4b2209fbdad0489 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec464 expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234670:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.234671:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.234674:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1372160->2084863] (req 1372160->2084863) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.234696:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b800/0xb4b2209fbdad0489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec464 expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234706:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b800/0xb4b2209fbdad0489 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec464 expref: 7 pid: 21080 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746147251.234715:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012224:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.234767:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad04eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4bf expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234775:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad04eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4bf expref: 19 pid: 8478 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746147251.234782:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012352:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.234801:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdad045f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec43a expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.234809:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdad045f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec43a expref: 13 pid: 8481 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746147251.234815:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012480:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147251.234830:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.243612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.244135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.244646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.245063:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012224:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.245080:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad04eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4bf expref: 19 pid: 8478 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746147251.245093:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012352:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147251.245101:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012480:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.245700:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [1372160->2084863] (req 1372160->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.245709:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485a200, rc 0) 00000100:00100000:1.0:1746147251.245732:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31719:x1830967465632896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11125us (15917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.245737:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15423 00000100:00100000:1.0:1746147251.246198:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465633152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15441us (15534us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.246206:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7258 00002000:00100000:1.0:1746147251.246214:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800a4fae300 x1830967465633152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.246221:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967465633152 ext(0->1048575) 00002000:00010000:1.0:1746147251.246224:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:1.0:1746147251.254541:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7261 00000100:00100000:1.0:1746147251.254549:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465634304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.257464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.268575:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465634304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14021us (14827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.268586:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7261 00002000:00100000:1.0:1746147251.268594:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880094d78380 x1830967465634304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.268600:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78380 with x1830967465634304 ext(1048576->2097151) 00002000:00010000:1.0:1746147251.268604:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d78380 00000100:00100000:0.0:1746147251.287002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.292797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.292878:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465634944 00000100:00100000:1.0:1746147251.292885:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465634944 00000100:00100000:1.0:1746147251.292956:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15424 00000100:00100000:1.0:1746147251.292963:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:31727:x1830967465634944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147251.292975:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.292987:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec521 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.293007:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.293012:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147251.293014:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147251.293016:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.293036:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.293044:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 11 pid: 6881 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.293056:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012736:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147251.294290:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147251.294310:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012736:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.294327:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.294337:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537e200, rc 0) 00000100:00100000:1.0:1746147251.294370:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:31727:x1830967465634944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1407us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.294376:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15424 00000100:00100000:1.0:1746147251.295854:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465635200 00000100:00100000:1.0:1746147251.295859:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465635200 00000100:00100000:1.0:1746147251.295881:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15425 00000100:00100000:1.0:1746147251.295886:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465635200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147251.295896:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.295906:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad05d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec528 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.295954:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012864:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147251.296117:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465635072 00000100:00100000:1.0:1746147251.296143:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.296281:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465635072 00002000:00100000:0.0:1746147251.296307:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1372160->2084863) req@ffff880094d78a80 x1830967465635072/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.296315:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78a80 with x1830967465635072 ext(1372160->2084863) 00010000:00010000:0.0:1746147251.296321:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 14 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746147251.296331:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 14 pid: 6881 timeout: 738 lvb_type: 0 00002000:00010000:0.0:1746147251.296336:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d78a80 00000100:00100000:0.0:1746147251.296347:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2500 00000100:00100000:0.0:1746147251.296352:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465635072:12345-192.168.203.36@tcp:4:cat.0 00002000:00010000:1.0:1746147251.298975:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147250 -> 1746147251 00002000:00010000:1.0:1746147251.298982:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147250 -> 1746147251 00002000:00010000:1.0:1746147251.298983:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147250 -> 1746147251 00000100:00100000:1.0:1746147251.298999:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467012864:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147251.299029:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad05d2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec528 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.299041:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad05d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec528 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.299054:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537f600, rc 0) 00000100:00100000:1.0:1746147251.299127:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465635200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3238us (3355us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147251.299134:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15425 00000100:00100000:0.0:1746147251.305768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.307623:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465635072:12345-192.168.203.36@tcp:4:cat.0 Request processed in 11268us (11882us total) trans 21474841352 rc 0/0 00000100:00100000:1.0:1746147251.307631:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2500 00002000:00100000:1.0:1746147251.307638:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1372160->2084863) req@ffff880094d78a80 x1830967465635072/t21474841352(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/448 e 0 to 0 dl 1746147262 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.307645:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78a80 with x1830967465635072 ext(1372160->2084863) 00010000:00010000:1.0:1746147251.307651:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 16 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.307661:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b485a200/0xb4b2209fbdad05c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec51a expref: 16 pid: 6881 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746147251.307666:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d78a80 00000100:00100000:0.0:1746147251.313437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.314589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.316081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.316372:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465635712 00000100:00100000:1.0:1746147251.316377:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465635712 00000100:00100000:1.0:1746147251.316415:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15428 00000100:00100000:1.0:1746147251.316422:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465635712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147251.316434:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.316444:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec53d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.316465:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.316467:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.316472:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.316484:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.316491:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b384400, rc 0) 00000100:00100000:1.0:1746147251.316851:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465635712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 429us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.316857:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15428 00000100:00100000:0.0:1746147251.316917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.325576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.325636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.327826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.327898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.327947:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465636736 00000100:00100000:1.0:1746147251.327948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.327950:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465636736 00002000:00100000:0.0:1746147251.327973:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012db2ea00 x1830967465636736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.327982:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ea00 with x1830967465636736 ext(1048576->2097151) 00002000:00010000:0.0:1746147251.327986:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2ea00 00000100:00100000:0.0:1746147251.328651:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465636864 00000100:00100000:0.0:1746147251.328655:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465636864 00002000:00100000:0.0:1746147251.328668:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012db2d500 x1830967465636864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.328674:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d500 with x1830967465636864 ext(1048576->2097151) 00002000:00010000:0.0:1746147251.328677:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d500 00000100:00100000:0.0:1746147251.328699:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7264 00000100:00100000:0.0:1746147251.328703:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967465636864:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147251.338337:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465637120 00000100:00100000:0.0:1746147251.338345:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465637120 00002000:00100000:0.0:1746147251.338376:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3792896->3796991) req@ffff88009e6f1500 x1830967465637120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.338392:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1500 with x1830967465637120 ext(3792896->3796991) 00002000:00010000:0.0:1746147251.338396:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f1500 00000100:00100000:0.0:1746147251.338424:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7265 00000100:00100000:0.0:1746147251.338431:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465637120:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147251.338585:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465637120:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 154us (467us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147251.338592:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7265 00002000:00100000:0.0:1746147251.338597:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3792896->3796991) req@ffff88009e6f1500 x1830967465637120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/4536 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.338603:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1500 with x1830967465637120 ext(3792896->3796991) 00002000:00010000:0.0:1746147251.338606:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f1500 00000100:00100000:0.0:1746147251.349743:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.354224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.354583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.372005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.372060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.376858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.380119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.380184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.397654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.405677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.405710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.405749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.405758:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465639040 00000100:00100000:1.0:1746147251.405769:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465639040 00000100:00100000:0.0:1746147251.405777:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465639296 00000100:00100000:0.0:1746147251.405781:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465639296 00002000:00100000:1.0:1746147251.405810:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009edcad80 x1830967465639040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.405810:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009edc8a80 x1830967465639296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.405820:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967465639040 ext(2097152->3145727) 00002000:00100000:0.0:1746147251.405820:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830967465639296 ext(3145728->4194303) 00002000:00010000:1.0:1746147251.405824:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00002000:00010000:0.0:1746147251.405824:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8a80 00000100:00100000:1.0:1746147251.405846:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465639552 00000100:00100000:1.0:1746147251.405849:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465639552 00002000:00100000:1.0:1746147251.405863:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3792895) req@ffff88009edc8e00 x1830967465639552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.405869:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8e00 with x1830967465639552 ext(3145728->3792895) 00002000:00010000:1.0:1746147251.405872:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc8e00 00000100:00100000:0.0:1746147251.406252:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7268 00000100:00100000:0.0:1746147251.406256:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465639296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.406680:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7269 00000100:00100000:0.0:1746147251.406685:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465639552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.426070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.429300:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465639296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23039us (23584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.429311:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7268 00002000:00100000:1.0:1746147251.429322:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009edc8a80 x1830967465639296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.429332:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830967465639296 ext(3145728->4194303) 00002000:00010000:1.0:1746147251.429336:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8a80 00000100:00100000:1.0:1746147251.432271:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465639552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25582us (26519us total) trans 0 rc 647168/647168 00000100:00100000:1.0:1746147251.432279:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7269 00002000:00100000:1.0:1746147251.432285:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3792895) req@ffff88009edc8e00 x1830967465639552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.432291:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8e00 with x1830967465639552 ext(3145728->3792895) 00002000:00010000:1.0:1746147251.432295:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc8e00 00000100:00100000:0.0:1746147251.441015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.441110:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465640064 00000100:00100000:1.0:1746147251.441120:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465640064 00002000:00100000:1.0:1746147251.441175:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009f152a00 x1830967465640064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.441185:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152a00 with x1830967465640064 ext(4194304->4976639) 00002000:00010000:1.0:1746147251.441190:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f152a00 00000100:00100000:1.0:1746147251.441222:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7270 00000100:00100000:1.0:1746147251.441230:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465640064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.446623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.447450:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15431 00000100:00100000:1.0:1746147251.447461:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31732:x1830967465640192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147251.447480:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.447497:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec559 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.447527:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.447535:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.447541:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.447543:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.447546:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1675264->2007039] (req 1675264->2007039) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.447578:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147251.447590:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 16 pid: 6881 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746147251.447602:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467014272:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.447712:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.447721:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.447729:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467014400:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147251.448192:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147251.448571:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465640064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7340us (7566us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147251.448580:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7270 00002000:00100000:1.0:1746147251.448590:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009f152a00 x1830967465640064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.448600:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152a00 with x1830967465640064 ext(4194304->4976639) 00002000:00010000:1.0:1746147251.448604:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f152a00 00000100:00100000:1.0:1746147251.451317:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467014272:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147251.451642:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467014400:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147251.451675:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1675264->2007039] (req 1675264->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.451690:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b384a00, rc 0) 00000100:00100000:1.0:1746147251.451751:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31732:x1830967465640192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4292us (5138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.451758:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15431 00000100:00100000:0.0:1746147251.454064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.454105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.454463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.454779:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7808 00000100:00100000:1.0:1746147251.454788:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465640320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.454803:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.454823:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 16 pid: 6881 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.454833:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 16 pid: 6881 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.454855:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b384400/0xb4b2209fbdad05e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec53d expref: 16 pid: 6881 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.454883:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.454921:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465640320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 134us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.454927:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7808 00000100:00100000:1.0:1746147251.454964:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7809 00000100:00100000:1.0:1746147251.454969:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465640448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.454975:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.454982:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.454990:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.455001:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537e200/0xb4b2209fbdad05cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec521 expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.455011:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.455013:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.455019:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.455027:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.455056:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.455067:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467014528:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147251.455130:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147251.455158:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465640576 00000100:00100000:1.0:1746147251.455161:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465640576 00000100:00100000:1.0:1746147251.455181:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15432 00000100:00100000:1.0:1746147251.455185:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465640576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147251.455198:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147251.455208:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdad0626 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec560 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.455234:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467014656:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147251.455253:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147251.458963:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467014528:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147251.458985:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.459592:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465640448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4620us (5484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.459602:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7809 00000100:00100000:1.0:1746147251.460530:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465640832 00000100:00100000:1.0:1746147251.460536:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465640832 00002000:00100000:1.0:1746147251.460567:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1675264->1679359) req@ffff88012df7aa00 x1830967465640832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.460577:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7aa00 with x1830967465640832 ext(1675264->1679359) 00002000:00010000:1.0:1746147251.460582:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7aa00 00000100:00100000:1.0:1746147251.460606:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7271 00000100:00100000:1.0:1746147251.460612:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465640832:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147251.460754:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465640832:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 142us (766us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147251.460760:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7271 00002000:00100000:1.0:1746147251.460765:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1675264->1679359) req@ffff88012df7aa00 x1830967465640832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/4536 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.460772:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7aa00 with x1830967465640832 ext(1675264->1679359) 00002000:00010000:1.0:1746147251.460774:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7aa00 00000100:00100000:0.0:1746147251.466034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.466309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.473339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.478113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.502235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.507812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.512803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.513045:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465642240 00000100:00100000:1.0:1746147251.513052:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465642240 00010000:00010000:1.0:1746147251.513083:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1514400/0xb4b2209fbdad0507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4db expref: 11 pid: 6881 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.513118:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7810 00000100:00100000:1.0:1746147251.513124:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465642240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.513136:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.513168:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514400/0xb4b2209fbdad0507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4db expref: 11 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.513178:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1514400/0xb4b2209fbdad0507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4db expref: 11 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.513198:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514400/0xb4b2209fbdad0507 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4db expref: 11 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.513606:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.513662:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465642240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 537us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.513670:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7810 00000100:00100000:1.0:1746147251.513921:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465642368 00000100:00100000:1.0:1746147251.513925:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465642368 00010000:00010000:1.0:1746147251.513977:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec50c expref: 26 pid: 6881 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746147251.514697:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7811 00000100:00100000:1.0:1746147251.514706:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465642368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.514719:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.514735:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec50c expref: 26 pid: 6881 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.514746:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec50c expref: 26 pid: 6881 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.514766:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e400/0xb4b2209fbdad05b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec50c expref: 26 pid: 6881 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.514779:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.514780:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.514787:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.514794:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.514823:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.514834:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467015168:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147251.514908:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.517343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.517451:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467015168:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147251.517472:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.517515:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465642368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2811us (3657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.517524:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7811 00000100:00100000:0.0:1746147251.522046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.525565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.546647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.550894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.551016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.551048:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465643520 00000100:00100000:0.0:1746147251.551056:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465643520 00000100:00100000:1.0:1746147251.553406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.553557:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465643776 00000100:00100000:0.0:1746147251.553564:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465643776 00000100:00100000:0.0:1746147251.553598:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15437 00000100:00100000:0.0:1746147251.553603:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465643776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147251.553611:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.553621:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec591 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.553633:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.553635:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.553643:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.553656:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.553666:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360c00, rc 0) 00000100:00100000:0.0:1746147251.553690:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465643776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147251.553695:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15437 00000100:00100000:0.0:1746147251.564843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.579544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.585039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.593283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.593363:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465644416 00000100:00100000:1.0:1746147251.593410:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465644416 00010000:00010000:1.0:1746147251.593445:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 27 pid: 6881 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.593491:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7812 00000100:00100000:1.0:1746147251.593498:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465644416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.593509:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.593528:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 27 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.593539:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 27 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.593558:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec575 expref: 27 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.593583:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.593585:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.593651:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.593659:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.593686:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.593696:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467015680:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147251.593784:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147251.599574:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467015680:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147251.599598:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.599660:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465644416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6160us (6389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.599671:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7812 00000100:00100000:0.0:1746147251.600087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.608299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.611070:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7276 00002000:00100000:2.0:1746147251.611082:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a044b100 x1830967465644672/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.611090:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044b100 with x1830967465644672 ext(1048576->2097151) 00002000:00010000:2.0:1746147251.611095:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044b100 00000100:00100000:0.0:1746147251.614988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.615025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.615124:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465645184 00000100:00100000:2.0:1746147251.615131:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465645184 00000100:00100000:2.0:1746147251.615185:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15440 00000100:00100000:2.0:1746147251.615192:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465645184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147251.615206:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147251.615221:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec5ad expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.615239:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.615241:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.615249:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.615263:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.615273:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee9dc00, rc 0) 00000100:00100000:2.0:1746147251.615315:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465645184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 124us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147251.615321:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15440 00000100:00100000:0.0:1746147251.617753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.621627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.621843:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465645440 00000100:00100000:2.0:1746147251.621850:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465645440 00002000:00100000:2.0:1746147251.621889:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3792896->4194303) req@ffff88012c85fb80 x1830967465645440/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.621899:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85fb80 with x1830967465645440 ext(3792896->4194303) 00010000:00010000:2.0:1746147251.621906:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 27 pid: 17548 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.621917:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 27 pid: 17548 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746147251.621923:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c85fb80 00000100:00100000:2.0:1746147251.621958:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2505 00000100:00100000:2.0:1746147251.621965:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465645440:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147251.626803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.631624:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465645440:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9650us (9988us total) trans 17179873995 rc 0/0 00000100:00100000:2.0:1746147251.631635:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2505 00002000:00100000:2.0:1746147251.631645:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3792896->4194303) req@ffff88012c85fb80 x1830967465645440/t17179873995(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/448 e 0 to 0 dl 1746147262 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.631654:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85fb80 with x1830967465645440 ext(3792896->4194303) 00010000:00010000:2.0:1746147251.631662:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 29 pid: 17548 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.631673:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 29 pid: 17548 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746147251.631680:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c85fb80 00000100:00100000:0.0:1746147251.635309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.635636:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465645696 00000100:00100000:2.0:1746147251.635646:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465645696 00002000:00100000:2.0:1746147251.635686:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1675264->2007039) req@ffff88012c85f480 x1830967465645696/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.635694:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f480 with x1830967465645696 ext(1675264->2007039) 00010000:00010000:2.0:1746147251.635703:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 16 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.635714:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 16 pid: 6881 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746147251.635720:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c85f480 00000100:00100000:2.0:1746147251.636136:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2506 00000100:00100000:2.0:1746147251.636143:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465645696:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147251.636307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.636659:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465645824 00000100:00100000:1.0:1746147251.636663:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465645824 00010000:00010000:1.0:1746147251.636678:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 29 pid: 17548 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.636699:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7813 00000100:00100000:1.0:1746147251.636703:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465645824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.636710:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.636723:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 29 pid: 17548 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.636731:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 29 pid: 17548 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.636746:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514e00/0xb4b2209fbdad05e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec536 expref: 29 pid: 17548 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.637023:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.637026:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.637034:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.637045:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.637071:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.637081:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467016192:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147251.637126:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.649987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.650004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.650015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.650033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.650051:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465646080 00000100:00100000:0.0:1746147251.650057:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465646080 00002000:00100000:0.0:1746147251.650087:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c56680 x1830967465646080/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.650096:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56680 with x1830967465646080 ext(2097152->3145727) 00002000:00010000:0.0:1746147251.650101:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56680 00000100:00100000:0.0:1746147251.650112:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465646336 00000100:00100000:0.0:1746147251.650114:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465646336 00002000:00100000:0.0:1746147251.650122:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c57800 x1830967465646336/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.650127:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57800 with x1830967465646336 ext(3145728->4194303) 00002000:00010000:0.0:1746147251.650129:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c57800 00000100:00100000:0.0:1746147251.650140:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465646592 00000100:00100000:0.0:1746147251.650142:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465646592 00002000:00100000:0.0:1746147251.650168:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134c57b80 x1830967465646592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.650178:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57b80 with x1830967465646592 ext(2097152->3145727) 00002000:00010000:0.0:1746147251.650181:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c57b80 00000100:00100000:0.0:1746147251.650189:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465646848 00000100:00100000:0.0:1746147251.650191:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465646848 00002000:00100000:0.0:1746147251.650202:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134c55880 x1830967465646848/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.650207:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967465646848 ext(3145728->4194303) 00002000:00010000:0.0:1746147251.650209:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55880 00000100:00100000:0.0:1746147251.650219:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7277 00000100:00100000:0.0:1746147251.650224:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465646080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147251.650762:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7278 00000100:00100000:2.0:1746147251.650770:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465646336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.651979:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7279 00000100:00100000:1.0:1746147251.651987:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465646592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.652760:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467016192:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147251.652776:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147251.652801:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465645824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 16096us (16492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147251.652808:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7813 00000100:00100000:1.0:1746147251.655092:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465645696:12345-192.168.203.36@tcp:4:cat.0 Request processed in 18944us (19785us total) trans 21474841355 rc 0/0 00000100:00100000:1.0:1746147251.655101:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2506 00002000:00100000:1.0:1746147251.655108:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1675264->2007039) req@ffff88012c85f480 x1830967465645696/t21474841355(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/448 e 0 to 0 dl 1746147262 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.655116:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f480 with x1830967465645696 ext(1675264->2007039) 00010000:00010000:1.0:1746147251.655124:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.655135:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746147251.655141:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c85f480 00000100:00100000:0.0:1746147251.664045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.664161:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465646976 00000100:00100000:2.0:1746147251.664171:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465646976 00010000:00010000:2.0:1746147251.664207:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746147251.664252:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7814 00000100:00100000:2.0:1746147251.664261:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465646976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147251.664279:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147251.664304:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.664322:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.664348:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b384a00/0xb4b2209fbdad061f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2007039) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec559 expref: 22 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.664380:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.664386:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.664394:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.664401:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.664446:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147251.664471:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467016320:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147251.664567:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147251.669368:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465646080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19142us (19387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147251.669375:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7277 00002000:00100000:2.0:1746147251.669384:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c56680 x1830967465646080/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.669392:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56680 with x1830967465646080 ext(2097152->3145727) 00002000:00010000:2.0:1746147251.669398:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56680 00000100:00100000:0.0:1746147251.675347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.675378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.675659:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465646592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23671us (25640us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.675667:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7279 00002000:00100000:1.0:1746147251.675678:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134c57b80 x1830967465646592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.675686:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57b80 with x1830967465646592 ext(2097152->3145727) 00002000:00010000:1.0:1746147251.675690:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c57b80 00000100:00100000:1.0:1746147251.675711:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465647488 00000100:00100000:1.0:1746147251.675716:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465647488 00002000:00100000:1.0:1746147251.675737:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a4670000 x1830967465647488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.675742:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670000 with x1830967465647488 ext(1048576->2097151) 00002000:00010000:1.0:1746147251.675745:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4670000 00000100:00100000:1.0:1746147251.675755:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465647360 00000100:00100000:1.0:1746147251.675757:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465647360 00002000:00100000:1.0:1746147251.675765:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a4673b80 x1830967465647360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.675770:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967465647360 ext(1048576->2097151) 00002000:00010000:1.0:1746147251.675772:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:1.0:1746147251.675780:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7281 00000100:00100000:1.0:1746147251.675785:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465647488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.675855:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1959:x1830967465646848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23784us (25819us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147251.675861:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7280 00002000:00100000:0.0:1746147251.675867:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134c55880 x1830967465646848/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147251.675879:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967465646848 ext(3145728->4194303) 00002000:00010000:0.0:1746147251.675882:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55880 00000100:00100000:0.0:1746147251.675895:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7282 00000100:00100000:0.0:1746147251.675900:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465647360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.689361:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465647488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13567us (14013us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.689371:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7281 00002000:00100000:1.0:1746147251.689380:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a4670000 x1830967465647488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.689389:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670000 with x1830967465647488 ext(1048576->2097151) 00002000:00010000:1.0:1746147251.689393:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4670000 00000100:00100000:0.0:1746147251.690752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.691131:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465647360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15229us (15751us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147251.691138:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7282 00002000:00100000:1.0:1746147251.691144:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a4673b80 x1830967465647360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.691164:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967465647360 ext(1048576->2097151) 00002000:00010000:1.0:1746147251.691168:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:0.0:1746147251.701296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.703095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.703461:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465647872 00000100:00100000:2.0:1746147251.703466:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465647872 00002000:00100000:2.0:1746147251.703494:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6b9180 x1830967465647872/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.703503:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9180 with x1830967465647872 ext(4194304->4976639) 00002000:00010000:2.0:1746147251.703507:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9180 00000100:00100000:2.0:1746147251.703521:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7283 00000100:00100000:2.0:1746147251.703526:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465647872:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147251.704616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.704631:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465648256 00000100:00100000:0.0:1746147251.704634:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465648256 00000100:00100000:0.0:1746147251.704663:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15444 00000100:00100000:0.0:1746147251.704668:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31744:x1830967465648256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147251.704677:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.704689:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec5d0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.704704:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.704706:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.704712:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.704722:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.704730:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c4200, rc 0) 00000100:00100000:0.0:1746147251.704756:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31744:x1830967465648256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147251.704761:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15444 00000100:00100000:2.0:1746147251.716826:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465647872:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13292us (13725us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147251.716837:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7283 00002000:00100000:2.0:1746147251.716846:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6b9180 x1830967465647872/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.716854:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9180 with x1830967465647872 ext(4194304->4976639) 00002000:00010000:2.0:1746147251.716859:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9180 00000100:00100000:0.0:1746147251.717876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.718099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.718178:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465648512 00000100:00100000:2.0:1746147251.718185:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465648512 00002000:00100000:2.0:1746147251.718212:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b6baa00 x1830967465648512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.718219:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6baa00 with x1830967465648512 ext(2097152->3145727) 00002000:00010000:2.0:1746147251.718222:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6baa00 00000100:00100000:2.0:1746147251.718243:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465648768 00000100:00100000:2.0:1746147251.718245:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465648768 00002000:00100000:2.0:1746147251.718255:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b6bb480 x1830967465648768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.718261:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967465648768 ext(3145728->4194303) 00002000:00010000:2.0:1746147251.718264:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:2.0:1746147251.718520:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7285 00000100:00100000:2.0:1746147251.718527:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465648768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147251.728489:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465648768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9955us (10382us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147251.728499:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7285 00002000:00100000:2.0:1746147251.728509:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b6bb480 x1830967465648768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.728517:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967465648768 ext(3145728->4194303) 00002000:00010000:2.0:1746147251.728522:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:0.0:1746147251.730518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.730638:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465649024 00000100:00100000:2.0:1746147251.730647:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465649024 00000100:00100000:2.0:1746147251.730689:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4749 00000100:00100000:2.0:1746147251.730695:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31741:x1830967465649024:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147251.731156:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31741:x1830967465649024:12345-192.168.203.36@tcp:35:cat.0 Request processed in 449us (636us total) trans 8589945380 rc 0/0 00000100:00100000:2.0:1746147251.731163:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4749 00000100:00100000:0.0:1746147251.742489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.746052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.749318:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465649280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6603us (6831us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147251.749328:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7286 00002000:00100000:2.0:1746147251.749337:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6b9f80 x1830967465649280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.749350:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9f80 with x1830967465649280 ext(4194304->4976639) 00002000:00010000:2.0:1746147251.749355:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9f80 00000100:00100000:0.0:1746147251.762492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.762876:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465649792 00000100:00100000:2.0:1746147251.762887:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465649792 00000100:00100000:2.0:1746147251.762970:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4750 00000100:00100000:2.0:1746147251.762977:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:31744:x1830967465649792:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147251.764109:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+313:31744:x1830967465649792:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1131us (1629us total) trans 8589945382 rc 0/0 00000100:00100000:2.0:1746147251.764115:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4750 00000100:00100000:0.0:1746147251.809000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.809093:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465650048 00000100:00100000:2.0:1746147251.809104:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465650048 00000100:00100000:2.0:1746147251.809170:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4751 00000100:00100000:2.0:1746147251.809177:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:31705:x1830967465650048:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147251.809356:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31705:x1830967465650048:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 179us (366us total) trans 8589945383 rc 0/0 00000100:00100000:2.0:1746147251.809362:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4751 00000100:00100000:0.0:1746147251.810983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.811418:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465650304 00000100:00100000:2.0:1746147251.811425:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465650304 00000100:00100000:2.0:1746147251.811464:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4752 00000100:00100000:2.0:1746147251.811470:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31705:x1830967465650304:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147251.811615:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31705:x1830967465650304:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 144us (635us total) trans 8589945384 rc 0/0 00000100:00100000:2.0:1746147251.811621:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4752 00000100:00100000:0.0:1746147251.854441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.856518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.856888:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465650560 00000100:00100000:0.0:1746147251.856894:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465650560 00000100:00100000:0.0:1746147251.856994:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15446 00000100:00100000:0.0:1746147251.857001:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31748:x1830967465650560:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147251.857011:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.857022:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec5e5 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.857040:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a0600/0xb4b2209fbdad0458 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec42c expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.857047:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d42e00/0xb4b2209fbdad04d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4a3 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.857054:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0482 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec456 expref: 5 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.857059:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.857061:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.857063:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->729087] (req 0->729087) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.857078:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0482 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec456 expref: 5 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.857086:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0482 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec456 expref: 5 pid: 21080 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746147251.857094:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467016704:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147251.857121:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d42e00/0xb4b2209fbdad04d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4a3 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.857128:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d42e00/0xb4b2209fbdad04d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4a3 expref: 30 pid: 17548 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746147251.857134:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467016832:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147251.857164:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a0600/0xb4b2209fbdad0458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec42c expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147251.857172:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a0600/0xb4b2209fbdad0458 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec42c expref: 11 pid: 8481 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746147251.857183:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467016960:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147251.857200:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.859351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.859796:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465650816 00000100:00100000:2.0:1746147251.859803:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465650816 00000100:00100000:2.0:1746147251.859848:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11401 00000100:00100000:2.0:1746147251.859855:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31754:x1830967465650816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147251.860008:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147251.860022:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485cc00/0xb4b2209fbdad073e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec5ec expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.860104:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860115:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860123:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860132:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860137:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860142:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860235:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdad0753 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860242:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdad0753 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860247:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdad0753 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147251.860256:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147251.860314:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860320:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860324:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860329:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e037a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147251.860332:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860337:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860346:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147251.860349:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147251.860352:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860356:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad0745 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860380:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860385:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860389:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860397:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e037800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147251.860399:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860404:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860409:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13000) 00010000:00010000:2.0:1746147251.860411:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147251.860413:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.860417:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad074c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147251.861622:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485cc00/0xb4b2209fbdad073e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ec expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.861635:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdad0753 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ec expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.861641:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147251.861643:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147251.861645:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e036200, rc 0) 00000100:00100000:2.0:1746147251.863348:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31754:x1830967465650816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3489us (3997us total) trans 8589945385 rc 0/0 00000100:00100000:2.0:1746147251.863355:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11401 00000100:00100000:0.0:1746147251.864225:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467016704:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147251.864473:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467016832:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147251.864489:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e682a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467016960:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147251.864511:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->729087] (req 0->729087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.864524:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e000, rc 0) 00000100:00100000:0.0:1746147251.864554:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:31748:x1830967465650560:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7554us (8037us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147251.864560:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15446 00000100:00100000:0.0:1746147251.864607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.864726:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467016576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147251.865324:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.865335:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4bbe00, rc 0) 00000100:00100000:2.0:1746147251.865353:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31746:x1830967465650432:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10455us (10920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147251.865358:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15445 00000100:00100000:0.0:1746147251.866004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.866030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.866068:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465651456 00000100:00100000:0.0:1746147251.866069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.866073:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465651456 00000100:00100000:0.0:1746147251.866089:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465651584 00000100:00100000:0.0:1746147251.866096:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465651584 00000100:00100000:2.0:1746147251.866104:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15447 00000100:00100000:2.0:1746147251.866109:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465651456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147251.866120:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147251.866134:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15448 00000100:00100000:0.0:1746147251.866140:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465651584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147251.866162:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147251.866176:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad0761 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec5fa expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.866203:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad0768 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec5f3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.866217:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.866224:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad0768 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5f3 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.866232:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad0768 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5f3 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.866239:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e036000, rc 0) 00000100:00100000:2.0:1746147251.866260:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465651456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 151us (229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147251.866265:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15447 00000100:00100000:1.0:1746147251.866625:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465651328 00000100:00100000:1.0:1746147251.866630:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465651328 00010000:00010000:1.0:1746147251.866647:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.866671:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7818 00000100:00100000:1.0:1746147251.866677:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465651328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147251.866687:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.866709:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.866719:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.866740:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4ba000/0xb4b2209fbdad06d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5bb expref: 23 pid: 6881 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.866764:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.866766:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147251.866772:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.866781:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.866812:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.866824:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467017088:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147251.866889:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.867548:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467017216:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147251.868014:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.868343:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7819 00000100:00100000:0.0:1746147251.868360:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465651840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147251.868370:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147251.868389:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a0600/0xb4b2209fbdad0458 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec42c expref: 12 pid: 8481 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746147251.868401:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a0600/0xb4b2209fbdad0458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec42c expref: 12 pid: 8481 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746147251.868417:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a0600/0xb4b2209fbdad0458 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec42c expref: 12 pid: 8481 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746147251.868434:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.868435:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147251.868441:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.868449:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147251.868469:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147251.868482:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467017344:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147251.868705:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.873053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.873619:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467017088:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147251.873639:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.873685:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465651328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7007us (7686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.873697:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7818 00000100:00100000:2.0:1746147251.873747:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467017216:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147251.873770:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad0761 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5fa expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.873784:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad0761 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5fa expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.873793:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0c000, rc 0) 00000100:00100000:2.0:1746147251.873812:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465651584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7672us (7743us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147251.873817:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15448 00000100:00100000:0.0:1746147251.874989:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467017344:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147251.875001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147251.875001:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147251.875035:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465651840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6684us (6834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.875036:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465652224 00000100:00100000:0.0:1746147251.875042:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7819 00000100:00100000:1.0:1746147251.875043:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465652224 00002000:00100000:1.0:1746147251.875075:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->4095) req@ffff88012db2dc00 x1830967465652224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.875089:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2dc00 with x1830967465652224 ext(0->4095) 00002000:00010000:1.0:1746147251.875093:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2dc00 00000100:00100000:1.0:1746147251.875116:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7287 00000100:00100000:1.0:1746147251.875122:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465652224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147251.875310:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465652224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 187us (318us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147251.875317:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7287 00002000:00100000:1.0:1746147251.875322:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->4095) req@ffff88012db2dc00 x1830967465652224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/4536 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.875330:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2dc00 with x1830967465652224 ext(0->4095) 00002000:00010000:1.0:1746147251.875333:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2dc00 00000100:00100000:2.0:1746147251.875401:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465651968 00000100:00100000:2.0:1746147251.875406:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465651968 00000100:00100000:2.0:1746147251.875495:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15449 00000100:00100000:2.0:1746147251.875502:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31746:x1830967465651968:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147251.875514:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147251.875933:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec601 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.876458:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.876467:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.876474:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.876476:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.876480:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.876515:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147251.876527:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 28 pid: 8480 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746147251.876538:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467017472:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147251.876611:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.876619:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 12 pid: 8480 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746147251.876628:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467017600:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147251.876646:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.877797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.877883:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465652352 00000100:00100000:2.0:1746147251.877890:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465652352 00000100:00100000:2.0:1746147251.880925:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467017472:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147251.881007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.881034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.881172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.881207:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467017600:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147251.881237:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147251.881249:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465652480 00010000:00010000:2.0:1746147251.881255:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037c00, rc 0) 00000100:00100000:1.0:1746147251.881255:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465652480 00010000:00010000:1.0:1746147251.881282:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 29 pid: 8480 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746147251.881295:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31746:x1830967465651968:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5794us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.881301:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465652608 00000100:00100000:1.0:1746147251.881303:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465652608 00000100:00100000:2.0:1746147251.881304:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15449 00010000:00010000:1.0:1746147251.881310:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 15 pid: 8480 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746147251.881320:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7820 00000100:00100000:1.0:1746147251.881326:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465652480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147251.881327:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7821 00000100:00100000:2.0:1746147251.881331:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465652608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147251.881337:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147251.881337:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147251.881355:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 14 pid: 8480 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.881355:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 29 pid: 8480 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746147251.881364:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 29 pid: 8480 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746147251.881510:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 13 pid: 8480 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.881545:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad06c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5ad expref: 29 pid: 8480 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746147251.881548:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad0696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec598 expref: 13 pid: 8480 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746147251.881559:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.881561:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147251.881567:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147251.881576:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147251.881659:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147251.881676:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465652480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 351us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147251.881682:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7820 00000100:00100000:1.0:1746147251.881713:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465652864 00000100:00100000:1.0:1746147251.881717:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465652864 00002000:00100000:1.0:1746147251.881739:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (724992->729087) req@ffff88008e5c8380 x1830967465652864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.881748:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8380 with x1830967465652864 ext(724992->729087) 00010000:00010000:1.0:1746147251.881753:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.881781:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746147251.881786:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e5c8380 00000100:00100000:1.0:1746147251.881800:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2507 00000100:00100000:1.0:1746147251.881805:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465652864:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147251.881961:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465652864:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 130us (763us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147251.881967:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2507 00002000:00100000:1.0:1746147251.881971:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (724992->729087) req@ffff88008e5c8380 x1830967465652864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/4536 e 0 to 0 dl 1746147262 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.881978:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8380 with x1830967465652864 ext(724992->729087) 00010000:00010000:1.0:1746147251.881982:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.881990:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746147251.881996:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e5c8380 00010000:00010000:2.0:1746147251.882628:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147251.882639:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467017856:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147251.882962:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147251.884411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.884495:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465653376 00000100:00100000:2.0:1746147251.884502:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465653376 00000100:00100000:2.0:1746147251.884541:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4753 00000100:00100000:2.0:1746147251.884547:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+313:31748:x1830967465653376:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147251.884766:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:31748:x1830967465653376:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 217us (359us total) trans 8589945386 rc 0/0 00000100:00100000:2.0:1746147251.884773:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4753 00000100:00100000:2.0:1746147251.887272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.887537:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465653120 00000100:00100000:1.0:1746147251.887544:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465653120 00002000:00100000:1.0:1746147251.887580:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->729087) req@ffff88012df7b480 x1830967465653120/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.887588:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b480 with x1830967465653120 ext(0->729087) 00010000:00010000:1.0:1746147251.887596:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.887609:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 28 pid: 8481 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746147251.887616:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df7b480 00000100:00100000:1.0:1746147251.887633:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2508 00000100:00100000:1.0:1746147251.887639:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465653120:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147251.892008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147251.892538:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465653632 00000100:00100000:1.0:1746147251.892548:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465653632 00002000:00100000:1.0:1746147251.892592:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1527808->1531903) req@ffff88008e5c8e00 x1830967465653632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.892602:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967465653632 ext(1527808->1531903) 00002000:00010000:1.0:1746147251.892608:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8e00 00000100:00100000:1.0:1746147251.892636:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7288 00000100:00100000:1.0:1746147251.892647:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465653632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.892810:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465653632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 166us (812us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147251.892817:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7288 00002000:00100000:1.0:1746147251.892822:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1527808->1531903) req@ffff88008e5c8e00 x1830967465653632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/4536 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.892828:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967465653632 ext(1527808->1531903) 00002000:00010000:1.0:1746147251.892830:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8e00 00000100:00100000:0.0:1746147251.894897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.894922:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465653888 00000100:00100000:0.0:1746147251.894930:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465653888 00000100:00100000:0.0:1746147251.895070:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4754 00000100:00100000:0.0:1746147251.895078:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31746:x1830967465653888:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147251.895316:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31746:x1830967465653888:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 239us (431us total) trans 8589945387 rc 0/0 00000100:00100000:0.0:1746147251.895335:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4754 00000100:00100000:1.0:1746147251.902315:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465653120:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 14664us (15039us total) trans 17179873996 rc 0/0 00000100:00100000:1.0:1746147251.902328:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2508 00002000:00100000:1.0:1746147251.902342:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->729087) req@ffff88012df7b480 x1830967465653120/t17179873996(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:627/0 lens 488/448 e 0 to 0 dl 1746147262 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.902351:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b480 with x1830967465653120 ext(0->729087) 00010000:00010000:1.0:1746147251.902362:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 30 pid: 8481 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746147251.902377:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad0737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->729087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5e5 expref: 30 pid: 8481 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746147251.902384:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df7b480 00000100:00100000:0.0:1746147251.904184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.913563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.913598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147251.913645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.914647:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465654656 00000100:00100000:1.0:1746147251.914650:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465654784 00000100:00100000:2.0:1746147251.914651:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465654656 00000100:00100000:1.0:1746147251.914654:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465654784 00002000:00100000:1.0:1746147251.914764:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1732607) req@ffff88008f9ffb80 x1830967465654784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147251.914767:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1531904->2097151) req@ffff88008f9fe680 x1830967465654656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/0 e 0 to 0 dl 1746147262 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.914770:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ffb80 with x1830967465654784 ext(1048576->1732607) 00002000:00100000:2.0:1746147251.914773:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe680 with x1830967465654656 ext(1531904->2097151) 00002000:00010000:1.0:1746147251.914773:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ffb80 00002000:00010000:2.0:1746147251.914776:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fe680 00000100:00100000:1.0:1746147251.914793:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7290 00000100:00100000:1.0:1746147251.914805:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7291 00000100:00100000:1.0:1746147251.914809:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465654656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.915604:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465654784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147251.927739:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465654656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12916us (14128us total) trans 0 rc 565248/565248 00000100:00100000:1.0:1746147251.927752:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7291 00002000:00100000:1.0:1746147251.927765:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1531904->2097151) req@ffff88008f9fe680 x1830967465654656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.927774:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe680 with x1830967465654656 ext(1531904->2097151) 00002000:00010000:1.0:1746147251.927780:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fe680 00000100:00100000:1.0:1746147251.936071:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465654784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21261us (22414us total) trans 0 rc 684032/684032 00000100:00100000:1.0:1746147251.936087:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7290 00002000:00100000:1.0:1746147251.936100:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1732607) req@ffff88008f9ffb80 x1830967465654784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:627/0 lens 488/440 e 0 to 0 dl 1746147262 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147251.936109:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ffb80 with x1830967465654784 ext(1048576->1732607) 00002000:00010000:1.0:1746147251.936115:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ffb80 00000100:00100000:0.0:1746147251.949901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.951668:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465655040 00000100:00100000:2.0:1746147251.951682:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465655040 00000100:00100000:2.0:1746147251.951753:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4755 00000100:00100000:2.0:1746147251.951762:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31754:x1830967465655040:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147251.952014:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31754:x1830967465655040:12345-192.168.203.36@tcp:35:cat.0 Request processed in 253us (2123us total) trans 8589945388 rc 0/0 00000100:00100000:2.0:1746147251.952020:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4755 00000100:00100000:0.0:1746147251.999354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147251.999844:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465655296 00000100:00100000:2.0:1746147251.999855:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465655296 00000100:00100000:2.0:1746147251.999901:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11402 00000100:00100000:2.0:1746147251.999908:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:31760:x1830967465655296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147251.999932:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147251.999967:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdad077d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec60f expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.000067:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000079:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000088:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000100:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000104:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000109:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000208:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad0792 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000215:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad0792 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000219:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad0792 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147252.000228:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.000298:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000304:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000309:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000315:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e036400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.000318:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000323:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000331:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.000334:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.000337:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000341:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad0784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000353:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000357:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000362:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000365:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e037e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.000367:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000370:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000394:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13300) 00010000:00010000:2.0:1746147252.000396:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.000398:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000402:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad078b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.000435:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdad077d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec60f expref: 317 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.000446:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad0792 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec60f expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.000452:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.000454:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147252.000456:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037800, rc 0) 00000100:00100000:2.0:1746147252.000516:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:31760:x1830967465655296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 608us (1171us total) trans 8589945389 rc 0/0 00000100:00100000:2.0:1746147252.000521:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11402 00000100:00100000:0.0:1746147252.005116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.005152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.005169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.005196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.005228:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465655424 00000100:00100000:0.0:1746147252.005237:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465655424 00000100:00100000:0.0:1746147252.005279:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465655552 00000100:00100000:0.0:1746147252.005282:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465655552 00000100:00100000:0.0:1746147252.005303:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465655680 00000100:00100000:0.0:1746147252.005304:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465655680 00000100:00100000:0.0:1746147252.005318:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15451 00000100:00100000:0.0:1746147252.005325:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465655424:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.005344:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.005360:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec616 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.005382:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.005384:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.005393:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 31 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.005406:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 31 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.005417:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ed3a00, rc 0) 00000100:00100000:0.0:1746147252.005467:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465655424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 143us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.005473:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15451 00000100:00100000:0.0:1746147252.005487:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15452 00000100:00100000:0.0:1746147252.005491:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465655552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.005498:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.005507:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad07a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec61d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.005545:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467018112:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147252.005598:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e000 going to sleep for 11 seconds 00000100:00080000:0.0:1746147252.005613:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147252.005616:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147252.005626:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15453 00000100:00100000:0.0:1746147252.005631:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465655680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.005637:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.005644:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b077800/0xb4b2209fbdad07ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec624 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.005664:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467018240:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147252.005681:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.005709:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465655808 00000100:00100000:0.0:1746147252.005712:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465655808 00000100:00100000:0.0:1746147252.005739:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 768 00000100:00100000:0.0:1746147252.005743:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1958:x1830967465655808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.005752:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.005770:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad0792 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec60f expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.005786:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.005790:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.005803:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1958:x1830967465655808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.005808:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 768 00000100:00080000:0.0:1746147252.005822:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147252.012813:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467018112:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147252.013070:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467018240:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147252.013092:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b077800/0xb4b2209fbdad07ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec624 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.013107:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b077800/0xb4b2209fbdad07ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec624 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.013137:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077800, rc 0) 00000100:00100000:1.0:1746147252.013269:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465655680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7635us (8096us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147252.013277:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad07a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec61d expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147252.013277:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15453 00010000:00010000:2.0:1746147252.013288:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad07a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec61d expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.013853:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e1fc00, rc 0) 00000100:00100000:2.0:1746147252.014050:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465655552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8556us (8904us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147252.014057:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15452 00000100:00100000:0.0:1746147252.030117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.030200:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656064 00000100:00100000:1.0:1746147252.030211:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656064 00002000:00100000:1.0:1746147252.030254:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008f9fed80 x1830967465656064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.030264:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fed80 with x1830967465656064 ext(0->1048575) 00002000:00010000:1.0:1746147252.030269:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fed80 00000100:00100000:1.0:1746147252.031371:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7292 00000100:00100000:1.0:1746147252.031382:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465656064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147252.042819:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465656064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11428us (12701us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147252.042832:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7292 00002000:00100000:1.0:1746147252.042845:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008f9fed80 x1830967465656064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.042854:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fed80 with x1830967465656064 ext(0->1048575) 00002000:00010000:1.0:1746147252.042860:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fed80 00000100:00100000:0.0:1746147252.056063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.056131:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656192 00000100:00100000:2.0:1746147252.056151:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656192 00000100:00100000:2.0:1746147252.056212:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15454 00000100:00100000:2.0:1746147252.056219:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:31760:x1830967465656192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.056237:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.056256:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec62b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.056286:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.056294:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.056295:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.056299:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.056329:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.056340:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 17 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.056357:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467018368:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.057175:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.059746:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.059851:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467018368:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.059879:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.059896:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037a00, rc 0) 00000100:00100000:2.0:1746147252.059934:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31760:x1830967465656192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3715us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.059964:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15454 00000100:00100000:1.0:1746147252.060174:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656320 00000100:00100000:1.0:1746147252.060181:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656320 00002000:00100000:1.0:1746147252.060215:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1732608->2097151) req@ffff88008f9fce00 x1830967465656320/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.060223:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fce00 with x1830967465656320 ext(1732608->2097151) 00010000:00010000:1.0:1746147252.060229:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 18 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.060240:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 18 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:1.0:1746147252.060247:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fce00 00000100:00100000:1.0:1746147252.060275:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2509 00000100:00100000:1.0:1746147252.060281:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465656320:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147252.067272:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465656320:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6980us (7522us total) trans 21474841356 rc 0/0 00000100:00100000:1.0:1746147252.067285:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2509 00002000:00100000:1.0:1746147252.067297:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1732608->2097151) req@ffff88008f9fce00 x1830967465656320/t21474841356(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.067307:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fce00 with x1830967465656320 ext(1732608->2097151) 00010000:00010000:1.0:1746147252.067317:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 20 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.067332:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 20 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:1.0:1746147252.067339:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fce00 00000100:00100000:0.0:1746147252.070656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.071164:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656448 00000100:00100000:2.0:1746147252.071174:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656448 00010000:00010000:2.0:1746147252.071213:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 20 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.071253:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7823 00000100:00100000:2.0:1746147252.071259:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465656448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.071273:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.071297:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 20 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.071309:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 20 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.071338:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad0730 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5de expref: 20 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.071365:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.071367:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.071374:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.071381:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.071412:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147252.071423:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467018496:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147252.071501:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.074032:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467018496:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147252.074053:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.074101:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465656448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2840us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.074112:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7823 00000100:00100000:0.0:1746147252.076030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.076188:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656704 00000100:00100000:1.0:1746147252.076197:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656704 00002000:00100000:1.0:1746147252.076240:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008f9fdf80 x1830967465656704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.076250:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdf80 with x1830967465656704 ext(1048576->2097151) 00002000:00010000:1.0:1746147252.076256:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fdf80 00000100:00100000:1.0:1746147252.076288:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7293 00000100:00100000:1.0:1746147252.076295:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465656704:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147252.092834:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465656704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16528us (16798us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.092847:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7293 00002000:00100000:2.0:1746147252.092859:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008f9fdf80 x1830967465656704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.092870:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdf80 with x1830967465656704 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.092876:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fdf80 00000100:00100000:0.0:1746147252.099095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.099245:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656832 00000100:00100000:2.0:1746147252.099255:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656832 00000100:00100000:2.0:1746147252.099298:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15455 00000100:00100000:2.0:1746147252.099305:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:31760:x1830967465656832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.099323:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.099339:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec632 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.099368:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.099376:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.099378:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.099382:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 31 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.099416:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.099429:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 11 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.099440:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467018624:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.099541:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.104003:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467018624:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.104035:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 31 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.104053:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e036000, rc 0) 00000100:00100000:2.0:1746147252.104972:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:31760:x1830967465656832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5663us (5883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.104981:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15455 00000100:00100000:0.0:1746147252.105075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.105180:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465656960 00000100:00100000:2.0:1746147252.105187:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465656960 00002000:00100000:2.0:1746147252.105219:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1531903) req@ffff88012bfe0000 x1830967465656960/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.105229:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe0000 with x1830967465656960 ext(1048576->1531903) 00010000:00010000:2.0:1746147252.105236:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 12 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.105248:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 12 pid: 8480 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.105255:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bfe0000 00000100:00100000:2.0:1746147252.105284:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2510 00000100:00100000:2.0:1746147252.105291:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465656960:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147252.119244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.119327:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465657216 00000100:00100000:1.0:1746147252.119335:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465657216 00000100:00100000:1.0:1746147252.119380:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11403 00000100:00100000:1.0:1746147252.119387:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:31762:x1830967465657216:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147252.119405:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.119420:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198a00/0xb4b2209fbdad07c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec639 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.119971:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147252.119983:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.119990:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.119995:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147252.120020:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.120029:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 22 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.120038:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467018752:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.120113:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.120120:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 316 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.120127:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467018880:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.120157:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.121157:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465656960:12345-192.168.203.36@tcp:4:cat.0 Request processed in 15849us (16065us total) trans 17179873997 rc 0/0 00000100:00100000:2.0:1746147252.121168:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2510 00002000:00100000:2.0:1746147252.121181:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1531903) req@ffff88012bfe0000 x1830967465656960/t17179873997(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.121190:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe0000 with x1830967465656960 ext(1048576->1531903) 00010000:00010000:2.0:1746147252.121200:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.121213:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.121219:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bfe0000 00000100:00100000:0.0:1746147252.125871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147252.126269:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147252.126397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.126426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.126481:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467018752:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.126489:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467018880:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.126503:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147252.126539:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465657600 00000100:00100000:0.0:1746147252.126542:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465657600 00010000:00010000:0.0:1746147252.126556:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 25 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.126569:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465657728 00000100:00100000:0.0:1746147252.126571:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465657728 00010000:00010000:0.0:1746147252.126578:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 317 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.126589:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7824 00000100:00100000:0.0:1746147252.126594:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465657600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.126601:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.126604:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 25 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.126612:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 25 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.126626:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad05af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec505 expref: 25 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.126640:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.126643:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147252.126649:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147252.126653:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.126681:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465657600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.126686:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7824 00000100:00100000:0.0:1746147252.126697:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7825 00000100:00100000:0.0:1746147252.126701:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1958:x1830967465657728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.126708:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.126711:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 317 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.126729:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 317 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.126738:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad05a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4fe expref: 317 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.126747:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.126751:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147252.126756:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147252.126761:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147252.126767:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.126771:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.126776:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.126795:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.126807:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1958:x1830967465657728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.126812:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7825 00010000:00010000:0.0:1746147252.126828:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147252.126837:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147252.126847:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147252.126931:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198a00/0xb4b2209fbdad07c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec639 expref: 317 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.126966:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec639 expref: 316 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.126972:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.126974:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147252.126976:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f198600, rc 0) 00000100:00100000:0.0:1746147252.126994:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:31762:x1830967465657216:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7609us (7758us total) trans 8589945390 rc 0/0 00000100:00100000:0.0:1746147252.126999:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11403 00010000:00010000:2.0:1746147252.127126:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.127131:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147252.127140:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.127203:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xb4b2209fbdad07d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 25 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.127224:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.127229:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.127231:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147252.127232:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06a00, rc 0) 00000100:00100000:2.0:1746147252.127258:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31764:x1830967465657472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1225us (1394us total) trans 8589945391 rc 0/0 00000100:00100000:2.0:1746147252.127264:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11404 00000100:00100000:0.0:1746147252.131192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.131467:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465657984 00000100:00100000:2.0:1746147252.131476:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465657984 00000100:00080000:0.0:1746147252.131529:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147252.131538:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11405 00000100:00100000:2.0:1746147252.131544:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31765:x1830967465657984:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147252.131560:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.131575:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdad07ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec647 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.131617:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131627:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131634:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131645:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131649:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131654:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131735:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131743:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec639 expref: 315 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.131749:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.131754:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.131777:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.131785:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 23 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.131794:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467019008:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.132047:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec639 expref: 315 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.132054:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec639 expref: 315 pid: 14125 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.132062:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467019136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.132095:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.132884:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465657856 00000100:00100000:1.0:1746147252.132891:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465657856 00010000:00010000:1.0:1746147252.132921:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.132975:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7826 00000100:00100000:1.0:1746147252.132982:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465657856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.132995:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.133016:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.133027:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.133048:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e037c00/0xb4b2209fbdad076f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec601 expref: 14 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.133406:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.133408:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.133415:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.133423:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.133451:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.133460:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467019264:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147252.133646:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.137406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.138119:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467019008:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.138134:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198600/0xb4b2209fbdad07ca lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec639 expref: 315 pid: 14125 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.138164:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467019136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.138190:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147252.138233:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467019264:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.138245:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.138290:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465657856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5308us (6611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.138299:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7826 00000100:00100000:0.0:1746147252.139662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.139723:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465658368 00000100:00100000:2.0:1746147252.139730:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465658368 00002000:00100000:2.0:1746147252.139763:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012bfe1f80 x1830967465658368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.139772:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1f80 with x1830967465658368 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.139776:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe1f80 00000100:00100000:2.0:1746147252.139800:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7294 00000100:00100000:2.0:1746147252.139806:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465658368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.146099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.146167:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465658496 00000100:00100000:2.0:1746147252.146177:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465658496 00000100:00100000:2.0:1746147252.146235:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15456 00000100:00100000:2.0:1746147252.146242:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31764:x1830967465658496:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.146256:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.146272:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec64e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.146295:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.146309:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.146314:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.146317:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.146319:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.146345:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.146354:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 32 pid: 8481 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.146364:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467019392:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.146450:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.146458:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.146465:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467019520:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.146482:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.148503:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465658624 00000100:00100000:1.0:1746147252.148509:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465658624 00010000:00010000:1.0:1746147252.148530:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 24 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.148557:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7828 00000100:00100000:1.0:1746147252.148563:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465658624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.148572:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.148577:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 24 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.148586:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 24 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.148601:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xb4b2209fbdad07d8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec640 expref: 24 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.148626:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147252.148630:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.148638:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.148643:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.148666:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.148694:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465658624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 131us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.148700:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7828 00010000:00010000:2.0:1746147252.148755:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148762:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147252.148793:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147252.148797:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147252.148809:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148820:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148828:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148833:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148838:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148843:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e036400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.148846:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148852:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148860:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.148862:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.148865:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148869:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdad07f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148881:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148887:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148892:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148896:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e037800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.148898:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148903:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148909:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13300) 00010000:00010000:2.0:1746147252.148967:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.148970:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.148975:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037800/0xb4b2209fbdad07fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.149000:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdad07ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec647 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.149009:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec647 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.149014:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.149016:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147252.149018:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037e00, rc 0) 00000100:00100000:2.0:1746147252.149046:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31765:x1830967465657984:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 17502us (17864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.149052:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11405 00000100:00100000:2.0:1746147252.150270:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465658368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10462us (10609us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.150281:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7294 00002000:00100000:2.0:1746147252.150288:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012bfe1f80 x1830967465658368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.150295:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1f80 with x1830967465658368 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.150299:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe1f80 00000100:00100000:0.0:1746147252.151905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147252.152062:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147252.152107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.152120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.152131:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465658880 00000100:00100000:1.0:1746147252.152134:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465658880 00000100:00100000:1.0:1746147252.152166:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465659008 00000100:00100000:1.0:1746147252.152168:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465659008 00000100:00100000:1.0:1746147252.152181:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15458 00000100:00080000:0.0:1746147252.152300:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147252.152340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.152368:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465659136 00000100:00100000:0.0:1746147252.152371:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465659136 00000100:00100000:2.0:1746147252.152385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.152387:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15460 00000100:00100000:0.0:1746147252.152391:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465659136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147252.152398:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.152404:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad081e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec66a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.152412:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.152418:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad081e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec66a expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147252.152582:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465658880:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147252.152588:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.152597:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec65c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.152606:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.152607:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.152611:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.152619:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.152626:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b829e00, rc 0) 00000100:00100000:1.0:1746147252.152695:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465658880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 327us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.152699:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15458 00010000:00010000:0.0:1746147252.152734:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdad081e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec66a expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.152755:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e000, rc 0) 00000100:00100000:0.0:1746147252.152835:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465659136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 442us (493us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147252.152840:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15460 00000100:00100000:0.0:1746147252.153967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.154026:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465659392 00000100:00100000:1.0:1746147252.154029:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465659392 00010000:00010000:1.0:1746147252.154044:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.154099:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7829 00000100:00100000:1.0:1746147252.154104:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465659392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.154113:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.154130:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.154137:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.154160:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba600/0xb4b2209fbdad06ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5b4 expref: 14 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.154310:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.154340:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465659392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 235us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.154346:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7829 00000100:00100000:0.0:1746147252.154892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.154993:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465659520 00000100:00100000:1.0:1746147252.154996:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465659520 00010000:00010000:1.0:1746147252.155008:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 31 pid: 8481 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.155062:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7830 00000100:00100000:1.0:1746147252.155067:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465659520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.155074:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.155081:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 31 pid: 8481 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.155090:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 31 pid: 8481 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.155100:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0706 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec5d0 expref: 31 pid: 8481 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.155107:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.155109:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.155112:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.155122:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.155151:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.155160:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467019648:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147252.155471:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.155706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.159089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.159106:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465659904 00000100:00100000:0.0:1746147252.159111:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465659904 00000100:00100000:0.0:1746147252.159136:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15462 00000100:00100000:0.0:1746147252.159154:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:31760:x1830967465659904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.159166:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.159176:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec67f expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159201:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159207:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147252.159208:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147252.159211:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159229:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159237:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 12 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.159245:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467019904:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.159299:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.159324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.159378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.159405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.159414:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465660416 00000100:00100000:0.0:1746147252.159417:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465660416 00000100:00100000:0.0:1746147252.159430:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15463 00000100:00100000:0.0:1746147252.159434:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31762:x1830967465660416:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147252.159440:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.159447:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec686 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159462:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159469:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.159473:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.159475:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.159477:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1126400->1490943] (req 1126400->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.159490:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.159497:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 6 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.159500:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465660032 00000100:00100000:2.0:1746147252.159503:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465660032 00000100:00100000:0.0:1746147252.159504:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467020032:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.159518:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec647 expref: 11 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.159532:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147252.159533:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7831 00000100:00100000:2.0:1746147252.159538:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465660032:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.159539:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 34 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.159545:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147252.159545:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467020160:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.159549:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec647 expref: 11 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.159557:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdad0802 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec647 expref: 11 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.159560:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381ea80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147252.159570:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.159575:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.159582:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.159587:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.159598:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.159618:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465660032:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.159624:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7831 00000100:00100000:2.0:1746147252.159644:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465660288 00000100:00100000:2.0:1746147252.159646:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465660288 00002000:00100000:2.0:1746147252.159663:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4161536->4165631) req@ffff88012e2ba300 x1830967465660288/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.159671:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967465660288 ext(4161536->4165631) 00010000:00010000:2.0:1746147252.159676:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 13 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.159682:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 13 pid: 8480 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.159687:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2ba300 00000100:00100000:2.0:1746147252.159704:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2511 00000100:00100000:2.0:1746147252.159709:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465660288:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147252.159807:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465660288:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 98us (428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.159813:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2511 00002000:00100000:2.0:1746147252.159817:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4161536->4165631) req@ffff88012e2ba300 x1830967465660288/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.159831:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967465660288 ext(4161536->4165631) 00010000:00010000:2.0:1746147252.159835:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 13 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.159842:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 13 pid: 8480 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.159847:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2ba300 00000100:00100000:1.0:1746147252.160074:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467019648:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.160083:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.160103:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967465659520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5036us (5211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.160108:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7830 00000100:00100000:2.0:1746147252.164073:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467019904:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.164099:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.164113:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e400, rc 0) 00000100:00100000:2.0:1746147252.164385:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31760:x1830967465659904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5242us (5299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.164391:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15462 00000100:00100000:0.0:1746147252.164480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.164873:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467020032:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.164873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.164883:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467020160:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.164897:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1126400->1490943] (req 1126400->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.164898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147252.164907:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50c200, rc 0) 00000100:00100000:2.0:1746147252.164909:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465660800 00000100:00100000:2.0:1746147252.164914:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465660800 00000100:00100000:1.0:1746147252.164950:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:31762:x1830967465660416:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5501us (5530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.164955:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15463 00002000:00100000:2.0:1746147252.164957:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4161536->4194303) req@ffff88009e587800 x1830967465660800/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.164966:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587800 with x1830967465660800 ext(4161536->4194303) 00010000:00010000:2.0:1746147252.164972:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 13 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.164973:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465660544 00000100:00100000:1.0:1746147252.164976:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465660544 00010000:00010000:2.0:1746147252.164981:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 13 pid: 8480 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.164987:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e587800 00010000:00010000:1.0:1746147252.164990:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.164994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.165011:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465660928 00000100:00100000:1.0:1746147252.165013:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465660928 00010000:00010000:1.0:1746147252.165021:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad07bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec632 expref: 32 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.165033:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7832 00000100:00100000:1.0:1746147252.165038:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465660544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.165047:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147252.165048:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2512 00000100:00100000:2.0:1746147252.165055:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465660800:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:1.0:1746147252.165063:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.165078:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.165106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147252.165262:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0817 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec663 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.165270:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.165272:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.165276:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.165283:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.165308:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.165318:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467020288:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147252.165543:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.165551:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465661056 00000100:00100000:1.0:1746147252.165553:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465661056 00000100:00100000:1.0:1746147252.165567:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15464 00000100:00100000:1.0:1746147252.165571:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31764:x1830967465661056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147252.165578:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.165587:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec68d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.165599:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.165605:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0825 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec671 expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.165611:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.165615:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.165616:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.165619:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3182591] (req 3145728->3182591) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.165631:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.165639:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 20 pid: 17548 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.165646:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467020416:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.165670:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0825 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec671 expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.165676:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0825 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec671 expref: 8 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.165684:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467020672:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.165715:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.165722:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 22 pid: 17548 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.165730:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467020800:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.165746:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.167613:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465660800:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2556us (2737us total) trans 17179873998 rc 0/0 00000100:00100000:2.0:1746147252.167620:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2512 00002000:00100000:2.0:1746147252.167626:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4161536->4194303) req@ffff88009e587800 x1830967465660800/t17179873998(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.167635:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587800 with x1830967465660800 ext(4161536->4194303) 00010000:00010000:2.0:1746147252.167642:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 15 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.167650:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134fac400/0xb4b2209fbdad0809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec64e expref: 15 pid: 8480 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.167656:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e587800 00000100:00100000:0.0:1746147252.170868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.170885:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467020416:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.170898:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467020672:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.170901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.170967:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465661312 00000100:00100000:2.0:1746147252.170973:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465661312 00010000:00010000:2.0:1746147252.170998:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 21 pid: 17548 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.171250:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7835 00000100:00100000:2.0:1746147252.171256:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465661312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.171265:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.171274:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 21 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.171282:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 21 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.171292:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdad068f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec591 expref: 21 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.171305:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.171322:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465661312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 66us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.171327:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7835 00000100:00100000:1.0:1746147252.171393:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467020800:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.171414:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->3182591] (req 3145728->3182591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.171424:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50da00, rc 0) 00000100:00100000:1.0:1746147252.171442:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31764:x1830967465661056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5870us (6448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.171447:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15464 00000100:00100000:0.0:1746147252.171464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.171542:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467020288:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.171550:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.171567:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465660544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6529us (7088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.171573:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7832 00000100:00100000:1.0:1746147252.171583:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465661568 00000100:00100000:1.0:1746147252.171585:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465661568 00010000:00010000:1.0:1746147252.171596:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec678 expref: 12 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.171609:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7836 00000100:00100000:1.0:1746147252.171613:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465661568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.171619:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.171624:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec678 expref: 12 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.171633:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec678 expref: 12 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.171697:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467020544:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.171819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.171861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147252.171910:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147252.171926:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465661952 00000100:00100000:2.0:1746147252.171929:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465661952 00002000:00100000:2.0:1746147252.171972:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1126400->1130495) req@ffff880094d79500 x1830967465661952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.171980:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79500 with x1830967465661952 ext(1126400->1130495) 00002000:00010000:2.0:1746147252.171983:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79500 00000100:00100000:2.0:1746147252.171995:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7295 00000100:00100000:2.0:1746147252.172000:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465661952:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147252.172397:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad083a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec678 expref: 12 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.172411:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147252.172414:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.172422:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.172426:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.172532:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.172551:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465661568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 936us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.172558:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7836 00000100:00100000:2.0:1746147252.172837:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465661952:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 836us (975us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.172843:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7295 00002000:00100000:2.0:1746147252.172849:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1126400->1130495) req@ffff880094d79500 x1830967465661952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.172860:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79500 with x1830967465661952 ext(1126400->1130495) 00002000:00010000:2.0:1746147252.172863:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79500 00000100:00100000:0.0:1746147252.173166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.173178:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465662080 00000100:00100000:0.0:1746147252.173181:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465662080 00010000:00010000:0.0:1746147252.173193:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 23 pid: 17548 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.173214:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7838 00000100:00100000:0.0:1746147252.173219:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465662080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.173226:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.173235:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 23 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.173250:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 23 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.173261:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad05f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec54b expref: 23 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.173274:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.173276:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.173279:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.173287:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.173303:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.173311:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467021056:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147252.173355:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.175767:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467021056:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.175896:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.175926:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465662080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2706us (2760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.175934:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7838 00000100:00100000:0.0:1746147252.180224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.180265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.180277:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465662464 00000100:00100000:2.0:1746147252.180284:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465662464 00000100:00100000:0.0:1746147252.180291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.180316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147252.180318:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c85c700 x1830967465662464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.180327:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c700 with x1830967465662464 ext(2097152->3145727) 00002000:00010000:2.0:1746147252.180331:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85c700 00000100:00100000:0.0:1746147252.180341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.180421:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15466 00000100:00100000:1.0:1746147252.180427:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465662720:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147252.180431:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.180437:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6a2 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.180453:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.180455:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.180461:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.180472:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.180481:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98c800, rc 0) 00000100:00100000:1.0:1746147252.180677:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465662720:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 248us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.180682:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15466 00000100:00100000:2.0:1746147252.180791:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465662976 00000100:00100000:2.0:1746147252.180795:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465662976 00000100:00100000:1.0:1746147252.180797:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7296 00000100:00100000:1.0:1746147252.180803:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465662464:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:2.0:1746147252.180813:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (3178496->3182591) req@ffff88012c85f800 x1830967465662976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.180819:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f800 with x1830967465662976 ext(3178496->3182591) 00002000:00010000:2.0:1746147252.180822:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f800 00000100:00100000:2.0:1746147252.180843:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7297 00000100:00100000:2.0:1746147252.180847:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465662976:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147252.180958:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465662976:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 109us (616us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.180963:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7297 00002000:00100000:2.0:1746147252.180968:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (3178496->3182591) req@ffff88012c85f800 x1830967465662976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.180974:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f800 with x1830967465662976 ext(3178496->3182591) 00002000:00010000:2.0:1746147252.180976:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f800 00000100:00100000:0.0:1746147252.183554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.186848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.186870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.187125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.187371:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465663744 00000100:00100000:2.0:1746147252.187375:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465663744 00000100:00100000:2.0:1746147252.187393:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465664000 00000100:00100000:2.0:1746147252.187394:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465664000 00000100:00100000:2.0:1746147252.187406:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11408 00000100:00100000:2.0:1746147252.187410:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31768:x1830967465663744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.187418:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.187430:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac400/0xb4b2209fbdad0880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6b0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.187496:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187507:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187515:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187525:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187530:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187534:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187616:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187623:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187628:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147252.187634:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.187674:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187680:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187684:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187688:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fadc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.187691:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187697:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187705:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.187708:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.187711:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.187715:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fadc00/0xb4b2209fbdad0887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147252.188041:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465662464:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 7237us (7825us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147252.188049:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7296 00002000:00100000:1.0:1746147252.188055:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c85c700 x1830967465662464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.188064:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c700 with x1830967465662464 ext(2097152->3145727) 00002000:00010000:1.0:1746147252.188068:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85c700 00010000:00010000:2.0:1746147252.188302:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188308:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188312:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188316:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fad800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.188318:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188322:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188328:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13000) 00010000:00010000:2.0:1746147252.188330:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.188332:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188336:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad088e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147252.188360:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac400/0xb4b2209fbdad0880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 27 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.188416:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 26 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.188421:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.188423:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147252.188425:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fad600, rc 0) 00000100:00100000:2.0:1746147252.188455:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31768:x1830967465663744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1045us (1587us total) trans 8589945394 rc 0/0 00000100:00100000:2.0:1746147252.188460:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11408 00000100:00100000:1.0:1746147252.188602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.193338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.193409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.193922:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465664640 00000100:00100000:2.0:1746147252.193929:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465664640 00000100:00100000:2.0:1746147252.193974:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15468 00000100:00100000:2.0:1746147252.193978:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:31760:x1830967465664640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.193987:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.193998:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6be expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.194016:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.194022:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.194028:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.194031:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.194053:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.194062:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 18 pid: 8481 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.194073:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467021440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.194119:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.197436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.197478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.197599:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467021440:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147252.197623:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.197637:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465664768 00010000:00010000:0.0:1746147252.197638:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fad200, rc 0) 00000100:00100000:1.0:1746147252.197643:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465664768 00000100:00100000:1.0:1746147252.197668:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465664896 00000100:00100000:1.0:1746147252.197670:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465664896 00000100:00100000:0.0:1746147252.197670:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31760:x1830967465664640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3691us (4260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.197677:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15468 00000100:00100000:1.0:1746147252.197694:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15469 00000100:00100000:1.0:1746147252.197699:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465664768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.197710:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.197815:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6c5 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.197829:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.197830:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.197837:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.197848:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.197854:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98d400, rc 0) 00000100:00100000:2.0:1746147252.197861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.197872:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465664768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 173us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.197877:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15469 00000100:00100000:1.0:1746147252.197889:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465665024 00000100:00100000:1.0:1746147252.197891:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465665024 00000100:00100000:1.0:1746147252.197904:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15471 00000100:00100000:1.0:1746147252.197908:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465665024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.197914:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.197920:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6d3 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.197929:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.197931:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.197934:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 17 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147252.197952:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147252.197960:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 17 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.197967:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98d600, rc 0) 00000100:00100000:1.0:1746147252.197982:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465665024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.197987:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15471 00000100:00100000:1.0:1746147252.198006:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465665152 00000100:00100000:1.0:1746147252.198009:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465665152 00002000:00100000:1.0:1746147252.198027:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3182591) req@ffff88012df79500 x1830967465665152/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.198036:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967465665152 ext(3145728->3182591) 00010000:00010000:1.0:1746147252.198041:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 20 pid: 8481 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.198050:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 20 pid: 8481 timeout: 739 lvb_type: 0 00002000:00010000:1.0:1746147252.198055:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012df79500 00000100:00100000:1.0:1746147252.198065:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2513 00000100:00100000:1.0:1746147252.198069:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465665152:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147252.201476:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465665152:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 3404us (3538us total) trans 21474841357 rc 0/0 00000100:00100000:1.0:1746147252.201486:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2513 00002000:00100000:1.0:1746147252.201494:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3182591) req@ffff88012df79500 x1830967465665152/t21474841357(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.201503:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967465665152 ext(3145728->3182591) 00010000:00010000:1.0:1746147252.201510:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 22 pid: 8481 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.201521:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad085d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec68d expref: 22 pid: 8481 timeout: 739 lvb_type: 0 00002000:00010000:1.0:1746147252.201527:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012df79500 00000100:00100000:0.0:1746147252.203737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.209889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.209957:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465665536 00000100:00100000:1.0:1746147252.209963:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465665536 00002000:00100000:1.0:1746147252.209990:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b50c000 x1830967465665536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.209999:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50c000 with x1830967465665536 ext(1048576->2097151) 00002000:00010000:1.0:1746147252.210002:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50c000 00000100:00100000:1.0:1746147252.210029:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7299 00000100:00100000:1.0:1746147252.210035:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465665536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.212729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.212761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.212818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.213516:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465665920 00000100:00100000:2.0:1746147252.213524:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465665920 00002000:00100000:2.0:1746147252.213560:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009b50ce00 x1830967465665920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.213570:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50ce00 with x1830967465665920 ext(2097152->3145727) 00002000:00010000:2.0:1746147252.213574:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50ce00 00000100:00100000:2.0:1746147252.213596:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465666048 00000100:00100000:2.0:1746147252.213599:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465666048 00002000:00100000:2.0:1746147252.213610:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b50c380 x1830967465666048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.213617:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50c380 with x1830967465666048 ext(3145728->4194303) 00002000:00010000:2.0:1746147252.213620:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50c380 00000100:00100000:2.0:1746147252.213628:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465666304 00000100:00100000:2.0:1746147252.213629:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465666304 00002000:00100000:2.0:1746147252.213640:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b50d180 x1830967465666304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.213646:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50d180 with x1830967465666304 ext(3145728->4194303) 00002000:00010000:2.0:1746147252.213648:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50d180 00000100:00100000:2.0:1746147252.213660:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7300 00000100:00100000:2.0:1746147252.213665:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465665920:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147252.214770:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7302 00000100:00100000:2.0:1746147252.214777:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465666304:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147252.221486:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465665536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11442us (11589us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147252.221496:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7299 00002000:00100000:1.0:1746147252.221506:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b50c000 x1830967465665536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.221520:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50c000 with x1830967465665536 ext(1048576->2097151) 00002000:00010000:1.0:1746147252.221525:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50c000 00000100:00100000:2.0:1746147252.224287:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465665920:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10614us (11556us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.224296:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7300 00002000:00100000:2.0:1746147252.224306:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009b50ce00 x1830967465665920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.224315:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50ce00 with x1830967465665920 ext(2097152->3145727) 00002000:00010000:2.0:1746147252.224320:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50ce00 00000100:00100000:0.0:1746147252.233122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.233551:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465666304:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18774us (20732us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.233562:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7302 00002000:00100000:2.0:1746147252.233570:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b50d180 x1830967465666304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.233579:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50d180 with x1830967465666304 ext(3145728->4194303) 00002000:00010000:2.0:1746147252.233584:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b50d180 00000100:00100000:0.0:1746147252.239379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.239823:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465666560 00000100:00100000:2.0:1746147252.239836:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465666560 00002000:00100000:2.0:1746147252.239877:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1126400->1490943) req@ffff88009b50ed80 x1830967465666560/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.239887:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50ed80 with x1830967465666560 ext(1126400->1490943) 00010000:00010000:2.0:1746147252.239895:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 31 pid: 8481 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.239895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147252.239913:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d50c200/0xb4b2209fbdad0848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec686 expref: 31 pid: 8481 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.239920:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b50ed80 00000100:00100000:2.0:1746147252.239956:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2514 00000100:00100000:2.0:1746147252.239962:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465666560:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147252.247781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.248574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.253412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.253533:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465667328 00000100:00100000:2.0:1746147252.253543:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465667328 00002000:00100000:2.0:1746147252.253593:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134ed5880 x1830967465667328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.253602:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5880 with x1830967465667328 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.253610:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed5880 00000100:00100000:2.0:1746147252.253645:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7304 00000100:00100000:2.0:1746147252.253653:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465667328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.258026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.262259:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465667328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8600us (8851us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.262267:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7304 00002000:00100000:2.0:1746147252.262274:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134ed5880 x1830967465667328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.262280:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5880 with x1830967465667328 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.262283:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed5880 00000100:00100000:0.0:1746147252.266570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.266650:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465667712 00000100:00100000:1.0:1746147252.266660:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465667712 00000100:00100000:1.0:1746147252.266851:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4759 00000100:00100000:1.0:1746147252.266860:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:31760:x1830967465667712:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147252.267059:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:31760:x1830967465667712:12345-192.168.203.36@tcp:35:cat.0 Request processed in 201us (499us total) trans 8589945397 rc 0/0 00000100:00100000:1.0:1746147252.267065:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4759 00000100:00100000:0.0:1746147252.268532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.269233:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465667968 00000100:00100000:2.0:1746147252.269243:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465667968 00002000:00100000:2.0:1746147252.269288:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b6b9880 x1830967465667968/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.269299:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967465667968 ext(2097152->3145727) 00002000:00010000:2.0:1746147252.269304:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9880 00000100:00100000:2.0:1746147252.270061:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7305 00000100:00100000:2.0:1746147252.270081:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465667968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.285488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.285572:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465668096 00000100:00100000:2.0:1746147252.285580:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465668096 00000100:00100000:2.0:1746147252.285662:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15475 00000100:00100000:2.0:1746147252.285668:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31768:x1830967465668096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.285682:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.285695:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6ef expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.285714:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.285715:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.285721:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.285733:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.285742:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fac000, rc 0) 00000100:00100000:2.0:1746147252.285974:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31768:x1830967465668096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 305us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.285980:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15475 00000100:00100000:0.0:1746147252.293073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.293376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.293589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.294449:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7307 00000100:00100000:2.0:1746147252.294456:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967465668608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.294655:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7308 00000100:00100000:0.0:1746147252.294661:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465668864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.317343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.317420:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465669120 00000100:00100000:1.0:1746147252.317427:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465669120 00000100:00100000:1.0:1746147252.317463:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11410 00000100:00100000:1.0:1746147252.317499:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:31774:x1830967465669120:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147252.317501:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465668864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22801us (23873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.317509:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7308 00010000:00010000:1.0:1746147252.317516:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746147252.317517:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b6b8a80 x1830967465668864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.317526:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8a80 with x1830967465668864 ext(3145728->4194303) 00002000:00010000:2.0:1746147252.317531:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b8a80 00010000:00010000:1.0:1746147252.317531:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad08e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6f6 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.317611:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317622:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317630:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317639:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317645:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317650:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317729:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317735:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317741:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147252.317747:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147252.317855:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317861:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317866:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317870:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147252.317873:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317878:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317886:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147252.317889:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147252.317892:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.317896:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683c00/0xb4b2209fbdad08f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319116:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319123:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319128:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319132:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147252.319134:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319139:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319157:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f800) 00010000:00010000:1.0:1746147252.319159:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147252.319161:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319165:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad08f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.319199:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad08e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.319212:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.319217:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147252.319218:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147252.319220:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094683400, rc 0) 00000100:00100000:1.0:1746147252.319256:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:31774:x1830967465669120:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1787us (1919us total) trans 8589945398 rc 0/0 00000100:00100000:1.0:1746147252.319261:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11410 00000100:00100000:0.0:1746147252.325857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.344507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.345202:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465669632 00000100:00100000:2.0:1746147252.345211:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465669632 00000100:00100000:2.0:1746147252.345262:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4760 00000100:00100000:2.0:1746147252.345269:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31768:x1830967465669632:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147252.345443:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31768:x1830967465669632:12345-192.168.203.36@tcp:35:cat.0 Request processed in 173us (941us total) trans 8589945399 rc 0/0 00000100:00100000:2.0:1746147252.345449:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4760 00000100:00100000:0.0:1746147252.426312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.426424:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465669760 00000100:00100000:2.0:1746147252.426431:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465669760 00000100:00100000:2.0:1746147252.426482:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15476 00000100:00100000:2.0:1746147252.426488:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31774:x1830967465669760:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.426502:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.426516:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec6fd expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.426538:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.426546:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.426552:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 7 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.426557:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.426559:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.426561:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1929216->2097151] (req 1929216->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.426584:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 7 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.426593:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 7 pid: 6881 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.426602:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467022208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.426694:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.426701:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 21 pid: 8481 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.426709:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467022336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.426735:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.426742:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 24 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.426748:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467022464:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.426762:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.440682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.440712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.440749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.440779:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465669888 00000100:00100000:0.0:1746147252.440785:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465669888 00010000:00010000:0.0:1746147252.440811:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 8 pid: 6881 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.440831:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465670016 00000100:00100000:0.0:1746147252.440833:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465670016 00010000:00010000:0.0:1746147252.440841:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 22 pid: 8481 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.440851:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465670144 00000100:00100000:0.0:1746147252.440852:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465670144 00010000:00010000:0.0:1746147252.440859:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 25 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.440871:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7841 00000100:00100000:0.0:1746147252.440877:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465669888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.440887:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.440905:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 8 pid: 6881 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.440916:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 8 pid: 6881 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.440933:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.440982:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465669888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.440987:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7841 00000100:00100000:0.0:1746147252.440998:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7842 00000100:00100000:0.0:1746147252.441002:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465670016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.441007:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.441013:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 22 pid: 8481 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.441020:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 22 pid: 8481 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.441028:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.441039:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465670016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.441042:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7842 00000100:00100000:0.0:1746147252.441050:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7843 00000100:00100000:0.0:1746147252.441054:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465670144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.441060:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.441065:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 25 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.441072:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 25 pid: 8480 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.441081:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.441082:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.441088:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.441095:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.441563:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b829e00/0xb4b2209fbdad082c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec65c expref: 7 pid: 6881 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.441589:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467022208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.441599:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad08bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6c5 expref: 21 pid: 8481 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.441606:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467022336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.441655:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e037a00/0xb4b2209fbdad07b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec62b expref: 25 pid: 8480 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.441663:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467022464:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.441686:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.441694:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fac600, rc 0) 00000100:00100000:2.0:1746147252.441885:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31774:x1830967465669760:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15396us (15580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.441892:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15476 00010000:00010000:0.0:1746147252.442769:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.442784:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467022592:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147252.443890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.443981:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465670272 00000100:00100000:0.0:1746147252.443987:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465670272 00000100:00100000:0.0:1746147252.444016:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11411 00000100:00100000:0.0:1746147252.444020:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:31776:x1830967465670272:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147252.444037:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.444049:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec704 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.444091:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.444101:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.444109:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147252.445163:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00010000:00010000:0.0:1746147252.445286:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445294:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445301:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445385:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445392:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445397:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147252.445422:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147252.445425:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147252.445436:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445444:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445450:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445455:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445460:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445464:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b076a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147252.445466:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445471:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445478:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147252.445480:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147252.445483:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445487:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad091a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445499:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445505:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445509:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445513:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b077000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147252.445516:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445521:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.445527:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a46c3400) 00010000:00010000:0.0:1746147252.446779:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147252.446784:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.447045:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad0921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147252.447253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.447404:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467022592:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147252.447416:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.447446:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465670144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6391us (6695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.447458:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7843 00010000:00010000:0.0:1746147252.447698:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec704 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.447707:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec704 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.447714:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.447716:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147252.447719:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4a800, rc 0) 00000100:00100000:0.0:1746147252.447766:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:31776:x1830967465670272:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3744us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.447771:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11411 00000100:00100000:0.0:1746147252.451641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.451676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.451702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.451724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.451757:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465670784 00000100:00100000:0.0:1746147252.451764:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465670784 00000100:00100000:0.0:1746147252.451791:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465670912 00000100:00100000:0.0:1746147252.451793:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465670912 00000100:00100000:0.0:1746147252.451800:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465671040 00000100:00100000:0.0:1746147252.451801:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465671040 00000100:00100000:0.0:1746147252.451817:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15477 00000100:00100000:0.0:1746147252.451822:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465670784:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147252.451834:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.451848:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad092f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec70b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.451887:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467022720:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147252.452085:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465670656 00000100:00100000:2.0:1746147252.452088:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465670656 00000100:00100000:2.0:1746147252.452113:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 769 00000100:00100000:2.0:1746147252.452117:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465670656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.452126:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.452151:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa4a800/0xb4b2209fbdad0928 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec704 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.452164:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.452167:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.452186:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465670656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.452192:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 769 00000100:00100000:2.0:1746147252.452266:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15478 00000100:00100000:2.0:1746147252.452272:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465670912:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147252.452278:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.452287:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec712 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.452300:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.452302:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.452308:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.452318:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.452325:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fad800, rc 0) 00000100:00100000:2.0:1746147252.452338:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465670912:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 67us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.452342:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15478 00000100:00100000:2.0:1746147252.452351:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15479 00000100:00100000:2.0:1746147252.452355:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31774:x1830967465671040:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.452359:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.452363:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec719 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.452374:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.452379:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 7 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.452385:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad08db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6e8 expref: 34 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.452390:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.452392:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.452394:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1048576->1642495] (req 1048576->1642495) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.452409:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad08db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6e8 expref: 34 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.452419:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad08db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6e8 expref: 34 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.452426:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467022848:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.452462:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 7 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.452470:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 7 pid: 17548 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.452476:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467022976:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.452497:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.452504:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 15 pid: 8478 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.452514:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467023104:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.452528:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.452799:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.453102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.453262:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465671168 00000100:00100000:1.0:1746147252.453266:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465671168 00000100:00100000:1.0:1746147252.453287:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15480 00000100:00100000:1.0:1746147252.453292:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465671168:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147252.453300:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.453308:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec720 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.453317:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.453319:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.453323:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.453331:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.453343:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682e00, rc 0) 00000100:00100000:1.0:1746147252.453374:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465671168:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 81us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.453379:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15480 00000100:00100000:2.0:1746147252.453422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.453778:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465671424 00000100:00100000:1.0:1746147252.453782:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465671424 00000100:00100000:1.0:1746147252.454032:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11412 00000100:00100000:1.0:1746147252.454038:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31778:x1830967465671424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147252.454049:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.454058:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683600/0xb4b2209fbdad094b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec727 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454123:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.454134:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec694 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454153:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454160:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454166:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.454186:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454193:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 318 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.454201:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467023232:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.454678:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454685:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 28 pid: 14125 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.454692:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467023360:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.454717:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec694 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.454723:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0864 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec694 expref: 10 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.454730:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467023488:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.454745:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.457714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.457728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.457747:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.457769:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465671552 00000100:00100000:0.0:1746147252.457774:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465671552 00010000:00010000:0.0:1746147252.457796:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad08db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6e8 expref: 35 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.457813:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465671808 00000100:00100000:0.0:1746147252.457815:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465671808 00010000:00010000:0.0:1746147252.457822:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 16 pid: 8478 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.457843:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7845 00000100:00100000:0.0:1746147252.457847:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465671680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.457855:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147252.457926:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7846 00000100:00100000:1.0:1746147252.457934:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465671808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1746147252.457951:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147251 -> 1746147252 00002000:00010000:2.0:1746147252.457954:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147251 -> 1746147252 00010000:00010000:1.0:1746147252.457955:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147252.457956:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147251 -> 1746147252 00000100:00100000:2.0:1746147252.457966:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467022720:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147252.457984:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad092f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec70b expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.457993:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad092f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec70b expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.458000:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0c000, rc 0) 00000100:00100000:2.0:1746147252.458357:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465670784:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 6534us (6679us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147252.458413:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15477 00000100:00100000:2.0:1746147252.458557:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467022848:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.458567:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467022976:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.458573:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467023104:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147252.458858:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 8 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.458862:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 16 pid: 8478 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.458866:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 8 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.458874:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 16 pid: 8478 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.460331:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [1048576->1642495] (req 1048576->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.460341:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fad400, rc 0) 00000100:00100000:2.0:1746147252.460361:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31774:x1830967465671040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8006us (8637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.460366:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15479 00000100:00100000:2.0:1746147252.460406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147252.460760:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fad800/0xb4b2209fbdad0936 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec712 expref: 8 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.460775:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147252.460785:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72000/0xb4b2209fbdad08cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6da expref: 16 pid: 8478 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.460791:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465671680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2944us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.460797:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7845 00010000:00010000:1.0:1746147252.460799:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.460801:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.460805:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.461052:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465671936 00010000:00010000:1.0:1746147252.461055:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.461055:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465671936 00010000:00010000:0.0:1746147252.461067:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 29 pid: 14125 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.461076:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7847 00000100:00100000:0.0:1746147252.461080:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967465672064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.461088:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.461092:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 319 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.461098:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 319 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.461113:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.461117:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.461170:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.461388:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.461394:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.461411:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967465672064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 330us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.461416:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7847 00010000:00010000:0.0:1746147252.461463:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683400/0xb4b2209fbdad08fe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6f6 expref: 318 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.461471:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467023232:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147252.461479:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad600/0xb4b2209fbdad0895 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6b0 expref: 28 pid: 14125 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.461781:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467023616:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147252.461835:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.462090:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467023360:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.462102:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467023488:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147252.462115:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147252.462241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147252.462685:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.462824:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147252.462840:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147252.463438:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683600/0xb4b2209fbdad094b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.463450:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.463456:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147252.463458:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147252.463461:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682c00, rc 0) 00000100:00100000:1.0:1746147252.463485:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31778:x1830967465671424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9447us (10062us total) trans 8589945400 rc 0/0 00000100:00100000:1.0:1746147252.463491:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11412 00000100:00100000:0.0:1746147252.466337:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465672320 00000100:00100000:0.0:1746147252.466345:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465672320 00000100:00100000:0.0:1746147252.466390:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11413 00000100:00100000:0.0:1746147252.466397:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31776:x1830967465672320:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147252.466412:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.466427:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdad0960 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec72e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.466470:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdad0960 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec72e expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.466481:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdad0960 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec72e expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.466495:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.466498:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147252.466501:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0c400, rc 0) 00000100:00100000:0.0:1746147252.468043:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:31776:x1830967465672320:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 1642us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.468052:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11413 00000100:00100000:1.0:1746147252.468452:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467023616:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.468466:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.468573:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465671808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10639us (10823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.468581:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7846 00000100:00100000:0.0:1746147252.469978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.471881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.471886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.471908:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465672960 00000100:00100000:2.0:1746147252.471912:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465672960 00000100:00100000:2.0:1746147252.471966:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15481 00000100:00100000:2.0:1746147252.471972:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31778:x1830967465672960:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.471983:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.471996:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec73c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.472018:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.472026:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.472032:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.472038:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.472039:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.472042:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [462848->618495] (req 462848->618495) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.472203:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465672832 00000100:00100000:1.0:1746147252.472207:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465672832 00000100:00100000:1.0:1746147252.472229:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11414 00000100:00100000:1.0:1746147252.472234:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:31776:x1830967465672832:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147252.472241:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.472251:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683800/0xb4b2209fbdad096e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec735 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.472324:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472335:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472343:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472351:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472356:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472359:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472438:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0983 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472445:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0983 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472450:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0983 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147252.472456:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147252.472512:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472517:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472522:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472530:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147252.472532:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472549:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472557:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147252.472559:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147252.472562:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472566:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683000/0xb4b2209fbdad0975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472573:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472577:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472580:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472584:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147252.472586:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472589:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472593:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f400) 00010000:00010000:1.0:1746147252.472595:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147252.472597:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472601:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683a00/0xb4b2209fbdad097c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147252.472625:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683800/0xb4b2209fbdad096e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec735 expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.472633:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0983 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec735 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.472638:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147252.472640:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147252.472641:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094683e00, rc 0) 00000100:00100000:1.0:1746147252.472665:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31776:x1830967465672832:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 431us (789us total) trans 8589945401 rc 0/0 00000100:00100000:1.0:1746147252.472669:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11414 00010000:00010000:2.0:1746147252.473503:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 32 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.473514:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 32 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.473523:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467023744:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.473590:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.473597:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 6 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.473604:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467023872:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.473627:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.473633:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.473640:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467024000:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.473892:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.478116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.478177:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467023744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.478203:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467023872:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.478246:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467024000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.478274:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [462848->618495] (req 462848->618495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.478287:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134faca00, rc 0) 00000100:00100000:2.0:1746147252.478319:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31778:x1830967465672960:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6347us (6433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.478326:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15481 00000100:00100000:0.0:1746147252.478729:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465673216 00000100:00100000:0.0:1746147252.478734:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465673216 00000100:00100000:0.0:1746147252.479172:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11415 00000100:00100000:0.0:1746147252.479178:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31776:x1830967465673216:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147252.479194:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.479217:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0xb4b2209fbdad0991 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec743 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.479288:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.479300:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.479306:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.479327:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.479335:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 27 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.479344:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467024128:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.479384:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.481500:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465673472 00000100:00100000:2.0:1746147252.481507:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465673472 00010000:00010000:2.0:1746147252.481533:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 33 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.481562:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7850 00000100:00100000:2.0:1746147252.481567:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465673472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.481577:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.481595:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 33 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.481604:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 33 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.481621:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ed3a00/0xb4b2209fbdad07a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec616 expref: 33 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.481636:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.481664:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465673472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.481670:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7850 00000100:00100000:1.0:1746147252.482486:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465673856 00000100:00100000:1.0:1746147252.482490:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465673856 00000100:00100000:1.0:1746147252.482514:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4761 00000100:00100000:1.0:1746147252.482519:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+318:31774:x1830967465673856:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147252.482689:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+319:31774:x1830967465673856:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 169us (258us total) trans 8589945402 rc 0/0 00000100:00100000:1.0:1746147252.482694:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4761 00000100:00100000:0.0:1746147252.482820:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465673344 00000100:00100000:0.0:1746147252.482823:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465673344 00010000:00010000:0.0:1746147252.482838:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.482851:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465673600 00000100:00100000:0.0:1746147252.482852:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465673600 00010000:00010000:0.0:1746147252.482860:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.482871:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7851 00000100:00100000:0.0:1746147252.482875:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465673344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.482880:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.482891:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.482898:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.482908:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72a00/0xb4b2209fbdad0810 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec655 expref: 7 pid: 8480 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746147252.482918:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.482930:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465673344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.482948:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7851 00000100:00100000:0.0:1746147252.482958:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7852 00000100:00100000:0.0:1746147252.482962:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465673600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.482967:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.482972:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.482979:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.482987:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xb4b2209fbdad0776 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec608 expref: 16 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.482994:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.482996:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.483001:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.483008:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.483028:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.483036:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467024256:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147252.483065:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.484554:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467024128:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147252.484569:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147252.485152:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.485464:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465673984 00000100:00100000:1.0:1746147252.485468:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465673984 00010000:00010000:1.0:1746147252.485488:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 28 pid: 14049 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.485968:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7853 00000100:00100000:1.0:1746147252.485975:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465673984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.485984:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.485989:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 28 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.485998:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 28 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.486012:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094682c00/0xb4b2209fbdad0952 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec727 expref: 28 pid: 14049 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.486021:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147252.486025:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147252.486032:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147252.486036:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147252.486254:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.486292:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465673984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 317us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.486297:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7853 00010000:00010000:0.0:1746147252.486426:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486432:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486446:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486451:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486455:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486462:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0d600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147252.486465:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486470:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486476:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.486478:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147252.486481:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486485:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdad0998 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.486512:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0xb4b2209fbdad0991 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec743 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.486518:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0xb4b2209fbdad0991 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec743 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.486524:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0d400, rc 0) 00000100:00100000:0.0:1746147252.486544:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31776:x1830967465673216:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 7367us (8435us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147252.487072:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11415 00000100:00100000:2.0:1746147252.487675:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467024256:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147252.487688:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.487708:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465673600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4746us (5313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.487714:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7852 00000100:00100000:0.0:1746147252.489708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.490102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.490120:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465674496 00000100:00100000:0.0:1746147252.490126:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465674496 00000100:00100000:0.0:1746147252.490169:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11416 00000100:00100000:0.0:1746147252.490177:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+319:31782:x1830967465674496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.490194:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.490209:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad099f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec74a expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.490267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147252.490292:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490302:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490312:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490322:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490327:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490332:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147252.490413:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465674752 00010000:00010000:0.0:1746147252.490414:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147252.490417:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465674752 00010000:00010000:0.0:1746147252.490421:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490426:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:0.0:1746147252.490433:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:2.0:1746147252.490439:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4762 00000100:00100000:2.0:1746147252.490444:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31776:x1830967465674752:12345-192.168.203.36@tcp:35:mirror_io.0 00010000:00010000:0.0:1746147252.490495:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490501:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490505:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490510:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0c000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147252.490513:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490517:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490526:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147252.490529:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147252.490531:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490535:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0xb4b2209fbdad09a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490542:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147252.490543:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:31776:x1830967465674752:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 98us (276us total) trans 8589945404 rc 0/0 00010000:00010000:0.0:1746147252.490547:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147252.490549:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4762 00010000:00010000:0.0:1746147252.490551:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490554:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0c800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147252.490556:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490560:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490565:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f5da700) 00010000:00010000:0.0:1746147252.490567:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147252.490568:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490572:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad09ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147252.490597:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad099f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 322 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.490606:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 321 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.490612:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.490613:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147252.490615:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0cc00, rc 0) 00000100:00100000:0.0:1746147252.490636:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+321:31782:x1830967465674496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 461us (535us total) trans 8589945403 rc 0/0 00000100:00100000:0.0:1746147252.490641:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11416 00000100:00100000:0.0:1746147252.492736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.492807:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465674880 00000100:00100000:2.0:1746147252.492812:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465674880 00000100:00100000:2.0:1746147252.492839:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15482 00000100:00100000:2.0:1746147252.492844:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465674880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.492856:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.492867:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134facc00/0xb4b2209fbdad09c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec751 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147252.492907:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467024384:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147252.492989:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.495768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147252.495958:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime: 1746147251 -> 1746147252 00002000:00010000:2.0:1746147252.495962:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime: 1746147249 -> 1746147252 00002000:00010000:2.0:1746147252.495964:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime: 1746147251 -> 1746147252 00000100:00100000:2.0:1746147252.495975:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467024384:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147252.496001:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134facc00/0xb4b2209fbdad09c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec751 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.496011:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134facc00/0xb4b2209fbdad09c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec751 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.496019:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134facc00, rc 0) 00000100:00100000:2.0:1746147252.496218:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465674880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3372us (3482us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147252.496224:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15482 00000100:00100000:0.0:1746147252.497627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.498034:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465675392 00000100:00100000:1.0:1746147252.498040:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465675392 00000100:00100000:0.0:1746147252.499562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.499723:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4763 00000100:00100000:1.0:1746147252.499734:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31778:x1830967465675392:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147252.500456:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465675520 00000100:00100000:2.0:1746147252.500462:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465675520 00000100:00100000:2.0:1746147252.500490:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15483 00000100:00100000:2.0:1746147252.500495:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:31782:x1830967465675520:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.500504:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.500518:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec758 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.500539:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.500546:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746147252.500546:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31778:x1830967465675392:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 814us (2922us total) trans 8589945405 rc 0/0 00010000:00010000:2.0:1746147252.500548:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147252.500551:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.500552:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4763 00010000:00010000:2.0:1746147252.500574:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.500583:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 14 pid: 17548 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.500593:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467024512:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.500631:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.502564:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467024512:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.502587:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.502600:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fac800, rc 0) 00000100:00100000:2.0:1746147252.502641:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31782:x1830967465675520:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2144us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.502648:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15483 00000100:00100000:0.0:1746147252.505552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.510358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.510437:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465675776 00000100:00100000:2.0:1746147252.510444:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465675776 00010000:00010000:2.0:1746147252.510471:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 17 pid: 17548 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.510510:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7854 00000100:00100000:2.0:1746147252.510517:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465675776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.510528:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.510544:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 17 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.510554:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 17 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.510572:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad0967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->618495) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec73c expref: 17 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.510599:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.510601:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.510607:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.510614:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.510640:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147252.510650:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467024640:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147252.511342:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.514485:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467024640:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147252.514506:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.514559:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465675776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4042us (4207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.514567:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7854 00000100:00100000:0.0:1746147252.523464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.524117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.524187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.524240:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465676288 00000100:00100000:2.0:1746147252.524242:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465676544 00000100:00100000:0.0:1746147252.524243:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465676288 00000100:00100000:2.0:1746147252.524245:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465676544 00002000:00100000:0.0:1746147252.524260:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1929215) req@ffff88012db2f800 x1830967465676288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.524263:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1642496->2097151) req@ffff88012db2c000 x1830967465676544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.524268:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2f800 with x1830967465676288 ext(1048576->1929215) 00002000:00100000:2.0:1746147252.524270:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c000 with x1830967465676544 ext(1642496->2097151) 00002000:00010000:0.0:1746147252.524271:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2f800 00002000:00010000:2.0:1746147252.524273:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2c000 00000100:00100000:0.0:1746147252.524282:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7315 00000100:00100000:0.0:1746147252.524286:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465676288:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147252.524288:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7316 00000100:00100000:2.0:1746147252.524293:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465676544:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147252.531367:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465676544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7063us (7169us total) trans 0 rc 454656/454656 00000100:00100000:0.0:1746147252.531379:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7316 00002000:00100000:0.0:1746147252.531390:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1642496->2097151) req@ffff88012db2c000 x1830967465676544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 454656/454656 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.531399:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c000 with x1830967465676544 ext(1642496->2097151) 00002000:00010000:0.0:1746147252.531405:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2c000 00000100:00100000:2.0:1746147252.539680:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465676288:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15385us (15555us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746147252.539689:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7315 00002000:00100000:2.0:1746147252.539698:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1929215) req@ffff88012db2f800 x1830967465676288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.539706:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2f800 with x1830967465676288 ext(1048576->1929215) 00002000:00010000:2.0:1746147252.539710:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2f800 00000100:00100000:0.0:1746147252.563189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.578872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.580130:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465677056 00000100:00100000:2.0:1746147252.580146:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465677056 00000100:00100000:2.0:1746147252.580193:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11417 00000100:00100000:2.0:1746147252.580201:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31787:x1830967465677056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.580219:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.580234:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad09d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec75f expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.580316:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580327:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580336:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580348:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580353:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580358:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580444:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580452:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580458:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147252.580466:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.580532:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580538:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580544:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580548:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fad000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.580552:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580557:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580567:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.580569:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.580573:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580577:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad000/0xb4b2209fbdad09d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580594:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580599:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580604:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580608:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fac200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.580610:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580614:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580623:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13000) 00010000:00010000:2.0:1746147252.580625:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.580627:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580632:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fac200/0xb4b2209fbdad09de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.580660:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fad800/0xb4b2209fbdad09d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 31 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.580670:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 30 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.580675:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.580677:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147252.580679:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134faca00, rc 0) 00000100:00100000:2.0:1746147252.580735:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31787:x1830967465677056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 534us (1869us total) trans 8589945407 rc 0/0 00000100:00100000:2.0:1746147252.580741:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11417 00000100:00100000:1.0:1746147252.583794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.583902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.583973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.583995:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465677184 00000100:00100000:0.0:1746147252.584001:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465677184 00000100:00100000:0.0:1746147252.584027:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465677312 00000100:00100000:0.0:1746147252.584028:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465677312 00000100:00100000:0.0:1746147252.584037:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465677440 00000100:00100000:0.0:1746147252.584039:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465677440 00000100:00100000:0.0:1746147252.584065:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15484 00000100:00100000:0.0:1746147252.584071:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465677184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.584085:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.584096:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec766 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147252.584113:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.584115:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147252.584121:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.584132:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147252.584151:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e036200, rc 0) 00000100:00100000:0.0:1746147252.584182:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465677184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.584187:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15484 00000100:00100000:0.0:1746147252.584200:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15485 00000100:00100000:0.0:1746147252.584205:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465677312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.584211:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.584218:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e037600/0xb4b2209fbdad09fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec76d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.584247:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467024768:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147252.584290:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.584308:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15486 00000100:00100000:0.0:1746147252.584313:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465677440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147252.584318:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147252.584323:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad0a01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec774 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147252.584340:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467024896:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147252.584355:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.587826:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467024768:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147252.587852:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e037600/0xb4b2209fbdad09fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec76d expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.587864:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e037600/0xb4b2209fbdad09fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec76d expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147252.587887:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037600, rc 0) 00000100:00100000:2.0:1746147252.587932:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465677312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3726us (4029us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147252.587958:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15485 00002000:00010000:1.0:1746147252.588261:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147251 -> 1746147252 00002000:00010000:1.0:1746147252.588264:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147251 -> 1746147252 00000100:00100000:1.0:1746147252.588276:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467024896:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147252.588292:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad0a01 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec774 expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.588300:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e036000/0xb4b2209fbdad0a01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec774 expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.588319:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e036000, rc 0) 00000100:00100000:1.0:1746147252.588342:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465677440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4029us (4369us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147252.588348:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15486 00000100:00100000:0.0:1746147252.594006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.604971:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1958:x1830967465677696:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10782us (10964us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147252.604982:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7317 00002000:00100000:0.0:1746147252.604992:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008e91b800 x1830967465677696/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.605001:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b800 with x1830967465677696 ext(0->1048575) 00002000:00010000:0.0:1746147252.605006:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91b800 00000100:00100000:0.0:1746147252.622623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.622719:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465677824 00000100:00100000:1.0:1746147252.622727:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465677824 00000100:00100000:1.0:1746147252.623389:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15487 00000100:00100000:1.0:1746147252.623401:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31787:x1830967465677824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.623418:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.623432:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec77b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.623455:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.623461:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.623463:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.623466:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.623489:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.623500:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 22 pid: 21080 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.623510:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467025024:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.623586:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.625325:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467025024:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.625344:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.625356:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682400, rc 0) 00000100:00100000:1.0:1746147252.625386:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31787:x1830967465677824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1986us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.625392:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15487 00000100:00100000:0.0:1746147252.626454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.626649:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465677952 00000100:00100000:2.0:1746147252.626655:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465677952 00002000:00100000:2.0:1746147252.626686:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1929216->2097151) req@ffff88008e919f80 x1830967465677952/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.626694:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919f80 with x1830967465677952 ext(1929216->2097151) 00010000:00010000:2.0:1746147252.626701:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 23 pid: 21080 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.626711:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 23 pid: 21080 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.626718:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e919f80 00000100:00100000:2.0:1746147252.626734:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2516 00000100:00100000:2.0:1746147252.626740:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465677952:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147252.630212:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465677952:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3464us (3751us total) trans 21474841358 rc 0/0 00000100:00100000:2.0:1746147252.630223:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2516 00002000:00100000:2.0:1746147252.630231:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1929216->2097151) req@ffff88008e919f80 x1830967465677952/t21474841358(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.630246:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919f80 with x1830967465677952 ext(1929216->2097151) 00010000:00010000:2.0:1746147252.630254:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.630266:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.630272:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e919f80 00000100:00100000:0.0:1746147252.633131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.633270:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465678080 00000100:00100000:2.0:1746147252.633277:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465678080 00010000:00010000:2.0:1746147252.633304:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.633336:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7855 00000100:00100000:2.0:1746147252.633343:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465678080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.633353:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.633372:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.633382:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.633399:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fac600/0xb4b2209fbdad090c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6fd expref: 25 pid: 21080 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.634001:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.634004:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.634010:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.634017:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.634044:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147252.634054:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467025152:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147252.634358:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.636448:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467025152:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147252.636468:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.636500:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465678080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3157us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.636509:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7855 00000100:00100000:0.0:1746147252.639253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.639334:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465678336 00000100:00100000:2.0:1746147252.639342:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465678336 00002000:00100000:2.0:1746147252.639377:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008e91a680 x1830967465678336/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.639385:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a680 with x1830967465678336 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.639389:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e91a680 00000100:00100000:2.0:1746147252.639419:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7318 00000100:00100000:2.0:1746147252.639426:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465678336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147252.648297:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465678336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8863us (9043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.648307:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7318 00002000:00100000:2.0:1746147252.648317:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008e91a680 x1830967465678336/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.648326:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a680 with x1830967465678336 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.648331:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e91a680 00000100:00100000:0.0:1746147252.656252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.656334:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465678464 00000100:00100000:1.0:1746147252.656340:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465678464 00000100:00100000:1.0:1746147252.656423:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15488 00000100:00100000:1.0:1746147252.656429:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31787:x1830967465678464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.656443:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.656457:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec782 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.656479:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.656485:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.656486:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.656489:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.656511:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.656519:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 32 pid: 17548 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.656528:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467025280:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.657252:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.661102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.661217:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465678592 00000100:00100000:2.0:1746147252.661225:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465678592 00002000:00100000:2.0:1746147252.661260:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1642495) req@ffff88008e919880 x1830967465678592/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.661271:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919880 with x1830967465678592 ext(1048576->1642495) 00010000:00010000:2.0:1746147252.661279:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 33 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.661291:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 33 pid: 17548 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.661297:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e919880 00000100:00100000:2.0:1746147252.661313:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2517 00000100:00100000:2.0:1746147252.661319:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465678592:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147252.662255:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467025280:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.662276:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.662288:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682800, rc 0) 00000100:00100000:1.0:1746147252.662314:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31787:x1830967465678464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5885us (6069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.662320:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15488 00000100:00100000:2.0:1746147252.669058:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465678592:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7730us (7956us total) trans 17179874001 rc 0/0 00000100:00100000:2.0:1746147252.669072:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2517 00002000:00100000:2.0:1746147252.669081:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1642495) req@ffff88008e919880 x1830967465678592/t17179874001(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.669090:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919880 with x1830967465678592 ext(1048576->1642495) 00010000:00010000:2.0:1746147252.669098:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 35 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.669111:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 35 pid: 17548 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.669117:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e919880 00000100:00100000:0.0:1746147252.672705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.672812:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465678720 00000100:00100000:2.0:1746147252.672819:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465678720 00010000:00010000:2.0:1746147252.672848:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 35 pid: 17548 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.673045:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7856 00000100:00100000:2.0:1746147252.673054:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967465678720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.673067:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.673086:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 35 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.673097:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 35 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.673120:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fad400/0xb4b2209fbdad093d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec719 expref: 35 pid: 17548 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.673251:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.673254:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147252.673260:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.673267:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.673297:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147252.673307:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467025408:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147252.673855:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.676987:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467025408:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147252.677007:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.677054:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967465678720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3997us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.677063:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7856 00000100:00100000:0.0:1746147252.678529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.678622:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465678976 00000100:00100000:2.0:1746147252.678628:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465678976 00002000:00100000:2.0:1746147252.678657:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e91a300 x1830967465678976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.678671:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a300 with x1830967465678976 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.678675:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91a300 00000100:00100000:2.0:1746147252.678723:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7319 00000100:00100000:2.0:1746147252.678729:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465678976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147252.685854:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465678976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7113us (7315us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.685865:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7319 00002000:00100000:2.0:1746147252.685874:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e91a300 x1830967465678976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.685882:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a300 with x1830967465678976 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.685887:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91a300 00000100:00100000:0.0:1746147252.697406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.716072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.716282:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465679488 00000100:00100000:2.0:1746147252.716294:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465679488 00000100:00100000:2.0:1746147252.716330:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11418 00000100:00100000:2.0:1746147252.716335:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+322:31791:x1830967465679488:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.716352:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.716365:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485cc00/0xb4b2209fbdad0a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec789 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.716437:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.716448:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 323 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.716459:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 30 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.716465:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.716491:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 30 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.716500:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 30 pid: 14047 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.716511:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467025536:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147252.716804:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 323 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.716812:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 323 pid: 14047 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.716820:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467025664:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.716841:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.721435:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467025536:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.721447:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467025664:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.721676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.721745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.721776:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465679616 00000100:00100000:0.0:1746147252.721781:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465679616 00010000:00010000:0.0:1746147252.721809:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 31 pid: 14047 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.721840:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465679744 00000100:00100000:0.0:1746147252.721843:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465679744 00010000:00010000:0.0:1746147252.721850:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 324 pid: 14047 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.721866:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7857 00000100:00100000:0.0:1746147252.721872:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1958:x1830967465679616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.721881:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.721886:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 31 pid: 14047 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.721894:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 31 pid: 14047 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.721909:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134faca00/0xb4b2209fbdad09e5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec75f expref: 31 pid: 14047 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.721921:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.721925:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.721931:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.721962:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.721998:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465679616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.722003:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7857 00000100:00100000:0.0:1746147252.722031:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7858 00000100:00100000:0.0:1746147252.722035:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1958:x1830967465679744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147252.722039:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147252.722042:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 324 pid: 14047 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.722049:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 324 pid: 14047 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.722058:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad09b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec74a expref: 324 pid: 14047 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746147252.722065:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147252.722067:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.722073:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.722077:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147252.722087:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147252.722095:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+323:1958:x1830967465679744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147252.722100:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7858 00010000:00010000:2.0:1746147252.722303:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.722326:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.722331:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147252.722346:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.722458:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485cc00/0xb4b2209fbdad0a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 324 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.722479:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 323 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.722485:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.722487:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147252.722489:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e1fc00, rc 0) 00000100:00100000:2.0:1746147252.722512:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+323:31791:x1830967465679488:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6177us (6448us total) trans 8589945409 rc 0/0 00000100:00100000:2.0:1746147252.722519:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11418 00000100:00100000:0.0:1746147252.728231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.728382:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465680000 00000100:00100000:2.0:1746147252.728389:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465680000 00000100:00100000:2.0:1746147252.728427:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11419 00000100:00100000:2.0:1746147252.728433:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31794:x1830967465680000:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.728451:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.728464:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec790 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.728544:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728555:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728564:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728575:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728580:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728584:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728668:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728674:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728680:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147252.728686:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.728752:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728757:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728762:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728770:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50da00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.728773:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728778:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728787:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.728789:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.728792:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728796:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728805:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728809:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728813:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728816:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485d400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.728818:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728822:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728827:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13000) 00010000:00010000:2.0:1746147252.728829:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.728831:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728835:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.728864:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 33 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.728873:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 32 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.728878:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.728880:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147252.728881:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1515a00, rc 0) 00000100:00100000:2.0:1746147252.728932:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31794:x1830967465680000:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 499us (708us total) trans 8589945410 rc 0/0 00000100:00100000:2.0:1746147252.728957:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11419 00000100:00100000:0.0:1746147252.760967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.761525:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465680128 00000100:00100000:1.0:1746147252.761535:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465680128 00000100:00100000:1.0:1746147252.761578:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15489 00000100:00100000:1.0:1746147252.761583:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+34:31791:x1830967465680128:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147252.761597:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.761610:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec797 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.761632:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.761639:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.761640:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.761643:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1699840->2056191] (req 1699840->2056191) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 35 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.761777:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.761787:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094682800/0xb4b2209fbdad0a0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec782 expref: 17 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.761797:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467025792:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.761971:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.764286:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467025792:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.764335:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1699840->2056191] (req 1699840->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 35 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.764350:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077c00, rc 0) 00000100:00100000:1.0:1746147252.764400:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:31791:x1830967465680128:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2816us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.764406:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15489 00000100:00100000:0.0:1746147252.767185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.779075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.779527:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465680512 00000100:00100000:2.0:1746147252.779538:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465680512 00002000:00100000:2.0:1746147252.779570:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1699840->1703935) req@ffff88008e918a80 x1830967465680512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.779579:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918a80 with x1830967465680512 ext(1699840->1703935) 00002000:00010000:2.0:1746147252.779583:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e918a80 00000100:00100000:2.0:1746147252.779607:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7320 00000100:00100000:2.0:1746147252.779613:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465680512:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147252.779790:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465680512:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 176us (721us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.779808:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7320 00002000:00100000:2.0:1746147252.779813:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1699840->1703935) req@ffff88008e918a80 x1830967465680512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.779819:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918a80 with x1830967465680512 ext(1699840->1703935) 00002000:00010000:2.0:1746147252.779822:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e918a80 00000100:00100000:2.0:1746147252.785368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.785556:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465680768 00000100:00100000:0.0:1746147252.785564:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465680768 00002000:00100000:0.0:1746147252.785598:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (2052096->2056191) req@ffff880090508e00 x1830967465680768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.785608:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967465680768 ext(2052096->2056191) 00002000:00010000:0.0:1746147252.785613:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:0.0:1746147252.786427:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7321 00000100:00100000:0.0:1746147252.786436:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465680768:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147252.787696:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465680768:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1257us (2330us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147252.787702:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7321 00002000:00100000:0.0:1746147252.787710:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (2052096->2056191) req@ffff880090508e00 x1830967465680768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.787717:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967465680768 ext(2052096->2056191) 00002000:00010000:0.0:1746147252.787721:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:0.0:1746147252.812918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.813061:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465681024 00000100:00100000:2.0:1746147252.813069:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465681024 00000100:00100000:2.0:1746147252.813118:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11420 00000100:00100000:2.0:1746147252.813124:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+323:31797:x1830967465681024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.813151:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.813172:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec79e expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.813259:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813275:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813284:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813293:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813297:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813305:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813376:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813382:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813387:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147252.813393:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.813458:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813464:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813468:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813473:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50ca00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.813475:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813479:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813487:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.813489:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.813499:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813507:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813522:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813526:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813530:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813533:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50da00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.813535:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813538:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813543:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13c00) 00010000:00010000:2.0:1746147252.813544:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.813546:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813549:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0a63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.813572:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485d400/0xb4b2209fbdad0a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 326 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.813585:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 325 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.813594:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.813595:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147252.813597:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50c200, rc 0) 00000100:00100000:2.0:1746147252.814183:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+325:31797:x1830967465681024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1058us (1270us total) trans 8589945411 rc 0/0 00000100:00100000:2.0:1746147252.814189:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11420 00000100:00100000:0.0:1746147252.815928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.816040:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465681152 00000100:00100000:1.0:1746147252.816047:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465681152 00000100:00100000:1.0:1746147252.816088:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15490 00000100:00100000:1.0:1746147252.816095:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31794:x1830967465681152:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147252.816107:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.816119:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7a5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.816150:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec433 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.816159:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.816171:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.816177:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.816179:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.816182:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.816205:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.816215:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 7 pid: 21080 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.816225:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026048:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.816291:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.816298:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 23 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.816306:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026176:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.816329:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec433 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.816339:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec433 expref: 23 pid: 21080 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.816346:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026304:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.816360:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.819725:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026048:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147252.819733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.819734:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026176:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.819740:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026304:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.820235:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.820243:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b076a00, rc 0) 00000100:00100000:1.0:1746147252.820260:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31794:x1830967465681152:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4167us (4337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.820265:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15490 00000100:00100000:0.0:1746147252.822289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.822747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.822787:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.822807:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465681408 00000100:00100000:0.0:1746147252.822813:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465681408 00010000:00010000:0.0:1746147252.822839:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 8 pid: 21080 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.822860:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465681536 00000100:00100000:0.0:1746147252.822862:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465681536 00010000:00010000:0.0:1746147252.822872:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 25 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.822906:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465681664 00000100:00100000:1.0:1746147252.822909:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465681664 00010000:00010000:1.0:1746147252.822923:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad046d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec433 expref: 23 pid: 21080 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746147252.822930:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7860 00000100:00100000:2.0:1746147252.822955:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465681408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147252.822958:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7861 00000100:00100000:1.0:1746147252.822963:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465681536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147252.822965:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.822971:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147252.822982:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 8 pid: 21080 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.822983:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 25 pid: 8478 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.822993:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 8 pid: 21080 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.823000:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 25 pid: 8478 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.823014:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369aea00/0xb4b2209fbdad04e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec4b8 expref: 25 pid: 8478 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746147252.823020:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a400/0xb4b2209fbdad0497 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec45d expref: 8 pid: 21080 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.823025:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147252.823035:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147252.823053:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465681408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147252.823058:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7860 00000100:00100000:1.0:1746147252.823154:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465681536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 190us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.823161:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7861 00000100:00100000:0.0:1746147252.826209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.826301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.826364:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465682048 00000100:00100000:2.0:1746147252.826374:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465682048 00000100:00100000:1.0:1746147252.826386:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465681920 00000100:00100000:1.0:1746147252.826393:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465681920 00002000:00100000:2.0:1746147252.826410:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1896448->1900543) req@ffff880134f84e00 x1830967465682048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.826422:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84e00 with x1830967465682048 ext(1896448->1900543) 00002000:00010000:2.0:1746147252.826426:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84e00 00000100:00100000:1.0:1746147252.826439:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15492 00000100:00100000:2.0:1746147252.826443:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7322 00000100:00100000:1.0:1746147252.826446:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31797:x1830967465681920:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147252.826450:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465682048:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147252.826462:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.826479:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7b3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.826506:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.826514:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.826516:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.826519:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.826552:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.826564:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.826575:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465682048:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 125us (273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147252.826575:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026560:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147252.826581:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7322 00002000:00100000:2.0:1746147252.826586:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1896448->1900543) req@ffff880134f84e00 x1830967465682048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.826593:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84e00 with x1830967465682048 ext(1896448->1900543) 00010000:00010000:2.0:1746147252.826599:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.826611:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.826617:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f84e00 00000100:00100000:1.0:1746147252.826642:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.827829:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026560:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.827844:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.827852:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98da00, rc 0) 00000100:00100000:1.0:1746147252.827872:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31797:x1830967465681920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1428us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.827877:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15492 00000100:00100000:0.0:1746147252.829751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.829798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.829864:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465682432 00000100:00100000:2.0:1746147252.829872:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465682432 00002000:00100000:2.0:1746147252.829904:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1896448->2097151) req@ffff880134f85180 x1830967465682432/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.829913:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85180 with x1830967465682432 ext(1896448->2097151) 00010000:00010000:2.0:1746147252.829921:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.829934:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 22 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.829963:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f85180 00000100:00100000:1.0:1746147252.829966:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465682304 00000100:00100000:1.0:1746147252.829970:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465682304 00000100:00100000:1.0:1746147252.829992:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15493 00000100:00100000:2.0:1746147252.829994:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2518 00000100:00100000:1.0:1746147252.829998:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31794:x1830967465682304:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147252.830000:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465682432:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:1.0:1746147252.830547:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.830560:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7ba expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.830583:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.830589:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0a7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ac expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.830593:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.830595:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.830598:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->1347583] (req 1048576->1347583) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.830620:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0a7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ac expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.830628:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0a7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ac expref: 24 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.830638:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026688:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.830915:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.830924:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.830931:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026816:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.831182:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.836026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.836104:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026688:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.836113:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467026816:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.836131:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1048576->1347583] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.836158:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98dc00, rc 0) 00010000:00010000:3.0:1746147252.836168:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0a7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ac expref: 25 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.836182:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31794:x1830967465682304:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6185us (6438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.836187:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15493 00010000:00010000:3.0:1746147252.836189:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0a7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ac expref: 25 pid: 8478 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746147252.836468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.836618:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465682688 00000100:00100000:1.0:1746147252.836621:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465682688 00010000:00010000:1.0:1746147252.836633:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.836658:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7864 00000100:00100000:1.0:1746147252.836663:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465682688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.836669:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.836677:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.836684:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.836822:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147252.836828:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682400/0xb4b2209fbdad0a08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec77b expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.836841:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.836843:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.836847:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.836854:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147252.836985:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465682560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 865us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.836991:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7863 00010000:00010000:1.0:1746147252.837065:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.837076:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467026944:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147252.837112:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.837209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.837277:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465682816 00000100:00100000:3.0:1746147252.837280:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465682816 00010000:00010000:3.0:1746147252.837324:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746147252.837461:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7865 00000100:00100000:3.0:1746147252.837466:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465682816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147252.837473:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147252.837482:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147250 -> 1746147252 00002000:00010000:3.0:1746147252.837485:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147250 -> 1746147252 00010000:00010000:3.0:1746147252.837488:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.837496:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.837507:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b076a00/0xb4b2209fbdad0a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7a5 expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.837519:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147252.837520:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147252.837523:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.837529:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.837546:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147252.837553:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467027072:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147252.837589:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.842359:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467026944:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147252.842756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147252.842806:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.842852:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465682688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6187us (6382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.842862:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7864 00000100:00100000:2.0:1746147252.842930:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465683072 00000100:00100000:2.0:1746147252.842950:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465683072 00002000:00100000:2.0:1746147252.842979:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1343488->1347583) req@ffff880134f84000 x1830967465683072/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.842988:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84000 with x1830967465683072 ext(1343488->1347583) 00002000:00010000:2.0:1746147252.842992:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84000 00000100:00100000:2.0:1746147252.843004:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7323 00000100:00100000:2.0:1746147252.843009:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465683072:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147252.843370:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465683072:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 360us (615us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.843377:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7323 00002000:00100000:2.0:1746147252.843382:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1343488->1347583) req@ffff880134f84000 x1830967465683072/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.843389:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84000 with x1830967465683072 ext(1343488->1347583) 00002000:00010000:2.0:1746147252.843392:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84000 00000100:00100000:3.0:1746147252.843448:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467027072:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147252.843458:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147252.843484:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465682816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6018us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.843489:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7865 00000100:00100000:0.0:1746147252.846714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.846766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.846828:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465683584 00000100:00100000:3.0:1746147252.846836:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465683584 00000100:00100000:2.0:1746147252.846839:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465683328 00000100:00100000:2.0:1746147252.846843:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465683328 00002000:00100000:2.0:1746147252.846871:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f87480 x1830967465683328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.846880:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87480 with x1830967465683328 ext(1048576->2097151) 00000100:00100000:3.0:1746147252.846881:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4766 00002000:00010000:2.0:1746147252.846884:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87480 00000100:00100000:3.0:1746147252.846887:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31794:x1830967465683584:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147252.846898:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7324 00000100:00100000:2.0:1746147252.846903:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465683328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147252.847057:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+33:31794:x1830967465683584:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 168us (289us total) trans 8589945412 rc 0/0 00000100:00100000:3.0:1746147252.847066:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4766 00000100:00100000:2.0:1746147252.858195:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465683328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11283us (11479us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.858204:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7324 00002000:00100000:2.0:1746147252.858213:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f87480 x1830967465683328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.858222:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87480 with x1830967465683328 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.858227:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87480 00000100:00100000:0.0:1746147252.866843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.866904:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465683712 00000100:00100000:1.0:1746147252.866911:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465683712 00000100:00100000:1.0:1746147252.866988:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15494 00000100:00100000:1.0:1746147252.866995:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31797:x1830967465683712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.867010:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.867023:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7c1 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.867048:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.867054:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.867056:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147252.867058:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.867080:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.867089:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 22 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.867100:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467027200:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147252.867184:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147252.871424:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467027200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147252.871450:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.871464:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98c000, rc 0) 00000100:00100000:1.0:1746147252.871495:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31797:x1830967465683712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4501us (4659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.871502:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15494 00000100:00100000:0.0:1746147252.874040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.874101:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465683840 00000100:00100000:2.0:1746147252.874107:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465683840 00002000:00100000:2.0:1746147252.874150:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1347583) req@ffff880134f85f80 x1830967465683840/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.874159:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85f80 with x1830967465683840 ext(1048576->1347583) 00010000:00010000:2.0:1746147252.874166:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 23 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.874178:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 23 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.874189:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f85f80 00000100:00100000:2.0:1746147252.874217:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2519 00000100:00100000:2.0:1746147252.874224:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465683840:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147252.890728:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465683840:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 16493us (16683us total) trans 21474841360 rc 0/0 00000100:00100000:2.0:1746147252.890740:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2519 00002000:00100000:2.0:1746147252.890755:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1347583) req@ffff880134f85f80 x1830967465683840/t21474841360(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.890763:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85f80 with x1830967465683840 ext(1048576->1347583) 00010000:00010000:2.0:1746147252.890772:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.890786:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.890792:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f85f80 00000100:00100000:0.0:1746147252.893691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.894025:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465683968 00000100:00100000:3.0:1746147252.894032:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465683968 00010000:00010000:3.0:1746147252.894059:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746147252.894097:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7866 00000100:00100000:3.0:1746147252.894104:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465683968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147252.894115:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147252.894133:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.894155:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.894174:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d98dc00/0xb4b2209fbdad0a8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7ba expref: 25 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746147252.894188:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147252.894190:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147252.894195:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.894202:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.894229:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147252.894241:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467027328:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147252.894315:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147252.897036:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467027328:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147252.897052:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147252.897093:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465683968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2989us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.897102:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7866 00000100:00100000:0.0:1746147252.899554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.899594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.899623:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465684352 00000100:00100000:2.0:1746147252.899631:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465684352 00000100:00100000:1.0:1746147252.899660:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465684480 00000100:00100000:1.0:1746147252.899665:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465684480 00002000:00100000:2.0:1746147252.899667:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134f85880 x1830967465684352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.899676:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85880 with x1830967465684352 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.899680:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85880 00002000:00100000:1.0:1746147252.899682:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134f86680 x1830967465684480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 504/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.899694:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86680 with x1830967465684480 ext(1048576->2097151) 00002000:00010000:1.0:1746147252.899697:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f86680 00000100:00100000:2.0:1746147252.899711:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7325 00000100:00100000:2.0:1746147252.899719:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465684352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147252.899722:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7326 00000100:00100000:1.0:1746147252.899728:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465684480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147252.905823:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465684480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6084us (6218us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746147252.905833:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7326 00002000:00100000:1.0:1746147252.905843:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134f86680 x1830967465684480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 504/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147252.905852:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86680 with x1830967465684480 ext(1048576->2097151) 00002000:00010000:1.0:1746147252.905857:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f86680 00000100:00100000:2.0:1746147252.908981:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465684352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9217us (9387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.908995:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7325 00002000:00100000:2.0:1746147252.909008:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134f85880 x1830967465684352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.909018:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85880 with x1830967465684352 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.909035:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85880 00000100:00100000:0.0:1746147252.921414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.922294:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465684736 00000100:00100000:1.0:1746147252.922303:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465684736 00000100:00100000:1.0:1746147252.922351:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4767 00000100:00100000:1.0:1746147252.922357:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:31797:x1830967465684736:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147252.922544:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+326:31797:x1830967465684736:12345-192.168.203.36@tcp:35:cat.0 Request processed in 186us (1136us total) trans 8589945413 rc 0/0 00000100:00100000:1.0:1746147252.922556:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4767 00000100:00100000:0.0:1746147252.925508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.925564:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465684992 00000100:00100000:2.0:1746147252.925570:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465684992 00000100:00100000:2.0:1746147252.925612:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11421 00000100:00100000:2.0:1746147252.925619:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+33:31802:x1830967465684992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147252.925635:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.925647:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e400/0xb4b2209fbdad0a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7c8 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.925723:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925735:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925743:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925753:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925764:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925770:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925849:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92ea00/0xb4b2209fbdad0ab0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925856:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92ea00/0xb4b2209fbdad0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925862:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92ea00/0xb4b2209fbdad0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147252.925868:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.925922:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925928:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925933:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925953:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b92e600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.925956:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925962:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925970:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.925972:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.925976:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.925984:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e600/0xb4b2209fbdad0aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926006:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926010:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926014:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926018:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b92e800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.926020:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926024:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926029:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13500) 00010000:00010000:2.0:1746147252.926031:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.926032:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926036:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e800/0xb4b2209fbdad0aa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147252.926063:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e400/0xb4b2209fbdad0a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c8 expref: 36 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.926073:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92ea00/0xb4b2209fbdad0ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c8 expref: 35 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.926082:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.926083:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147252.926085:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b92ea00, rc 0) 00000100:00100000:2.0:1746147252.926120:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+35:31802:x1830967465684992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 501us (615us total) trans 8589945414 rc 0/0 00000100:00100000:2.0:1746147252.926125:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11421 00000100:00100000:0.0:1746147252.929160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.929742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.930149:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.930187:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465685248 00000100:00100000:1.0:1746147252.930193:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465685248 00000100:00100000:1.0:1746147252.930229:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465685120 00000100:00100000:1.0:1746147252.930230:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465685120 00000100:00100000:1.0:1746147252.930243:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15495 00000100:00100000:1.0:1746147252.930248:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465685248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.930261:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.930273:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7d6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.930292:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.930294:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.930301:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.930314:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.930323:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077400, rc 0) 00000100:00100000:1.0:1746147252.930353:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465685248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 105us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.930359:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15495 00000100:00100000:1.0:1746147252.930371:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15496 00000100:00100000:1.0:1746147252.930375:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465685120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147252.930380:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147252.930385:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7cf expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.930394:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.930395:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.930399:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.930411:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147252.930418:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077200, rc 0) 00000100:00100000:1.0:1746147252.930428:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465685120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 53us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.930433:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15496 00000100:00100000:3.0:1746147252.930985:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465685376 00000100:00100000:3.0:1746147252.930990:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465685376 00000100:00100000:3.0:1746147252.931292:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15497 00000100:00100000:3.0:1746147252.931299:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465685376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147252.931306:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147252.931315:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d72600/0xb4b2209fbdad0acc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7dd expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147252.931347:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027456:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147252.931403:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.931429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.931775:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465685504 00000100:00100000:3.0:1746147252.931778:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465685504 00000100:00100000:3.0:1746147252.931799:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 770 00000100:00100000:3.0:1746147252.931804:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1959:x1830967465685504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147252.931813:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147252.931824:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92ea00/0xb4b2209fbdad0ab0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c8 expref: 35 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.931845:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147252.931849:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147252.931867:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1959:x1830967465685504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.931872:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 770 00000100:00100000:3.0:1746147252.932772:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027456:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147252.932789:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d72600/0xb4b2209fbdad0acc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7dd expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147252.932799:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72600/0xb4b2209fbdad0acc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7dd expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147252.932806:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72600, rc 0) 00000100:00100000:3.0:1746147252.932824:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465685376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1526us (2676us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147252.932830:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15497 00000100:00100000:1.0:1746147252.943857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.943903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.943981:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465685760 00000100:00100000:0.0:1746147252.943988:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465685760 00002000:00100000:0.0:1746147252.944021:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012db2d180 x1830967465685760/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.944030:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d180 with x1830967465685760 ext(1048576->2097151) 00002000:00010000:0.0:1746147252.944034:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d180 00000100:00100000:0.0:1746147252.944046:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686016 00000100:00100000:0.0:1746147252.944048:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686016 00002000:00100000:0.0:1746147252.944054:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012db2e680 x1830967465686016/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147252.944061:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e680 with x1830967465686016 ext(1048576->2097151) 00002000:00010000:0.0:1746147252.944063:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2e680 00000100:00100000:0.0:1746147252.944085:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7327 00000100:00100000:0.0:1746147252.944090:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465685760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147252.944238:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7328 00000100:00100000:2.0:1746147252.944247:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465686016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147252.956047:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465685760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11946us (12187us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.956057:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7327 00002000:00100000:2.0:1746147252.956067:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012db2d180 x1830967465685760/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.956075:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d180 with x1830967465685760 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.956080:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d180 00000100:00100000:2.0:1746147252.960422:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1959:x1830967465686016:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16170us (16510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147252.960432:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7328 00002000:00100000:2.0:1746147252.960441:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012db2e680 x1830967465686016/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.960450:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e680 with x1830967465686016 ext(1048576->2097151) 00002000:00010000:2.0:1746147252.960454:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2e680 00000100:00100000:0.0:1746147252.967713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.967824:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686144 00000100:00100000:3.0:1746147252.967833:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686144 00000100:00100000:3.0:1746147252.967875:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15498 00000100:00100000:3.0:1746147252.967882:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31802:x1830967465686144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147252.967901:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147252.967917:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7e4 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.967972:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.967981:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147252.967983:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147252.967986:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.968015:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.968027:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 34 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746147252.968039:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027584:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147252.968893:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.970275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.970342:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686400 00000100:00100000:2.0:1746147252.970352:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686400 00000100:00100000:2.0:1746147252.970723:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11422 00000100:00100000:2.0:1746147252.970731:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+34:31805:x1830967465686400:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147252.970750:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147252.970769:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f000/0xb4b2209fbdad0ada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7eb expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.970860:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.970870:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.970878:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.970890:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.970894:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.970899:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971014:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f600/0xb4b2209fbdad0aef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971023:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f600/0xb4b2209fbdad0aef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971028:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f600/0xb4b2209fbdad0aef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147252.971040:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147252.971104:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971110:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971114:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971119:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b92f200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.971122:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971127:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971153:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147252.971156:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.971159:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971164:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f200/0xb4b2209fbdad0ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971193:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971198:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971203:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971210:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b92f400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147252.971212:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971217:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971223:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13800) 00010000:00010000:2.0:1746147252.971224:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147252.971226:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971231:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f400/0xb4b2209fbdad0ae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147252.971260:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f000/0xb4b2209fbdad0ada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7eb expref: 37 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.971270:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f600/0xb4b2209fbdad0aef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7eb expref: 36 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147252.971275:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147252.971277:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147252.971279:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b92f600, rc 0) 00000100:00100000:2.0:1746147252.971339:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+36:31805:x1830967465686400:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 609us (1069us total) trans 8589945415 rc 0/0 00000100:00100000:2.0:1746147252.971344:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11422 00000100:00100000:3.0:1746147252.972277:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027584:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147252.972294:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.972306:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73800, rc 0) 00000100:00100000:3.0:1746147252.972337:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31802:x1830967465686144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4454us (4633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.972343:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15498 00000100:00100000:0.0:1746147252.972979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.973018:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686528 00000100:00100000:2.0:1746147252.973023:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686528 00002000:00100000:2.0:1746147252.973050:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1699840->2056191) req@ffff88012d498000 x1830967465686528/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.973058:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498000 with x1830967465686528 ext(1699840->2056191) 00000100:00100000:1.0:1746147252.973059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147252.973063:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 35 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.973072:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 35 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.973078:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d498000 00000100:00100000:2.0:1746147252.973092:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2520 00000100:00100000:2.0:1746147252.973097:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465686528:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147252.973128:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686656 00000100:00100000:3.0:1746147252.973131:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686656 00000100:00100000:3.0:1746147252.973161:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 771 00000100:00100000:3.0:1746147252.973166:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1957:x1830967465686656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147252.973174:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147252.973187:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92f600/0xb4b2209fbdad0aef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7eb expref: 36 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.973215:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147252.973218:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147252.973238:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1957:x1830967465686656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.973243:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 771 00000100:00100000:0.0:1746147252.973719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.973784:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686784 00000100:00100000:3.0:1746147252.973788:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686784 00000100:00100000:3.0:1746147252.973806:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15499 00000100:00100000:3.0:1746147252.973811:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31805:x1830967465686784:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147252.973818:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147252.973827:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7f2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.973843:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.973851:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147252.973857:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 5 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147252.973862:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147252.973864:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147252.973867:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3686400->3706879] (req 3686400->3706879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.973887:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 5 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147252.973895:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 5 pid: 17548 timeout: 739 lvb_type: 1 00000100:00100000:3.0:1746147252.973904:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027712:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147252.974029:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147252.974037:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 739 lvb_type: 1 00000100:00100000:3.0:1746147252.974044:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027840:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147252.974066:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.974074:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 36 pid: 8478 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746147252.974080:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027968:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147252.974092:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147252.982330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.982441:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027712:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147252.982454:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027840:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147252.982461:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467027968:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147252.982486:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3686400->3706879] (req 3686400->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147252.982501:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72400, rc 0) 00000100:00100000:3.0:1746147252.982549:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31805:x1830967465686784:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8737us (8830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147252.982557:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15499 00000100:00100000:1.0:1746147252.982687:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465686912 00000100:00100000:1.0:1746147252.982693:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465686912 00010000:00010000:1.0:1746147252.982713:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 6 pid: 17548 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.982739:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7867 00000100:00100000:1.0:1746147252.982743:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465686912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.982753:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.982769:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 6 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.982777:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 6 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.982791:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98c800/0xb4b2209fbdad0872 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6a2 expref: 6 pid: 17548 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.982811:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.982834:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1956:x1830967465686912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.982839:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7867 00000100:00100000:0.0:1746147252.982864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.982884:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465687040 00000100:00100000:1.0:1746147252.982886:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465687040 00010000:00010000:1.0:1746147252.982896:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 37 pid: 8478 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746147252.983256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.983743:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465687168 00000100:00100000:1.0:1746147252.983747:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465687168 00010000:00010000:1.0:1746147252.983760:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746147252.983780:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7868 00000100:00100000:1.0:1746147252.983785:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465687040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.983791:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.983799:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 37 pid: 8478 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.983807:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 37 pid: 8478 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.983818:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e400/0xb4b2209fbdad0841 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec67f expref: 37 pid: 8478 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746147252.983830:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.983848:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465687040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.983852:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7868 00000100:00100000:1.0:1746147252.983862:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7869 00000100:00100000:1.0:1746147252.983867:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465687168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.983871:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147252.983877:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.983884:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.983893:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad08c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6d3 expref: 19 pid: 8481 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746147252.983900:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.983902:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.983907:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.983913:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.983953:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.983964:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467028096:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147252.984002:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147252.986641:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465686528:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13536us (13662us total) trans 17179874002 rc 0/0 00000100:00100000:2.0:1746147252.986651:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2520 00002000:00100000:2.0:1746147252.986660:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1699840->2056191) req@ffff88012d498000 x1830967465686528/t17179874002(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:628/0 lens 488/448 e 0 to 0 dl 1746147263 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.986668:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498000 with x1830967465686528 ext(1699840->2056191) 00010000:00010000:2.0:1746147252.986676:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 36 pid: 6881 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746147252.986689:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 36 pid: 6881 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746147252.986695:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d498000 00000100:00100000:1.0:1746147252.992036:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467028096:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.992052:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.992094:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465687168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8223us (8834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.992103:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7869 00000100:00100000:0.0:1746147252.993798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147252.993830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147252.993837:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465687296 00000100:00100000:1.0:1746147252.993843:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465687296 00010000:00010000:1.0:1746147252.993864:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 36 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746147252.993895:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7870 00000100:00100000:2.0:1746147252.993896:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465687552 00000100:00100000:2.0:1746147252.993900:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465687552 00000100:00100000:1.0:1746147252.993901:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465687296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147252.993910:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746147252.993921:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3686400->3690495) req@ffff88012d49b800 x1830967465687552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746147252.993927:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 36 pid: 6881 timeout: 739 lvb_type: 0 00002000:00100000:2.0:1746147252.993929:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b800 with x1830967465687552 ext(3686400->3690495) 00002000:00010000:2.0:1746147252.993933:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b800 00010000:00010000:1.0:1746147252.993952:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 36 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.993968:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7329 00010000:00010000:1.0:1746147252.993970:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b077c00/0xb4b2209fbdad0a4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2056191) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec797 expref: 36 pid: 6881 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746147252.993973:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465687552:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147252.993988:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.993990:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147252.993995:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.994001:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147252.994021:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147252.994029:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467028224:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147252.994079:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465687552:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 105us (248us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.994084:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7329 00000100:00100000:1.0:1746147252.994087:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1000 going to sleep for 11 seconds 00002000:00100000:2.0:1746147252.994089:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3686400->3690495) req@ffff88012d49b800 x1830967465687552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.994096:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b800 with x1830967465687552 ext(3686400->3690495) 00002000:00010000:2.0:1746147252.994099:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b800 00010000:00010000:3.0:1746147252.995332:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147252.997431:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467028224:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147252.997447:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147252.997480:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465687296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3578us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147252.997490:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7870 00000100:00100000:1.0:1746147252.999173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147252.999264:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465687808 00000100:00100000:2.0:1746147252.999272:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465687808 00002000:00100000:2.0:1746147252.999308:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3702784->3706879) req@ffff88012db2e300 x1830967465687808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.999317:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e300 with x1830967465687808 ext(3702784->3706879) 00002000:00010000:2.0:1746147252.999322:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2e300 00000100:00100000:2.0:1746147252.999352:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7330 00000100:00100000:2.0:1746147252.999360:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465687808:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147252.999361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147252.999385:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465688064 00000100:00100000:3.0:1746147252.999389:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465688064 00002000:00100000:3.0:1746147252.999407:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012d499880 x1830967465688064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/0 e 0 to 0 dl 1746147263 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147252.999413:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967465688064 ext(1048576->2097151) 00002000:00010000:3.0:1746147252.999415:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:3.0:1746147252.999430:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7331 00000100:00100000:3.0:1746147252.999433:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465688064:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147252.999690:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967465687808:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 330us (520us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147252.999697:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7330 00002000:00100000:2.0:1746147252.999702:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3702784->3706879) req@ffff88012db2e300 x1830967465687808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147252.999708:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e300 with x1830967465687808 ext(3702784->3706879) 00002000:00010000:2.0:1746147252.999711:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2e300 00000100:00100000:0.0:1746147253.001488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.001602:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465688320 00000100:00100000:2.0:1746147253.001611:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465688320 00000100:00100000:2.0:1746147253.002282:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4768 00000100:00100000:2.0:1746147253.002291:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+35:31805:x1830967465688320:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147253.002516:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+36:31805:x1830967465688320:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 225us (1033us total) trans 8589945416 rc 0/0 00000100:00100000:2.0:1746147253.002523:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4768 00000100:00100000:3.0:1746147253.007993:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465688064:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8552us (8633us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.008002:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7331 00002000:00100000:3.0:1746147253.008010:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012d499880 x1830967465688064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:628/0 lens 488/440 e 0 to 0 dl 1746147263 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.008023:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967465688064 ext(1048576->2097151) 00002000:00010000:3.0:1746147253.008026:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:0.0:1746147253.016695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.016754:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465688576 00000100:00100000:3.0:1746147253.016761:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465688576 00002000:00100000:3.0:1746147253.016811:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012d49aa00 x1830967465688576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.016819:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49aa00 with x1830967465688576 ext(2097152->3145727) 00002000:00010000:3.0:1746147253.016824:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49aa00 00000100:00100000:3.0:1746147253.016845:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7332 00000100:00100000:3.0:1746147253.016850:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967465688576:12345-192.168.203.36@tcp:3:cat.0 00000100:00080000:0.0:1746147253.017738:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147253.018108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.019794:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465688832 00000100:00100000:2.0:1746147253.019802:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465688832 00002000:00100000:2.0:1746147253.019836:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012db2fb80 x1830967465688832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 504/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.019845:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2fb80 with x1830967465688832 ext(3145728->4194303) 00002000:00010000:2.0:1746147253.019850:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2fb80 00000100:00100000:2.0:1746147253.019966:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7333 00000100:00100000:2.0:1746147253.019973:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465688832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.031322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.031589:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465689088 00000100:00100000:2.0:1746147253.031597:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465689088 00000100:00100000:2.0:1746147253.031650:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11423 00000100:00100000:2.0:1746147253.031657:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+326:31808:x1830967465689088:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147253.031677:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.031692:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206c00/0xb4b2209fbdad0b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec7f9 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.031777:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031788:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031797:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031807:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031812:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031817:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031908:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0b19 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031916:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.031922:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147253.031928:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.032026:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032036:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032041:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032046:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b206e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.032049:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032054:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032063:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.032065:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.032068:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032073:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206e00/0xb4b2209fbdad0b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032094:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032099:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032103:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032107:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b207000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.032108:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032115:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032121:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13300) 00010000:00010000:2.0:1746147253.032122:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.032124:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032128:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207000/0xb4b2209fbdad0b12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.032172:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206c00/0xb4b2209fbdad0b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f9 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.032182:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0b19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f9 expref: 328 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.032187:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.032189:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147253.032190:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b207200, rc 0) 00000100:00100000:2.0:1746147253.032246:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:31808:x1830967465689088:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 588us (929us total) trans 8589945417 rc 0/0 00000100:00100000:2.0:1746147253.032251:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11423 00000100:00100000:3.0:1746147253.034334:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465688576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17479us (17641us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.034343:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7332 00002000:00100000:3.0:1746147253.034351:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012d49aa00 x1830967465688576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.034359:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49aa00 with x1830967465688576 ext(2097152->3145727) 00002000:00010000:3.0:1746147253.034363:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49aa00 00000100:00100000:2.0:1746147253.039779:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967465688832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19798us (21665us total) trans 0 rc 1028096/1028096 00000100:00100000:2.0:1746147253.039790:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7333 00002000:00100000:2.0:1746147253.039803:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012db2fb80 x1830967465688832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 504/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.039818:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2fb80 with x1830967465688832 ext(3145728->4194303) 00002000:00010000:2.0:1746147253.039823:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2fb80 00000100:00100000:0.0:1746147253.041404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.041451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.041460:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465689344 00000100:00100000:3.0:1746147253.041468:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465689344 00000100:00100000:1.0:1746147253.041492:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465689472 00000100:00100000:1.0:1746147253.041497:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465689472 00000100:00100000:3.0:1746147253.041557:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4769 00000100:00100000:1.0:1746147253.041558:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 772 00000100:00100000:1.0:1746147253.041564:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1956:x1830967465689472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147253.041565:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+329:31808:x1830967465689344:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:1.0:1746147253.041575:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.041595:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0b19 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f9 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.041620:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147253.041627:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.041658:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1956:x1830967465689472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.041663:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 772 00000100:00100000:3.0:1746147253.041706:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:31808:x1830967465689344:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 141us (308us total) trans 8589945418 rc 0/0 00000100:00100000:3.0:1746147253.041715:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4769 00000100:00100000:0.0:1746147253.049432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.049479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.049550:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465689984 00000100:00100000:2.0:1746147253.049557:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465689984 00000100:00100000:2.0:1746147253.049593:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11424 00000100:00100000:2.0:1746147253.049598:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:31811:x1830967465689984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.049615:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.049629:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207600/0xb4b2209fbdad0b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec800 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.049710:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049721:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049730:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049739:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049745:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049749:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147253.049820:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465689728 00000100:00100000:3.0:1746147253.049825:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465689728 00002000:00100000:3.0:1746147253.049850:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d49bb80 x1830967465689728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.049859:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49bb80 with x1830967465689728 ext(4194304->4976639) 00002000:00010000:3.0:1746147253.049864:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49bb80 00000100:00100000:3.0:1746147253.049883:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7334 00000100:00100000:3.0:1746147253.049888:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465689728:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147253.049963:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207c00/0xb4b2209fbdad0b3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049975:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207c00/0xb4b2209fbdad0b3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.049981:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207c00/0xb4b2209fbdad0b3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147253.049988:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.050054:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050060:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050065:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050070:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b207800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.050073:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050078:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050085:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.050088:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.050091:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050095:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207800/0xb4b2209fbdad0b2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050119:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050128:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050133:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050145:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b207a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.050147:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050154:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050161:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13800) 00010000:00010000:2.0:1746147253.050163:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.050165:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050169:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207a00/0xb4b2209fbdad0b35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.050198:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207600/0xb4b2209fbdad0b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec800 expref: 331 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.050207:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207c00/0xb4b2209fbdad0b3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec800 expref: 330 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.050240:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.050243:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147253.050246:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b207c00, rc 0) 00000100:00100000:2.0:1746147253.050281:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:31811:x1830967465689984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 682us (801us total) trans 8589945419 rc 0/0 00000100:00100000:2.0:1746147253.050288:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11424 00000100:00100000:0.0:1746147253.055736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.057907:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465690112 00000100:00100000:1.0:1746147253.057915:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465690112 00000100:00100000:1.0:1746147253.057972:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 773 00000100:00100000:1.0:1746147253.057978:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1956:x1830967465690112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.057989:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.058008:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b207c00/0xb4b2209fbdad0b3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec800 expref: 330 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.058028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147253.058029:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147253.058032:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.058066:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1956:x1830967465690112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.058072:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 773 00000100:00100000:3.0:1746147253.058075:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465690240 00000100:00100000:3.0:1746147253.058080:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465690240 00000100:00100000:3.0:1746147253.058102:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15500 00000100:00100000:3.0:1746147253.058108:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465690240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.058118:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.058129:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec807 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.058160:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.058162:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.058168:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 36 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.058271:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 36 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.058281:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72800, rc 0) 00000100:00100000:3.0:1746147253.058316:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465690240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 208us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.058321:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15500 00000100:00100000:0.0:1746147253.058754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.058880:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465690368 00000100:00100000:3.0:1746147253.058883:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465690368 00000100:00100000:3.0:1746147253.058968:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15501 00000100:00100000:3.0:1746147253.058974:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465690368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.058981:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.058988:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0b51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec80e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.059018:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467028352:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.059262:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.060298:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465689728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10406us (10868us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147253.060306:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7334 00002000:00100000:3.0:1746147253.060314:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d49bb80 x1830967465689728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.060322:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49bb80 with x1830967465689728 ext(4194304->4976639) 00002000:00010000:3.0:1746147253.060325:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49bb80 00002000:00010000:3.0:1746147253.064168:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147251 -> 1746147252 00002000:00010000:3.0:1746147253.064173:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147251 -> 1746147252 00002000:00010000:3.0:1746147253.064175:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147251 -> 1746147252 00000100:00100000:3.0:1746147253.064192:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467028352:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.064215:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0b51 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec80e expref: 37 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.064225:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0b51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec80e expref: 37 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.064246:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73400, rc 0) 00000100:00100000:3.0:1746147253.064300:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465690368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5324us (5546us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.064314:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15501 00000100:00100000:0.0:1746147253.069233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.069315:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465690624 00000100:00100000:3.0:1746147253.069326:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465690624 00000100:00100000:3.0:1746147253.069382:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4770 00000100:00100000:3.0:1746147253.069388:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+36:31802:x1830967465690624:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147253.069592:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+37:31802:x1830967465690624:12345-192.168.203.36@tcp:35:cat.0 Request processed in 203us (371us total) trans 8589945420 rc 0/0 00000100:00100000:3.0:1746147253.069854:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4770 00000100:00100000:0.0:1746147253.075066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.075164:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465690880 00000100:00100000:3.0:1746147253.075175:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465690880 00002000:00100000:3.0:1746147253.075217:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a5a0c380 x1830967465690880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.075225:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c380 with x1830967465690880 ext(1048576->2097151) 00002000:00010000:3.0:1746147253.075230:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c380 00000100:00100000:3.0:1746147253.075265:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7335 00000100:00100000:3.0:1746147253.075271:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465690880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.087759:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465690880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12477us (12693us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.087772:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7335 00002000:00100000:3.0:1746147253.087784:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a5a0c380 x1830967465690880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.087801:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c380 with x1830967465690880 ext(1048576->2097151) 00002000:00010000:3.0:1746147253.087807:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c380 00000100:00100000:0.0:1746147253.097566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.097879:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465691008 00000100:00100000:3.0:1746147253.097890:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465691008 00000100:00100000:3.0:1746147253.098023:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15502 00000100:00100000:3.0:1746147253.098032:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:31811:x1830967465691008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.098053:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.098071:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec815 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.098101:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.098109:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.098110:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.098376:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 37 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.098410:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.098422:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 17 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.098438:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467028480:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.098736:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.100315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.100400:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467028480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.100425:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 37 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.100438:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73600, rc 0) 00000100:00100000:3.0:1746147253.100488:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:31811:x1830967465691008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2458us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.100496:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15502 00000100:00100000:2.0:1746147253.100648:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465691136 00000100:00100000:2.0:1746147253.100655:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465691136 00002000:00100000:2.0:1746147253.100690:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3686400->3706879) req@ffff8800a5a0d880 x1830967465691136/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.100699:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967465691136 ext(3686400->3706879) 00010000:00010000:2.0:1746147253.100706:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 18 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.100717:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 18 pid: 8478 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.100723:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5a0d880 00000100:00100000:2.0:1746147253.100739:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2521 00000100:00100000:2.0:1746147253.100746:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967465691136:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147253.103241:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465691136:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2487us (2924us total) trans 17179874003 rc 0/0 00000100:00100000:2.0:1746147253.103253:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2521 00002000:00100000:2.0:1746147253.103264:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3686400->3706879) req@ffff8800a5a0d880 x1830967465691136/t17179874003(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.103272:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967465691136 ext(3686400->3706879) 00010000:00010000:2.0:1746147253.103282:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 20 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.103300:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 20 pid: 8478 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.103306:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5a0d880 00000100:00100000:0.0:1746147253.109527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.109596:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465691264 00000100:00100000:1.0:1746147253.109604:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465691264 00010000:00010000:1.0:1746147253.109637:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 20 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.109666:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7871 00000100:00100000:1.0:1746147253.109672:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465691264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.109684:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.109700:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 20 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.109710:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 20 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.109733:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72400/0xb4b2209fbdad0afd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3686400->3706879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7f2 expref: 20 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.109762:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.109764:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.109772:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.109779:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.109811:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.109823:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467028608:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147253.109913:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147253.115293:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467028608:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147253.115316:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.115361:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967465691264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5688us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.115374:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7871 00000100:00100000:0.0:1746147253.117471:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.117571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.118034:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465691520 00000100:00100000:3.0:1746147253.118044:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465691520 00002000:00100000:3.0:1746147253.118090:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5a0c000 x1830967465691520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.118100:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967465691520 ext(2097152->3145727) 00002000:00010000:3.0:1746147253.118104:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c000 00000100:00100000:3.0:1746147253.118132:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465691776 00000100:00100000:3.0:1746147253.118147:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465691776 00002000:00100000:3.0:1746147253.118159:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a5a0ca80 x1830967465691776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.118165:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ca80 with x1830967465691776 ext(3145728->4194303) 00002000:00010000:3.0:1746147253.118168:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ca80 00000100:00100000:3.0:1746147253.118180:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7336 00000100:00100000:3.0:1746147253.118187:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967465691520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147253.118375:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7337 00000100:00100000:1.0:1746147253.118381:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967465691776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.130171:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967465691520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11973us (12698us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.130184:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7336 00002000:00100000:3.0:1746147253.130197:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5a0c000 x1830967465691520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.130207:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967465691520 ext(2097152->3145727) 00002000:00010000:3.0:1746147253.130213:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c000 00000100:00100000:1.0:1746147253.132293:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465691776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13901us (14712us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.132305:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7337 00002000:00100000:1.0:1746147253.132316:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a5a0ca80 x1830967465691776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.132326:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ca80 with x1830967465691776 ext(3145728->4194303) 00002000:00010000:1.0:1746147253.132331:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ca80 00000100:00100000:0.0:1746147253.139658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.139702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.139836:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465692032 00000100:00100000:1.0:1746147253.139845:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465692032 00002000:00100000:1.0:1746147253.139885:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8801307edf80 x1830967465692032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.139892:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307edf80 with x1830967465692032 ext(4194304->4976639) 00002000:00010000:1.0:1746147253.139897:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307edf80 00000100:00100000:1.0:1746147253.139925:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7338 00000100:00100000:1.0:1746147253.139929:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465692032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.140026:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465692160 00000100:00100000:3.0:1746147253.140030:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465692160 00000100:00100000:3.0:1746147253.140062:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15503 00000100:00100000:3.0:1746147253.140066:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31808:x1830967465692160:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.140076:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.140091:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec81c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.140115:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.140123:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.140128:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.140129:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.140132:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1658880->2097151] (req 1658880->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.140178:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.140189:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 25 pid: 6881 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.140199:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467028736:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.140281:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.140288:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.140295:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467028864:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.140309:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.143427:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467028736:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.143439:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467028864:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.143466:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1658880->2097151] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.143484:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73c00, rc 0) 00000100:00100000:3.0:1746147253.143844:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31808:x1830967465692160:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3774us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.143857:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15503 00000100:00100000:0.0:1746147253.144378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.144497:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465692288 00000100:00100000:1.0:1746147253.144504:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465692288 00010000:00010000:1.0:1746147253.144533:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.144586:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7872 00000100:00100000:2.0:1746147253.144595:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465692288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.144608:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.144629:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.144638:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.144661:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0a86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7b3 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.144688:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.144712:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465692288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.144717:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7872 00000100:00100000:1.0:1746147253.145470:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465692032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5537us (5818us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147253.145479:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7338 00002000:00100000:1.0:1746147253.145489:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8801307edf80 x1830967465692032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.145498:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307edf80 with x1830967465692032 ext(4194304->4976639) 00002000:00010000:1.0:1746147253.145501:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307edf80 00000100:00100000:1.0:1746147253.146184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.146275:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465692416 00000100:00100000:2.0:1746147253.146281:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465692416 00010000:00010000:2.0:1746147253.146317:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 26 pid: 6881 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.146346:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7873 00000100:00100000:2.0:1746147253.146352:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465692416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.146364:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.146380:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 26 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.146391:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 26 pid: 6881 timeout: 740 lvb_type: 1 00000100:00080000:0.0:1746147253.146407:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746147253.146419:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b077200/0xb4b2209fbdad0ac5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7cf expref: 26 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.146432:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.146437:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.146444:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.146454:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.146484:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.146495:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467028992:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.146620:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.147925:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467028992:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147253.147986:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.148047:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465692416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1694us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.148056:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7873 00000100:00100000:0.0:1746147253.148329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.148480:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465692672 00000100:00100000:2.0:1746147253.148485:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465692672 00002000:00100000:2.0:1746147253.148514:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1658880->1662975) req@ffff8801307ee300 x1830967465692672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.148522:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ee300 with x1830967465692672 ext(1658880->1662975) 00002000:00010000:2.0:1746147253.148526:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ee300 00000100:00100000:2.0:1746147253.148551:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7339 00000100:00100000:2.0:1746147253.148557:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465692672:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147253.148685:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465692672:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 128us (356us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147253.148690:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7339 00002000:00100000:2.0:1746147253.148695:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1658880->1662975) req@ffff8801307ee300 x1830967465692672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.148701:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ee300 with x1830967465692672 ext(1658880->1662975) 00002000:00010000:2.0:1746147253.148704:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ee300 00000100:00100000:0.0:1746147253.150766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.150972:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465692928 00000100:00100000:3.0:1746147253.150979:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465692928 00000100:00100000:3.0:1746147253.151017:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4771 00000100:00100000:3.0:1746147253.151024:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+329:31811:x1830967465692928:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147253.153119:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:31811:x1830967465692928:12345-192.168.203.36@tcp:35:cat.0 Request processed in 2091us (2554us total) trans 8589945421 rc 0/0 00000100:00100000:3.0:1746147253.153128:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4771 00000100:00100000:0.0:1746147253.153506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.153577:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465693056 00000100:00100000:3.0:1746147253.153582:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465693056 00000100:00100000:3.0:1746147253.153606:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15504 00000100:00100000:3.0:1746147253.153612:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31808:x1830967465693056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.153623:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.153636:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec823 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.153658:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.153666:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.153672:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.153673:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.153677:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.153704:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.153715:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 24 pid: 6881 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.153725:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467029120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.153798:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.153805:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.153813:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467029248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.154231:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.156992:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467029248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.157762:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467029120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.157794:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.157810:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72e00, rc 0) 00000100:00100000:3.0:1746147253.157866:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31808:x1830967465693056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4253us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.157878:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15504 00000100:00100000:0.0:1746147253.158461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.158524:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465693184 00000100:00100000:2.0:1746147253.158532:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465693184 00010000:00010000:2.0:1746147253.158563:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.158603:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7874 00000100:00100000:2.0:1746147253.158610:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465693184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.158623:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.158642:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.158651:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.158667:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d98c000/0xb4b2209fbdad0a94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7c1 expref: 26 pid: 6881 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.158691:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.158733:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465693184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.158739:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7874 00000100:00100000:1.0:1746147253.160173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.160230:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465693312 00000100:00100000:2.0:1746147253.160237:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465693312 00010000:00010000:2.0:1746147253.160258:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 25 pid: 6881 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.160290:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7875 00000100:00100000:2.0:1746147253.160297:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465693312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.160305:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.160318:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 25 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.160326:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 25 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.160339:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0abe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7d6 expref: 25 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.160348:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.160350:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.160355:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.160362:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.160386:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.160395:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467029376:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.160475:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.163671:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467029376:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147253.163694:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.163739:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465693312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3442us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.163749:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7875 00000100:00100000:2.0:1746147253.164688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.164745:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465693568 00000100:00100000:0.0:1746147253.164751:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465693568 00002000:00100000:0.0:1746147253.164786:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1392640->1396735) req@ffff880090509180 x1830967465693568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.164795:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509180 with x1830967465693568 ext(1392640->1396735) 00002000:00010000:0.0:1746147253.164799:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509180 00000100:00100000:0.0:1746147253.164812:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7340 00000100:00100000:0.0:1746147253.164818:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465693568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.164990:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465693568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 171us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147253.164995:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7340 00002000:00100000:0.0:1746147253.165015:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1392640->1396735) req@ffff880090509180 x1830967465693568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.165023:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509180 with x1830967465693568 ext(1392640->1396735) 00002000:00010000:0.0:1746147253.165026:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509180 00000100:00100000:0.0:1746147253.184086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.184333:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465693824 00000100:00100000:2.0:1746147253.184346:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465693824 00000100:00100000:2.0:1746147253.184488:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11425 00000100:00100000:2.0:1746147253.184495:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+37:31817:x1830967465693824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.184520:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.184546:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4600/0xb4b2209fbdad0b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec82a expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.184661:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184671:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184678:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184687:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184690:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184693:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184791:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0b82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184797:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184800:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147253.184806:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.184867:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184874:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184878:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184881:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800952c4200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.184884:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184887:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184893:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.184895:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.184898:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184901:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4200/0xb4b2209fbdad0b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184918:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184923:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184927:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184930:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800952c5400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.184933:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184956:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184961:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13300) 00010000:00010000:2.0:1746147253.184963:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.184965:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.184969:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.185003:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c4600/0xb4b2209fbdad0b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec82a expref: 40 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.185012:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec82a expref: 39 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.185018:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.185019:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147253.185022:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50da00, rc 0) 00000100:00100000:2.0:1746147253.185080:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+39:31817:x1830967465693824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 584us (1003us total) trans 8589945422 rc 0/0 00000100:00100000:2.0:1746147253.185086:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11425 00000100:00100000:0.0:1746147253.187798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.187857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.187859:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465693952 00000100:00100000:3.0:1746147253.187879:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465693952 00000100:00100000:2.0:1746147253.187927:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694080 00000100:00100000:2.0:1746147253.187929:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694080 00000100:00100000:2.0:1746147253.187985:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 774 00000100:00100000:2.0:1746147253.187989:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+39:1956:x1830967465694080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147253.188038:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15505 00000100:00100000:3.0:1746147253.188042:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465693952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.188063:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.188076:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0b90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec831 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.188119:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467029504:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.188211:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.188384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.188416:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694208 00000100:00100000:1.0:1746147253.188424:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694208 00010000:00010000:2.0:1746147253.188426:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147253.188446:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15506 00000100:00100000:1.0:1746147253.188451:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465694208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.188457:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.188464:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0b97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec838 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.188488:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467029632:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147253.188523:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1000 going to sleep for 11 seconds 00010000:00010000:2.0:1746147253.188592:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0b82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec82a expref: 39 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.188610:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.188614:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.188810:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+38:1956:x1830967465694080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 817us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.188818:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 774 00000100:00100000:0.0:1746147253.188954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.189288:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694336 00000100:00100000:2.0:1746147253.189295:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694336 00000100:00100000:2.0:1746147253.189324:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15507 00000100:00100000:2.0:1746147253.189329:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465694336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.189342:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.189353:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec83f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.189368:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.189369:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.189375:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 20 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.189386:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 20 pid: 21080 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147253.189653:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147250 -> 1746147252 00000100:00100000:3.0:1746147253.189673:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467029504:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.189694:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0b90 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec831 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.189703:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0b90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec831 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.189715:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72a00, rc 0) 00000100:00100000:3.0:1746147253.189740:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465693952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1697us (1952us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.189746:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15505 00010000:00010000:2.0:1746147253.189994:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c5c00, rc 0) 00000100:00100000:2.0:1746147253.190193:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465694336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 861us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.190199:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15507 00000100:00100000:1.0:1746147253.190586:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467029632:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147253.190603:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0b97 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec838 expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.190612:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0b97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec838 expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.190622:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd200, rc 0) 00000100:00100000:1.0:1746147253.190652:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465694208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2200us (2268us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147253.190658:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15506 00000100:00100000:0.0:1746147253.196339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.196407:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694464 00000100:00100000:1.0:1746147253.196421:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694464 00000100:00100000:1.0:1746147253.196476:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15508 00000100:00100000:1.0:1746147253.196483:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31817:x1830967465694464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.196502:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.196519:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec846 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.196550:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.196557:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147253.196559:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147253.196563:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.196593:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.196605:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 24 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.196616:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467029760:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.196773:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147253.198775:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467029760:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147253.198800:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.198814:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd400, rc 0) 00000100:00100000:1.0:1746147253.198906:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31817:x1830967465694464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2422us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.198913:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15508 00000100:00100000:0.0:1746147253.200783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.200913:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694592 00000100:00100000:2.0:1746147253.200923:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694592 00002000:00100000:2.0:1746147253.201197:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1658880->2097151) req@ffff88012ececa80 x1830967465694592/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.201207:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ececa80 with x1830967465694592 ext(1658880->2097151) 00010000:00010000:2.0:1746147253.201216:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 25 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.201229:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 25 pid: 8478 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.201236:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ececa80 00000100:00100000:2.0:1746147253.201255:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2522 00000100:00100000:2.0:1746147253.201263:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465694592:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147253.206071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.206158:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694720 00000100:00100000:3.0:1746147253.206170:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694720 00000100:00100000:3.0:1746147253.206243:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11426 00000100:00100000:3.0:1746147253.206252:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:31818:x1830967465694720:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147253.206278:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.206295:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec84d expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.206356:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206368:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206380:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206393:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206398:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206404:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206507:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206517:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.206524:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.206554:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.206564:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 329 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.206576:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467029888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.206665:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.209712:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465694592:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8443us (8930us total) trans 21474841361 rc 0/0 00000100:00100000:3.0:1746147253.209723:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2522 00002000:00100000:3.0:1746147253.209733:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1658880->2097151) req@ffff88012ececa80 x1830967465694592/t21474841361(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.209741:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ececa80 with x1830967465694592 ext(1658880->2097151) 00010000:00010000:3.0:1746147253.209750:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 27 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.209761:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 27 pid: 8478 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.209767:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ececa80 00000100:00100000:0.0:1746147253.211660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.211735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.211819:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465694848 00000100:00100000:2.0:1746147253.211830:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465694848 00010000:00010000:2.0:1746147253.211856:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 27 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.211879:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7876 00000100:00100000:2.0:1746147253.211886:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465694848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.211896:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.211912:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 27 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.211922:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 27 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.211960:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0b5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec81c expref: 27 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.211986:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.211987:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.211993:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.212000:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.212027:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.212037:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467030016:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.212105:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.212164:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465695104 00000100:00100000:3.0:1746147253.212169:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465695104 00000100:00100000:3.0:1746147253.212200:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4772 00000100:00100000:3.0:1746147253.212205:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:7641:x1830967465695104:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147253.212747:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+331:7641:x1830967465695104:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 540us (1011us total) trans 8589945423 rc 0/0 00000100:00100000:3.0:1746147253.212753:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4772 00000100:00100000:3.0:1746147253.212786:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467029888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.212798:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147253.215234:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467030016:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147253.215361:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.215526:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465694848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3639us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.215535:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7876 00000100:00100000:0.0:1746147253.217564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.217611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.217683:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465695488 00000100:00100000:3.0:1746147253.217726:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465695488 00000100:00100000:2.0:1746147253.217743:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465695232 00000100:00100000:2.0:1746147253.217747:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465695232 00002000:00100000:3.0:1746147253.217759:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a044aa00 x1830967465695488/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.217768:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044aa00 with x1830967465695488 ext(1048576->2097151) 00010000:00010000:2.0:1746147253.217768:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 331 pid: 14049 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.217772:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044aa00 00000100:00100000:3.0:1746147253.217796:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7341 00000100:00100000:3.0:1746147253.217801:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465695488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147253.217803:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7877 00000100:00100000:2.0:1746147253.217808:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+331:1956:x1830967465695232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.217817:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.217823:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 331 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.217833:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 331 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.217848:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e1fc00/0xb4b2209fbdad0a1d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec789 expref: 331 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.217859:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.217863:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.217871:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.217876:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.217903:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.217934:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1956:x1830967465695232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.217957:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7877 00010000:00010000:3.0:1746147253.218848:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218856:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147253.218890:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147253.218894:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147253.218907:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218918:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218926:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218932:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218954:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218959:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d72400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147253.218962:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218968:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218976:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147253.218979:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147253.218982:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218986:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.218997:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219002:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219007:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219011:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147253.219013:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219017:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219022:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f137500) 00010000:00010000:3.0:1746147253.219024:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147253.219026:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219030:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0bba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.219062:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.219073:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.219078:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.219079:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147253.219081:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73200, rc 0) 00000100:00100000:3.0:1746147253.219122:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:31818:x1830967465694720:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 12871us (13057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.219129:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11426 00000100:00100000:2.0:1746147253.230385:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.230406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.230439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.230452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.231674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.231701:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465695744 00000100:00100000:1.0:1746147253.231709:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465695744 00000100:00100000:3.0:1746147253.231718:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465695616 00000100:00100000:3.0:1746147253.231721:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465695616 00000100:00100000:3.0:1746147253.233383:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465696000 00000100:00100000:1.0:1746147253.233383:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465695872 00000100:00100000:3.0:1746147253.233390:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465696000 00000100:00100000:1.0:1746147253.233390:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465695872 00000100:00100000:3.0:1746147253.233409:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465696128 00000100:00100000:3.0:1746147253.233411:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465696128 00000100:00100000:1.0:1746147253.233420:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15509 00000100:00100000:1.0:1746147253.233427:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465695616:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147253.233442:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147253.233446:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15510 00000100:00100000:3.0:1746147253.233451:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465695744:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147253.233455:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec854 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.233457:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.233464:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec85b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.233473:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.233473:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.233474:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.233474:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.233481:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.233481:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.233492:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.233492:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.233501:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72a00, rc 0) 00010000:00010000:1.0:1746147253.233501:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bda00, rc 0) 00000100:00100000:1.0:1746147253.233538:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465695616:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 112us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.233544:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15509 00000100:00100000:3.0:1746147253.233548:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465695744:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 97us (3172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.233553:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15510 00000100:00100000:3.0:1746147253.233562:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15511 00000100:00100000:1.0:1746147253.233564:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15512 00000100:00100000:3.0:1746147253.233566:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465696000:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147253.233568:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465695872:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147253.233571:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.233571:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.233577:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec869 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.233577:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0bdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec862 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.233588:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.233589:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.233593:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.233599:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.233605:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72200, rc 0) 00000100:00100000:1.0:1746147253.233605:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467030144:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.233617:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465696000:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 51us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.233621:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15511 00000100:00100000:3.0:1746147253.233629:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15513 00000100:00100000:3.0:1746147253.233633:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465696128:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147253.233637:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.233641:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec870 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.233642:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1000 going to sleep for 11 seconds 00010000:00010000:3.0:1746147253.233649:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.233650:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.233653:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.233660:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.233670:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73e00, rc 0) 00000100:00100000:3.0:1746147253.233682:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465696128:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 48us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.233685:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15513 00000100:00100000:1.0:1746147253.234355:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465695488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16552us (16742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.234362:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7341 00002000:00100000:1.0:1746147253.234369:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a044aa00 x1830967465695488/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.234377:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044aa00 with x1830967465695488 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.234381:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044aa00 00000100:00100000:2.0:1746147253.236145:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467030144:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.236170:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0bdd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec862 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.236182:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0bdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec862 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.236205:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd800, rc 0) 00000100:00100000:2.0:1746147253.236233:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465695872:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2664us (5779us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147253.236240:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15512 00000100:00100000:0.0:1746147253.243777:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.243820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.243903:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465696768 00000100:00100000:3.0:1746147253.244001:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465696768 00000100:00100000:3.0:1746147253.244049:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11427 00000100:00100000:3.0:1746147253.244056:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:31818:x1830967465696768:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147253.244071:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147253.244104:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465696256 00000100:00100000:2.0:1746147253.244107:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465696256 00000100:00100000:2.0:1746147253.244129:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15514 00000100:00100000:2.0:1746147253.244143:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31817:x1830967465696256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.244150:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.244164:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec877 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.244188:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.244194:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147253.244196:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147253.244200:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.244225:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.244237:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 25 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.244247:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467030272:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.244319:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00010000:00010000:3.0:1746147253.244508:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec885 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.244574:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.244585:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.244590:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.244603:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.244610:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 16 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.244620:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467030400:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.244643:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.246679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.246825:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465696512 00000100:00100000:1.0:1746147253.246831:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465696512 00000100:00100000:1.0:1746147253.246869:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11428 00000100:00100000:1.0:1746147253.246876:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+38:31820:x1830967465696512:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147253.246894:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.246904:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad0c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec87e expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.247008:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247018:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247026:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247035:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247039:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247044:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247119:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247127:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247132:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147253.247150:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147253.247216:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247222:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247231:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247235:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bca00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147253.247238:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247243:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247251:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147253.247254:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147253.247256:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247261:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad0c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247273:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247277:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247282:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247285:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bc800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147253.247287:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247291:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247299:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98fb00) 00010000:00010000:1.0:1746147253.247301:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147253.247303:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247307:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc800/0xb4b2209fbdad0c0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147253.247336:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad0c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec87e expref: 41 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.247345:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec87e expref: 40 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.247350:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147253.247352:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147253.247354:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bc400, rc 0) 00000100:00100000:1.0:1746147253.247387:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+40:31820:x1830967465696512:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 512us (712us total) trans 8589945424 rc 0/0 00000100:00100000:1.0:1746147253.247393:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11428 00000100:00100000:3.0:1746147253.247626:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467030400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.247639:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147253.247797:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467030272:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.247813:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.247824:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c5400, rc 0) 00000100:00100000:2.0:1746147253.247844:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31817:x1830967465696256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3710us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.247849:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15514 00000100:00100000:0.0:1746147253.247922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.247964:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465696896 00000100:00100000:2.0:1746147253.247967:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465696896 00010000:00010000:2.0:1746147253.247983:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 17 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.248009:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7878 00000100:00100000:2.0:1746147253.248014:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465696896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.248026:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.248030:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 17 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.248037:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 17 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.248048:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73200/0xb4b2209fbdad0bc1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec84d expref: 17 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.248062:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.248065:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.248072:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.248077:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.248088:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.248106:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465696896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.248112:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7878 00010000:00010000:3.0:1746147253.248237:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.248243:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147253.248252:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147253.248310:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec885 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.248323:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec885 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.248328:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.248330:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147253.248331:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72c00, rc 0) 00000100:00100000:3.0:1746147253.248347:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31818:x1830967465696768:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4292us (4579us total) trans 8589945425 rc 0/0 00000100:00100000:3.0:1746147253.248352:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11427 00000100:00100000:0.0:1746147253.248403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.249093:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465697024 00000100:00100000:1.0:1746147253.249097:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465697024 00002000:00100000:1.0:1746147253.249119:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1396735) req@ffff88008f9fc380 x1830967465697024/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.249126:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc380 with x1830967465697024 ext(1048576->1396735) 00010000:00010000:1.0:1746147253.249131:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 26 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.249154:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 26 pid: 8478 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746147253.249159:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fc380 00000100:00100000:1.0:1746147253.249181:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2523 00000100:00100000:1.0:1746147253.249186:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465697024:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147253.250456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.250834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.250958:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465697408 00000100:00100000:3.0:1746147253.250964:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465697408 00000100:00100000:3.0:1746147253.250989:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11429 00000100:00100000:3.0:1746147253.250994:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31818:x1830967465697408:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147253.251006:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.251009:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147253.251024:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0bf9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec885 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.251036:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.251039:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147253.251047:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72600/0xb4b2209fbdad0c2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec88c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.251103:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251111:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251117:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251124:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251128:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251133:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251146:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147253.251149:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251155:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251160:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.251162:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147253.251164:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251168:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73000/0xb4b2209fbdad0c31 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.251182:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72600/0xb4b2209fbdad0c2a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec88c expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.251188:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72600/0xb4b2209fbdad0c2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec88c expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.251194:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72600, rc 0) 00000100:00100000:3.0:1746147253.251216:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:31818:x1830967465697408:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 223us (383us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.251221:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11429 00000100:00100000:2.0:1746147253.251556:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465697152 00000100:00100000:2.0:1746147253.251560:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465697152 00000100:00100000:2.0:1746147253.251596:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 775 00000100:00100000:2.0:1746147253.251605:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+40:1958:x1830967465697152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.251612:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.251622:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c15 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec87e expref: 40 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.251630:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.251632:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.251650:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+39:1958:x1830967465697152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.251655:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 775 00000100:00100000:0.0:1746147253.257384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.257463:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465697664 00000100:00100000:3.0:1746147253.257470:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465697664 00000100:00100000:1.0:1746147253.258782:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465697024:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9592us (10375us total) trans 21474841362 rc 0/0 00000100:00100000:1.0:1746147253.258792:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2523 00002000:00100000:1.0:1746147253.258800:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1396735) req@ffff88008f9fc380 x1830967465697024/t21474841362(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.258809:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc380 with x1830967465697024 ext(1048576->1396735) 00010000:00010000:1.0:1746147253.258817:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 28 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.258992:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4773 00000100:00100000:3.0:1746147253.259000:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:31818:x1830967465697664:12345-192.168.203.36@tcp:35:mirror_io.0 00010000:00010000:1.0:1746147253.259000:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 28 pid: 8478 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746147253.259008:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fc380 00000100:00100000:3.0:1746147253.259124:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31818:x1830967465697664:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 125us (1748us total) trans 8589945426 rc 0/0 00000100:00100000:3.0:1746147253.259130:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4773 00000100:00100000:1.0:1746147253.262746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.262854:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465697792 00000100:00100000:3.0:1746147253.262862:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465697792 00010000:00010000:3.0:1746147253.262887:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 28 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.262907:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7879 00000100:00100000:3.0:1746147253.262912:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465697792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.262957:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.262975:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 28 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.262985:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 28 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.263001:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d72e00/0xb4b2209fbdad0b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec823 expref: 28 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.263022:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.263023:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.263028:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.263036:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.263060:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.263224:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467030528:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147253.263295:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.265807:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467030528:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147253.265822:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.265865:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465697792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2951us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.265873:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7879 00000100:00100000:0.0:1746147253.273421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.273518:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698048 00000100:00100000:1.0:1746147253.273527:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698048 00002000:00100000:1.0:1746147253.273572:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008f9ff800 x1830967465698048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.273582:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff800 with x1830967465698048 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.273588:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ff800 00000100:00100000:1.0:1746147253.273608:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7342 00000100:00100000:1.0:1746147253.273615:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465698048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147253.284627:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465698048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11000us (11203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.284638:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7342 00002000:00100000:1.0:1746147253.284650:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008f9ff800 x1830967465698048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.284659:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff800 with x1830967465698048 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.284665:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ff800 00000100:00100000:0.0:1746147253.284747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.285277:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698176 00000100:00100000:3.0:1746147253.285287:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698176 00000100:00100000:3.0:1746147253.285347:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15515 00000100:00100000:3.0:1746147253.285354:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31820:x1830967465698176:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.285368:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.285384:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec893 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.285407:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.285414:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.285420:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.285430:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.285432:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.285434:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.285459:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.285468:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.285478:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467030656:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.286487:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.286498:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 7 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.286506:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467030784:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.286712:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.286721:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 36 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.286735:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467030912:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.286753:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.291159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.291326:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467030656:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.291482:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467030784:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.291491:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467030912:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.291520:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.291538:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73000, rc 0) 00000100:00100000:3.0:1746147253.291583:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31820:x1830967465698176:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6228us (6837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.291591:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15515 00000100:00100000:2.0:1746147253.291621:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698304 00000100:00100000:2.0:1746147253.291632:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698304 00010000:00010000:2.0:1746147253.291663:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.291696:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7880 00000100:00100000:2.0:1746147253.291701:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465698304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.291709:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.291727:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.291737:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.291756:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0b9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec83f expref: 21 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.291781:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.291826:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465698304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.291832:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7880 00000100:00100000:0.0:1746147253.294673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.294822:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698432 00000100:00100000:2.0:1746147253.294832:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698432 00010000:00010000:2.0:1746147253.294868:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 8 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.294908:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7881 00000100:00100000:2.0:1746147253.294916:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465698432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.294930:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.294978:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 8 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.295312:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 8 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.295334:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73e00/0xb4b2209fbdad0be4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec870 expref: 8 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.295445:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.295504:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465698432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 586us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.295512:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7881 00000100:00100000:2.0:1746147253.297992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.298071:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698560 00000100:00100000:3.0:1746147253.298079:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698560 00000100:00100000:3.0:1746147253.298117:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15516 00000100:00100000:3.0:1746147253.298123:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31817:x1830967465698560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.298301:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.298314:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec89a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.298334:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.298336:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.298342:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.298358:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.298366:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72e00, rc 0) 00000100:00100000:3.0:1746147253.298399:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31817:x1830967465698560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 277us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.298404:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15516 00000100:00100000:0.0:1746147253.298875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.299576:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698688 00000100:00100000:2.0:1746147253.299581:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698688 00010000:00010000:2.0:1746147253.299600:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 37 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.299629:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7882 00000100:00100000:2.0:1746147253.299635:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465698688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.299643:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.299667:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 37 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.299676:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 37 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.299691:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0b58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec815 expref: 37 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.299700:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.299701:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.299706:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.299712:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.299737:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.299747:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467031040:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.299803:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.303623:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467031040:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147253.303640:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.303690:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465698688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4053us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.303725:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7882 00000100:00100000:0.0:1746147253.304367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.304432:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465698816 00000100:00100000:3.0:1746147253.304436:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465698816 00000100:00100000:3.0:1746147253.304461:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15517 00000100:00100000:3.0:1746147253.304466:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31820:x1830967465698816:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.304480:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.304493:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8a1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.304514:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.304522:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 7 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.304534:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.304539:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.304541:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.304544:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3571711] (req 3145728->3571711) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.304564:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.304573:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.304583:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031168:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.305048:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 7 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.305056:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 7 pid: 6881 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.305065:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031296:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.305463:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.305476:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 26 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.305483:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.305511:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.307015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.307052:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465699072 00000100:00100000:1.0:1746147253.307058:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465699072 00002000:00100000:1.0:1746147253.307089:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012bfe1180 x1830967465699072/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.307097:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1180 with x1830967465699072 ext(2097152->3145727) 00002000:00010000:1.0:1746147253.307101:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe1180 00000100:00100000:1.0:1746147253.307117:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7343 00000100:00100000:1.0:1746147253.307123:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465699072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.307147:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.307156:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031296:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.307161:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031424:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.307179:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3571711] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.307190:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72400, rc 0) 00000100:00100000:3.0:1746147253.307225:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31820:x1830967465698816:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2759us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.307231:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15517 00000100:00100000:0.0:1746147253.308368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.308442:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465699200 00000100:00100000:3.0:1746147253.308447:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465699200 00010000:00010000:3.0:1746147253.308463:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 8 pid: 6881 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.308522:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7883 00000100:00100000:3.0:1746147253.308528:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465699200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.308537:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.308553:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 8 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746147253.308561:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 8 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746147253.308577:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682e00/0xb4b2209fbdad0944 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec720 expref: 8 pid: 6881 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746147253.308684:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.309023:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465699200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 493us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.309029:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7883 00000100:00100000:0.0:1746147253.309236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.309343:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465699328 00000100:00100000:3.0:1746147253.309347:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465699328 00010000:00010000:3.0:1746147253.309360:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.309378:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7884 00000100:00100000:3.0:1746147253.309383:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465699328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.309389:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.309398:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.309407:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.309422:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad08e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6ef expref: 27 pid: 21080 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.309430:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.309460:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465699328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.309465:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7884 00000100:00100000:0.0:1746147253.311846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.311919:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465699456 00000100:00100000:2.0:1746147253.311926:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465699456 00010000:00010000:2.0:1746147253.311970:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 27 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.312030:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7885 00000100:00100000:2.0:1746147253.312038:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465699456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.312052:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.312070:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 27 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.312080:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 27 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.312096:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fad200/0xb4b2209fbdad08b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec6be expref: 27 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.312126:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.312127:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.312195:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.312203:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.312228:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.312242:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467031552:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.312696:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147253.316648:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465699072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9518us (9629us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.316656:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7343 00002000:00100000:1.0:1746147253.316664:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012bfe1180 x1830967465699072/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.316669:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1180 with x1830967465699072 ext(2097152->3145727) 00002000:00010000:1.0:1746147253.316673:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe1180 00000100:00100000:2.0:1746147253.316736:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467031552:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147253.316748:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.316761:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465699456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4725us (4921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.316765:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7885 00000100:00100000:0.0:1746147253.320063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.321212:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465699712 00000100:00100000:1.0:1746147253.321223:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465699712 00002000:00100000:1.0:1746147253.321270:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (3567616->3571711) req@ffff88012bfe3480 x1830967465699712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.321280:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3480 with x1830967465699712 ext(3567616->3571711) 00002000:00010000:1.0:1746147253.321286:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3480 00000100:00100000:1.0:1746147253.321311:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7344 00000100:00100000:1.0:1746147253.321319:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465699712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147253.321507:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465699712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 188us (1452us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147253.321514:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7344 00002000:00100000:1.0:1746147253.321520:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x422:0x0] (3567616->3571711) req@ffff88012bfe3480 x1830967465699712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.321527:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3480 with x1830967465699712 ext(3567616->3571711) 00002000:00010000:1.0:1746147253.321530:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3480 00000100:00100000:0.0:1746147253.326818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.327315:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465699968 00000100:00100000:2.0:1746147253.327325:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465699968 00002000:00100000:2.0:1746147253.327513:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012bfe3b80 x1830967465699968/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.327524:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3b80 with x1830967465699968 ext(2097152->3145727) 00002000:00010000:2.0:1746147253.327530:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3b80 00000100:00100000:2.0:1746147253.327552:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7345 00000100:00100000:2.0:1746147253.327561:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465699968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.328456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.328529:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465700224 00000100:00100000:3.0:1746147253.328538:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465700224 00000100:00100000:3.0:1746147253.328579:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4774 00000100:00100000:3.0:1746147253.328584:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+39:31820:x1830967465700224:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147253.328784:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+40:31820:x1830967465700224:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 198us (330us total) trans 8589945427 rc 0/0 00000100:00100000:3.0:1746147253.328790:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4774 00000100:00100000:2.0:1746147253.340327:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465699968:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12757us (13508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.340339:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7345 00002000:00100000:2.0:1746147253.340351:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012bfe3b80 x1830967465699968/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.340365:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3b80 with x1830967465699968 ext(2097152->3145727) 00002000:00010000:2.0:1746147253.340371:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3b80 00000100:00100000:0.0:1746147253.346552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.346760:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465700352 00000100:00100000:3.0:1746147253.346769:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465700352 00000100:00100000:3.0:1746147253.346980:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15518 00000100:00100000:3.0:1746147253.346988:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31817:x1830967465700352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.347003:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.347018:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8a8 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.347042:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.347054:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.347056:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.347059:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.347082:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.347092:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 22 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.347102:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467031680:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.347514:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.350361:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467031680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.350386:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.350400:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73a00, rc 0) 00000100:00100000:3.0:1746147253.350445:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31817:x1830967465700352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3458us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.350453:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15518 00000100:00100000:0.0:1746147253.352073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.352152:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465700480 00000100:00100000:2.0:1746147253.352450:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465700480 00002000:00100000:2.0:1746147253.352500:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4149248->4194303) req@ffff88012c9f1f80 x1830967465700480/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.352511:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967465700480 ext(4149248->4194303) 00010000:00010000:2.0:1746147253.352521:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 22 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.352536:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 22 pid: 8481 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.352543:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f1f80 00000100:00100000:2.0:1746147253.352576:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2524 00000100:00100000:2.0:1746147253.352584:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465700480:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147253.357498:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465700480:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4904us (5424us total) trans 17179874004 rc 0/0 00000100:00100000:2.0:1746147253.357509:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2524 00002000:00100000:2.0:1746147253.357521:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4149248->4194303) req@ffff88012c9f1f80 x1830967465700480/t17179874004(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.357530:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967465700480 ext(4149248->4194303) 00010000:00010000:2.0:1746147253.357540:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 24 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.357554:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 24 pid: 8481 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.357567:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f1f80 00000100:00100000:0.0:1746147253.359503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.359612:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465700608 00000100:00100000:2.0:1746147253.359621:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465700608 00010000:00010000:2.0:1746147253.359649:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 24 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.359688:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7886 00000100:00100000:2.0:1746147253.359695:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465700608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.359710:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147253.359725:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147252 -> 1746147253 00002000:00010000:2.0:1746147253.359728:0:7119:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147252 -> 1746147253 00002000:00010000:2.0:1746147253.359730:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147252 -> 1746147253 00010000:00010000:2.0:1746147253.359734:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 24 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.359745:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 24 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.359767:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73000/0xb4b2209fbdad0c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [4149248->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec893 expref: 24 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.360850:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.360853:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.360863:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.360877:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.360912:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.360924:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467031808:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.361515:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.365488:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467031808:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147253.365514:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.365600:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465700608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5903us (6101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.365611:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7886 00000100:00100000:0.0:1746147253.368563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.368697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.368773:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465700864 00000100:00100000:2.0:1746147253.368784:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465701120 00000100:00100000:1.0:1746147253.368784:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465700864 00000100:00100000:2.0:1746147253.368791:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465701120 00002000:00100000:2.0:1746147253.368822:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3571712->4194303) req@ffff88012c9f3100 x1830967465701120/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.368824:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c9f0a80 x1830967465700864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.368831:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967465701120 ext(3571712->4194303) 00002000:00010000:2.0:1746147253.368835:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:2.0:1746147253.368871:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7346 00000100:00100000:2.0:1746147253.368877:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465701120:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:1.0:1746147253.369051:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0a80 with x1830967465700864 ext(3145728->4194303) 00002000:00010000:1.0:1746147253.369056:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0a80 00000100:00100000:1.0:1746147253.369084:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7347 00000100:00100000:1.0:1746147253.369090:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465700864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147253.376539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.376574:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465701376 00000100:00100000:2.0:1746147253.376582:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465701376 00000100:00100000:3.0:1746147253.378727:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11430 00000100:00100000:3.0:1746147253.378742:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:31825:x1830967465701376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.378765:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.378785:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0c54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8af expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.378905:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.378917:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.378930:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.378957:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.378962:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.378968:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379066:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379074:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379080:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147253.379088:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147253.379181:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379188:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379194:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379200:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147253.379203:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379208:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379218:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147253.379221:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147253.379225:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379230:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379245:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379249:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379254:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379258:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d72c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147253.379260:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379264:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379273:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4e9ad00) 00010000:00010000:3.0:1746147253.379275:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147253.379277:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379281:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.379312:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0c54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 333 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.379321:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 332 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.379327:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.379329:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147253.379331:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73600, rc 0) 00000100:00100000:3.0:1746147253.379396:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+332:31825:x1830967465701376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 660us (2867us total) trans 8589945428 rc 0/0 00000100:00100000:3.0:1746147253.379403:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11430 00000100:00100000:1.0:1746147253.382466:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465701120:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13578us (13758us total) trans 0 rc 622592/622592 00000100:00100000:1.0:1746147253.382477:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7346 00002000:00100000:1.0:1746147253.382490:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3571712->4194303) req@ffff88012c9f3100 x1830967465701120/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.382500:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967465701120 ext(3571712->4194303) 00002000:00010000:1.0:1746147253.382507:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:0.0:1746147253.384660:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465700864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15562us (16095us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147253.384672:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7347 00002000:00100000:0.0:1746147253.384684:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c9f0a80 x1830967465700864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.384694:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0a80 with x1830967465700864 ext(3145728->4194303) 00002000:00010000:0.0:1746147253.384699:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0a80 00000100:00100000:0.0:1746147253.385679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.385710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.385732:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465701504 00000100:00100000:0.0:1746147253.385732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.385741:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465701504 00000100:00100000:0.0:1746147253.385747:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465701760 00000100:00100000:1.0:1746147253.385748:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465701632 00000100:00100000:0.0:1746147253.385750:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465701760 00000100:00100000:1.0:1746147253.385752:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465701632 00000100:00100000:1.0:1746147253.385774:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15519 00000100:00100000:1.0:1746147253.385779:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465701632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.385791:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147253.385794:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15520 00000100:00100000:0.0:1746147253.385800:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465701760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.385804:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8bd expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.385806:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15521 00010000:00010000:0.0:1746147253.385808:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147253.385813:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465701504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147253.385818:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8c4 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.385820:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.385823:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.385825:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.385828:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8b6 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.385830:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.385831:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.385831:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.385836:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.385842:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.385843:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.385845:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.385845:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.385850:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.385853:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0c800, rc 0) 00010000:00010000:0.0:1746147253.385853:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5765400, rc 0) 00010000:00010000:3.0:1746147253.385859:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.385866:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d72c00, rc 0) 00000100:00100000:1.0:1746147253.385871:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465701632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 93us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.385875:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15519 00000100:00100000:3.0:1746147253.385884:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465701504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.385890:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15521 00000100:00100000:1.0:1746147253.385907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.385922:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465701888 00000100:00100000:3.0:1746147253.385925:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465701888 00000100:00100000:3.0:1746147253.386040:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15522 00000100:00100000:3.0:1746147253.386045:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465701888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.386051:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.386057:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8cb expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.386092:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031936:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147253.386301:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465701760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 499us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.386307:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15520 00000100:00100000:3.0:1746147253.386371:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00002000:00010000:3.0:1746147253.389761:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147251 -> 1746147253 00002000:00010000:3.0:1746147253.389768:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147251 -> 1746147253 00002000:00010000:3.0:1746147253.389769:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147251 -> 1746147253 00000100:00100000:3.0:1746147253.389791:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467031936:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.389821:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c8c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8cb expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.389833:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0c8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8cb expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.389847:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73c00, rc 0) 00000100:00100000:3.0:1746147253.389903:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465701888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3856us (3993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.389910:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15522 00000100:00100000:0.0:1746147253.391926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.392081:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465702144 00000100:00100000:2.0:1746147253.392092:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465702144 00000100:00100000:2.0:1746147253.392154:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11431 00000100:00100000:2.0:1746147253.392161:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+332:31827:x1830967465702144:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147253.392184:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.392203:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8d2 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.392508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.392582:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465702400 00000100:00100000:1.0:1746147253.392586:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465702400 00002000:00100000:1.0:1746147253.392614:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009ee5f100 x1830967465702400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.392623:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967465702400 ext(4194304->4976639) 00002000:00010000:1.0:1746147253.392629:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5f100 00000100:00100000:1.0:1746147253.392642:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7348 00000100:00100000:1.0:1746147253.392647:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465702400:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147253.393208:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.393224:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 333 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.393232:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.393262:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 333 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.393285:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 333 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.393297:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467032064:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.393390:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.399608:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467032064:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.399632:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147253.400494:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465702400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7843us (7982us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147253.400506:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7348 00002000:00100000:1.0:1746147253.400517:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009ee5f100 x1830967465702400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.400526:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967465702400 ext(4194304->4976639) 00002000:00010000:1.0:1746147253.400531:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5f100 00000100:00100000:0.0:1746147253.400664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.401273:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.401276:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465702528 00000100:00100000:3.0:1746147253.401284:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465702528 00000100:00100000:0.0:1746147253.401293:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465702784 00000100:00100000:0.0:1746147253.401297:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465702784 00010000:00010000:3.0:1746147253.401310:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 334 pid: 14049 timeout: 740 lvb_type: 0 00002000:00100000:0.0:1746147253.401320:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009ee5ea00 x1830967465702784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.401327:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ea00 with x1830967465702784 ext(1048576->2097151) 00002000:00010000:0.0:1746147253.401330:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5ea00 00000100:00100000:3.0:1746147253.401342:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7887 00000100:00100000:3.0:1746147253.401347:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1956:x1830967465702528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147253.401349:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7349 00000100:00100000:0.0:1746147253.401354:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465702784:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147253.401360:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.401364:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 334 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.401373:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 334 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.401391:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0c69 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8af expref: 334 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.401410:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.401414:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.401421:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.401425:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.401450:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.401468:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+333:1956:x1830967465702528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 122us (807us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147253.401469:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147253.401472:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7887 00010000:00010000:2.0:1746147253.401482:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147253.401502:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.401627:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc400/0xb4b2209fbdad0c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 334 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.401658:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 333 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.401666:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.401668:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147253.401671:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd800, rc 0) 00000100:00100000:2.0:1746147253.401733:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+333:31827:x1830967465702144:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9571us (9813us total) trans 8589945429 rc 0/0 00000100:00100000:2.0:1746147253.401740:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11431 00000100:00100000:2.0:1746147253.402208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.402271:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465703040 00000100:00100000:1.0:1746147253.402275:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465703040 00002000:00100000:1.0:1746147253.402292:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b50f480 x1830967465703040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.402300:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50f480 with x1830967465703040 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.402303:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50f480 00000100:00100000:1.0:1746147253.402313:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7350 00000100:00100000:1.0:1746147253.402317:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465703040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147253.408842:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465702784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7478us (7559us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.408854:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7349 00002000:00100000:2.0:1746147253.408863:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009ee5ea00 x1830967465702784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.408872:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ea00 with x1830967465702784 ext(1048576->2097151) 00002000:00010000:2.0:1746147253.408877:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5ea00 00000100:00100000:0.0:1746147253.409398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.409481:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465703296 00000100:00100000:2.0:1746147253.409487:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465703296 00000100:00100000:2.0:1746147253.409527:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4775 00000100:00100000:2.0:1746147253.409533:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+40:31817:x1830967465703296:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147253.410480:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+41:31817:x1830967465703296:12345-192.168.203.36@tcp:35:cat.0 Request processed in 945us (1081us total) trans 8589945430 rc 0/0 00000100:00100000:2.0:1746147253.410486:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4775 00000100:00100000:1.0:1746147253.412264:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465703040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9941us (10053us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.412272:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7350 00002000:00100000:1.0:1746147253.412280:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b50f480 x1830967465703040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.412288:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b50f480 with x1830967465703040 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.412292:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b50f480 00000100:00100000:0.0:1746147253.420724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.420832:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465703552 00000100:00100000:1.0:1746147253.420843:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465703552 00002000:00100000:1.0:1746147253.420888:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009ee5e680 x1830967465703552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.420898:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e680 with x1830967465703552 ext(2097152->3145727) 00002000:00010000:1.0:1746147253.420909:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5e680 00000100:00100000:2.0:1746147253.421013:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7351 00000100:00100000:2.0:1746147253.421030:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465703552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147253.433451:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465703552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12417us (12726us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.433464:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7351 00002000:00100000:2.0:1746147253.433477:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009ee5e680 x1830967465703552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.433486:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e680 with x1830967465703552 ext(2097152->3145727) 00002000:00010000:2.0:1746147253.433492:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5e680 00000100:00100000:0.0:1746147253.439722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.439903:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465703680 00000100:00100000:3.0:1746147253.439911:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465703680 00000100:00100000:3.0:1746147253.439974:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15523 00000100:00100000:3.0:1746147253.439981:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31825:x1830967465703680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.439996:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.440011:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8d9 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.440036:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.440042:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.440044:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.440047:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.440071:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.440081:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 25 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.440091:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467032192:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.440187:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.442468:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467032192:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.442492:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.442507:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50da00, rc 0) 00000100:00100000:3.0:1746147253.443149:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31825:x1830967465703680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3166us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.443158:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15523 00000100:00100000:0.0:1746147253.444391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.444468:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465703808 00000100:00100000:2.0:1746147253.444474:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465703808 00002000:00100000:2.0:1746147253.444507:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3571711) req@ffff88009ee5f480 x1830967465703808/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.444517:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f480 with x1830967465703808 ext(3145728->3571711) 00010000:00010000:2.0:1746147253.444526:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 26 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.444538:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 26 pid: 8481 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.444545:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5f480 00000100:00100000:2.0:1746147253.444887:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2525 00000100:00100000:2.0:1746147253.444894:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465703808:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147253.453626:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465703808:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8725us (9231us total) trans 21474841363 rc 0/0 00000100:00100000:2.0:1746147253.453637:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2525 00002000:00100000:2.0:1746147253.453647:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3571711) req@ffff88009ee5f480 x1830967465703808/t21474841363(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.453655:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f480 with x1830967465703808 ext(3145728->3571711) 00010000:00010000:2.0:1746147253.453662:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.453675:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.453681:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5f480 00000100:00100000:0.0:1746147253.459627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.459776:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704064 00000100:00100000:2.0:1746147253.459785:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704064 00000100:00100000:2.0:1746147253.459833:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11432 00000100:00100000:2.0:1746147253.459839:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+41:31830:x1830967465704064:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147253.459854:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.459866:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad0caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8e0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.459963:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.459971:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.459978:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.459985:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.459988:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.459991:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460056:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bde00/0xb4b2209fbdad0cc4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460062:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bde00/0xb4b2209fbdad0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460065:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bde00/0xb4b2209fbdad0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147253.460069:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.460129:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460141:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460150:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460154:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bdc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.460157:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460163:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460172:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.460174:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.460177:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460181:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0cb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460193:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460197:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460202:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460205:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bd200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.460207:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460212:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460221:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13800) 00010000:00010000:2.0:1746147253.460226:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.460228:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460232:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad0cbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.460259:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad0caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e0 expref: 44 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.460268:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bde00/0xb4b2209fbdad0cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e0 expref: 43 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.460272:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.460274:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147253.460276:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bde00, rc 0) 00000100:00100000:2.0:1746147253.460336:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+43:31830:x1830967465704064:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 496us (724us total) trans 8589945431 rc 0/0 00000100:00100000:2.0:1746147253.460341:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11432 00000100:00100000:0.0:1746147253.468371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.468433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.468497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.468617:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704320 00000100:00100000:2.0:1746147253.468627:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704320 00000100:00100000:2.0:1746147253.468677:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704448 00000100:00100000:2.0:1746147253.468680:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704448 00010000:00010000:2.0:1746147253.468695:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.468800:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704192 00000100:00100000:3.0:1746147253.468810:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704192 00000100:00100000:2.0:1746147253.468846:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7888 00000100:00100000:2.0:1746147253.468854:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465704448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.468867:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.468887:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.468899:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.468916:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d72400/0xb4b2209fbdad0c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a1 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.468932:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.468935:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.468974:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.468982:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.469012:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.469022:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467032320:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.469089:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.469107:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 776 00000100:00100000:2.0:1746147253.469113:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+43:1959:x1830967465704320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.469120:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.469145:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bde00/0xb4b2209fbdad0cc4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e0 expref: 43 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.469155:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.469158:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.469175:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+42:1959:x1830967465704320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.469179:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 776 00000100:00100000:3.0:1746147253.469227:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15524 00000100:00100000:3.0:1746147253.469236:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31830:x1830967465704192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.469258:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.469275:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8e7 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.469312:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.469322:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 6 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.469328:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.469334:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.469336:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.469339:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [1011712->1048575] (req 1011712->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.469370:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.469383:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 24 pid: 8478 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.469395:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467032448:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.469463:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 6 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.469473:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 6 pid: 8481 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.469486:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467032576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.469524:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.469533:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 36 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.469542:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467032704:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.469569:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.471898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.471962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.472295:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704576 00000100:00100000:1.0:1746147253.472306:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704576 00010000:00010000:1.0:1746147253.472338:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 37 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.472361:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704704 00000100:00100000:1.0:1746147253.472364:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704704 00010000:00010000:1.0:1746147253.472374:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 7 pid: 8481 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746147253.472430:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7889 00000100:00100000:0.0:1746147253.472440:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465704576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.472457:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.472489:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 37 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.472504:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7890 00010000:00010000:0.0:1746147253.472504:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 37 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.472513:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465704704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.472524:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.472530:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.472540:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 7 pid: 8481 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.472550:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 7 pid: 8481 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.472567:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147253.472572:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465704576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 134us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.472578:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7889 00000100:00100000:2.0:1746147253.472599:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465704704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 89us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.472605:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7890 00000100:00100000:0.0:1746147253.473006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.473100:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467032320:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147253.473102:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467032448:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.473113:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147253.473120:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948bda00/0xb4b2209fbdad0bc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec854 expref: 6 pid: 8481 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.473153:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467032576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.473169:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fac800/0xb4b2209fbdad09c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec758 expref: 36 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.473178:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467032704:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.473252:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465704832 00000100:00100000:1.0:1746147253.473256:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465704832 00010000:00010000:1.0:1746147253.473268:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 25 pid: 8478 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.473283:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7891 00000100:00100000:1.0:1746147253.473293:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465704832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.473300:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.473308:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 25 pid: 8478 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.473315:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 25 pid: 8478 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.473327:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e036200/0xb4b2209fbdad09f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec766 expref: 25 pid: 8478 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.473340:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.473341:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.473347:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.473354:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.473379:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.473388:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467032832:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147253.473430:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.473519:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465704448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4666us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.473525:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7888 00010000:00010000:3.0:1746147253.473601:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.473615:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c4200, rc 0) 00000100:00100000:3.0:1746147253.473673:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31830:x1830967465704192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4436us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.473681:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15524 00000100:00100000:0.0:1746147253.476412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.476459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.476507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.476665:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467032832:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147253.476687:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.476742:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465704832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3450us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.476752:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7891 00000100:00100000:1.0:1746147253.476789:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465705088 00000100:00100000:1.0:1746147253.476795:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465705088 00002000:00100000:1.0:1746147253.476829:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880091079180 x1830967465705088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.476839:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091079180 with x1830967465705088 ext(2097152->3145727) 00002000:00010000:1.0:1746147253.476844:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091079180 00000100:00100000:1.0:1746147253.476864:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465705344 00000100:00100000:1.0:1746147253.476868:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465705344 00002000:00100000:1.0:1746147253.476884:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880094400000 x1830967465705344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.476891:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400000 with x1830967465705344 ext(3145728->4194303) 00002000:00010000:1.0:1746147253.476894:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094400000 00000100:00100000:1.0:1746147253.476918:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465705600 00000100:00100000:1.0:1746147253.476922:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465705600 00002000:00100000:1.0:1746147253.476980:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094400380 x1830967465705600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.476987:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400380 with x1830967465705600 ext(3145728->4194303) 00002000:00010000:1.0:1746147253.476991:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094400380 00000100:00100000:1.0:1746147253.477012:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7352 00000100:00100000:1.0:1746147253.477020:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465705088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147253.477160:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7353 00000100:00100000:2.0:1746147253.477175:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465705344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147253.478778:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7354 00000100:00100000:1.0:1746147253.478789:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465705600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.480488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.480726:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465705856 00000100:00100000:1.0:1746147253.480734:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465705856 00002000:00100000:1.0:1746147253.480771:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (1011712->1015807) req@ffff880094400a80 x1830967465705856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.480779:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400a80 with x1830967465705856 ext(1011712->1015807) 00002000:00010000:1.0:1746147253.480785:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094400a80 00000100:00100000:1.0:1746147253.480812:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7355 00000100:00100000:1.0:1746147253.480819:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465705856:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147253.480928:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465705856:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 109us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147253.480933:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7355 00002000:00100000:1.0:1746147253.480962:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (1011712->1015807) req@ffff880094400a80 x1830967465705856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.480969:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400a80 with x1830967465705856 ext(1011712->1015807) 00002000:00010000:1.0:1746147253.480972:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094400a80 00000100:00100000:2.0:1746147253.484597:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465705344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7420us (8130us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.484609:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7353 00002000:00100000:2.0:1746147253.484620:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880094400000 x1830967465705344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.484627:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400000 with x1830967465705344 ext(3145728->4194303) 00002000:00010000:2.0:1746147253.484632:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094400000 00000100:00100000:1.0:1746147253.489353:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465705088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12325us (12942us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.489365:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7352 00002000:00100000:1.0:1746147253.489376:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880091079180 x1830967465705088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.489386:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091079180 with x1830967465705088 ext(2097152->3145727) 00002000:00010000:1.0:1746147253.489392:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091079180 00000100:00100000:2.0:1746147253.491617:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465705600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12822us (15101us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.491628:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7354 00002000:00100000:2.0:1746147253.491637:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094400380 x1830967465705600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.491646:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400380 with x1830967465705600 ext(3145728->4194303) 00002000:00010000:2.0:1746147253.491651:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094400380 00000100:00100000:0.0:1746147253.491995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.492070:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465705984 00000100:00100000:3.0:1746147253.492077:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465705984 00000100:00100000:3.0:1746147253.492103:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15525 00000100:00100000:3.0:1746147253.492108:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31830:x1830967465705984:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.492399:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.492413:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8ee expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.492437:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.492444:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 28 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.492451:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 6 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.492456:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.492458:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.492461:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.492484:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 6 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.492493:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 6 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.492504:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467032960:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.492576:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 28 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.492584:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 28 pid: 4445 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.492591:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467033088:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.492625:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.492633:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.492639:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467033216:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.492669:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.495325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.495405:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467032960:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.495499:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465706112 00000100:00100000:1.0:1746147253.495505:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465706112 00010000:00010000:1.0:1746147253.495528:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 7 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.495559:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7892 00000100:00100000:1.0:1746147253.495565:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465706112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.495575:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.495591:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 7 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.495600:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 7 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746147253.495889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.495914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.495928:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465706496 00000100:00100000:0.0:1746147253.495930:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465706496 00000100:00100000:0.0:1746147253.495968:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465706368 00000100:00100000:0.0:1746147253.495970:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465706368 00000100:00100000:0.0:1746147253.495982:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15526 00000100:00100000:0.0:1746147253.495987:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465706496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147253.495997:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.496005:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad0ce0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8fc expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.496038:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15527 00000100:00100000:2.0:1746147253.496046:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465706368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.496056:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147253.496062:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467033088:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.496064:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad0ce7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec8f5 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.496070:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467033216:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.496093:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467033344:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147253.496121:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d72a00/0xb4b2209fbdad0bcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec85b expref: 7 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.496149:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439540 going to sleep for 11 seconds 00010000:00010000:0.0:1746147253.496932:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.496960:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad0ce0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8fc expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.496970:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d98d400/0xb4b2209fbdad0ce0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8fc expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.496980:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98d400, rc 0) 00000100:00100000:2.0:1746147253.497003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.497003:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465706496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1016us (1114us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147253.497008:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15526 00000100:00100000:2.0:1746147253.497018:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465706240 00000100:00100000:2.0:1746147253.497021:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465706240 00010000:00010000:2.0:1746147253.497034:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 29 pid: 4445 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.497050:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7893 00000100:00100000:2.0:1746147253.497055:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465706240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.497061:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.497072:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 29 pid: 4445 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.497080:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 29 pid: 4445 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746147253.497395:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.497408:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b207200, rc 0) 00000100:00100000:3.0:1746147253.497426:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31830:x1830967465705984:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5318us (5432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.497431:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15525 00010000:00010000:1.0:1746147253.497470:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.497477:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d72c00/0xb4b2209fbdad0c85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8b6 expref: 29 pid: 4445 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.497487:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465706112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1922us (2167us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147253.497490:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.497493:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7892 00000100:00100000:2.0:1746147253.497505:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465706240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 451us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.497516:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7893 00000100:00100000:2.0:1746147253.497803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.497883:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465706624 00000100:00100000:0.0:1746147253.497886:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465706624 00010000:00010000:0.0:1746147253.497896:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.497910:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7894 00000100:00100000:0.0:1746147253.497914:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465706624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.497918:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.497924:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.497930:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.497957:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd400/0xb4b2209fbdad0ba5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec846 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.497962:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.497963:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.497968:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.497972:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147253.497990:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime: 1746147252 -> 1746147253 00002000:00010000:3.0:1746147253.497993:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime: 1746147252 -> 1746147253 00010000:00010000:1.0:1746147253.498027:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.498037:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467033472:192.168.203.36@tcp:105: 00002000:00010000:3.0:1746147253.498109:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime: 1746147252 -> 1746147253 00000100:00100000:3.0:1746147253.498121:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b50d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467033344:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.498147:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad0ce7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8f5 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.498158:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad0ce7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8f5 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.498172:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1600, rc 0) 00000100:00100000:3.0:1746147253.498191:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465706368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2148us (2276us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.498196:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15527 00000100:00100000:1.0:1746147253.498216:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147253.499605:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467033472:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147253.499614:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.499637:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465706624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1722us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.499644:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7894 00000100:00100000:0.0:1746147253.500713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.500815:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465706880 00000100:00100000:2.0:1746147253.500821:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465706880 00002000:00100000:2.0:1746147253.500848:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1089536->1093631) req@ffff880094401500 x1830967465706880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.500861:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094401500 with x1830967465706880 ext(1089536->1093631) 00002000:00010000:2.0:1746147253.500864:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094401500 00000100:00100000:2.0:1746147253.500888:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7356 00000100:00100000:2.0:1746147253.500894:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465706880:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147253.501201:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465706880:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 306us (496us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147253.501207:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7356 00002000:00100000:2.0:1746147253.501212:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1089536->1093631) req@ffff880094401500 x1830967465706880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.501218:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094401500 with x1830967465706880 ext(1089536->1093631) 00002000:00010000:2.0:1746147253.501220:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094401500 00000100:00100000:0.0:1746147253.503396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.503480:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465707136 00000100:00100000:2.0:1746147253.503488:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465707136 00002000:00100000:2.0:1746147253.503514:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094402d80 x1830967465707136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.503521:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094402d80 with x1830967465707136 ext(4194304->4976639) 00002000:00010000:2.0:1746147253.503525:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094402d80 00000100:00100000:2.0:1746147253.503574:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7357 00000100:00100000:2.0:1746147253.503580:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465707136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.503984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.504205:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465707392 00000100:00100000:3.0:1746147253.504213:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465707392 00000100:00100000:3.0:1746147253.504261:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4776 00000100:00100000:3.0:1746147253.504270:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+42:31830:x1830967465707392:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147253.504611:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+43:31830:x1830967465707392:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 340us (626us total) trans 8589945432 rc 0/0 00000100:00100000:3.0:1746147253.504623:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4776 00000100:00100000:3.0:1746147253.512978:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465707136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9355us (9549us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147253.512993:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7357 00002000:00100000:3.0:1746147253.513007:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094402d80 x1830967465707136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.513017:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094402d80 with x1830967465707136 ext(4194304->4976639) 00002000:00010000:3.0:1746147253.513024:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094402d80 00000100:00100000:0.0:1746147253.518837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.518880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.518961:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465707520 00000100:00100000:2.0:1746147253.518968:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465707520 00000100:00100000:2.0:1746147253.519010:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465707648 00000100:00100000:2.0:1746147253.519013:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465707648 00000100:00100000:2.0:1746147253.519029:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15528 00000100:00100000:2.0:1746147253.519035:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465707520:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.519049:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.519063:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0cee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec903 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.519102:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15529 00000100:00100000:2.0:1746147253.519108:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467033600:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.519118:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465707648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.519145:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.519162:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b207400/0xb4b2209fbdad0cf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec90a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.519195:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.519209:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467033728:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.519261:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.522872:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467033600:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.522900:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0cee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec903 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.522913:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0cee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec903 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.522954:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1000, rc 0) 00000100:00100000:2.0:1746147253.522988:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465707520:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3953us (4158us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147253.522996:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15528 00002000:00010000:3.0:1746147253.523436:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147252 -> 1746147253 00002000:00010000:3.0:1746147253.523443:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147252 -> 1746147253 00002000:00010000:3.0:1746147253.523445:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime: 1746147252 -> 1746147253 00000100:00100000:3.0:1746147253.523467:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467033728:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.523497:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b207400/0xb4b2209fbdad0cf5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec90a expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.523510:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b207400/0xb4b2209fbdad0cf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec90a expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.523541:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b207400, rc 0) 00000100:00100000:3.0:1746147253.524054:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465707648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4940us (5171us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.524060:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15529 00000100:00100000:0.0:1746147253.526430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.526461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.526492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.526522:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465707776 00000100:00100000:3.0:1746147253.526524:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465707904 00000100:00100000:2.0:1746147253.526529:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465707776 00000100:00100000:3.0:1746147253.526534:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465707904 00000100:00100000:1.0:1746147253.526539:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465708032 00000100:00100000:1.0:1746147253.526544:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465708032 00000100:00100000:2.0:1746147253.526567:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15530 00000100:00100000:2.0:1746147253.526574:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:31827:x1830967465707776:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:1.0:1746147253.526580:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15531 00000100:00100000:1.0:1746147253.526586:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465708032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.526589:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.526594:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147253.526595:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15532 00000100:00100000:3.0:1746147253.526601:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465707904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.526603:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec911 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.526603:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad0d03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec91f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.526614:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.526626:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.526633:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 5 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.526636:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0d0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec918 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.526639:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147253.526642:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467033856:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.526644:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.526646:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.526649:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 6/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1785856->2097151] (req 1785856->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.526666:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147253.526676:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034112:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.526676:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 39 pid: 8478 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.526684:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467033984:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.526697:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.526727:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b840 going to sleep for 11 seconds 00010000:00010000:2.0:1746147253.526839:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 5 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.526847:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 5 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.526855:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467034240:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.526879:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.526886:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 22 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.527004:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467034368:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.527040:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.529637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.529723:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467033984:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.529732:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467034240:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.529738:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467034368:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.529740:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034112:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.529761:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1785856->2097151] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.529762:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0d0a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec918 expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147253.529765:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465708160 00000100:00100000:1.0:1746147253.529771:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465708160 00010000:00010000:2.0:1746147253.529775:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0e00, rc 0) 00010000:00010000:1.0:1746147253.529792:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 6 pid: 21080 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.529806:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:31827:x1830967465707776:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3233us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.529812:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15530 00000100:00100000:1.0:1746147253.529821:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7895 00000100:00100000:1.0:1746147253.529826:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465708160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.529837:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.529846:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 6 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.529854:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 6 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.529867:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72200/0xb4b2209fbdad0bd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec869 expref: 6 pid: 21080 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746147253.529870:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0d0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec918 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.529878:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b206c00, rc 0) 00010000:00010000:1.0:1746147253.529878:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.529893:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1956:x1830967465708160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.529898:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465707904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3297us (3436us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147253.529898:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7895 00000100:00100000:3.0:1746147253.529907:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15532 00000100:00100000:1.0:1746147253.529934:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467033856:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147253.529965:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad0d03 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec91f expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.529973:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdad0d03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec91f expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.529979:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0cc00, rc 0) 00000100:00100000:1.0:1746147253.529994:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465708032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3410us (3502us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147253.529999:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15531 00000100:00100000:0.0:1746147253.531842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.531886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.531910:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465708288 00000100:00100000:1.0:1746147253.531917:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465708288 00010000:00010000:1.0:1746147253.531970:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 37 pid: 8478 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.531980:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465708416 00000100:00100000:2.0:1746147253.531984:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465708416 00000100:00100000:1.0:1746147253.531996:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7896 00010000:00010000:2.0:1746147253.532000:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 23 pid: 8478 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.532003:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465708288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.532013:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147253.532023:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7897 00000100:00100000:2.0:1746147253.532028:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465708416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.532030:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 37 pid: 8478 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.532035:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.532039:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 37 pid: 8478 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.532238:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 23 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.532246:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72800/0xb4b2209fbdad0b4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec807 expref: 37 pid: 8478 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.532248:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 23 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.532296:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.532303:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73800/0xb4b2209fbdad0ad3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec7e4 expref: 23 pid: 8478 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.532321:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.532323:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.532328:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.532331:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465708288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 328us (497us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147253.532334:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.532337:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7896 00010000:00010000:2.0:1746147253.532358:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.532367:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467034496:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147253.532412:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.535114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.535171:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465708672 00000100:00100000:3.0:1746147253.535181:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465708672 00000100:00100000:3.0:1746147253.535218:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4777 00000100:00100000:3.0:1746147253.535225:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+333:31825:x1830967465708672:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147253.535249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.535356:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467034496:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147253.535371:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.535386:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+334:31825:x1830967465708672:12345-192.168.203.36@tcp:35:cat.0 Request processed in 161us (281us total) trans 8589945433 rc 0/0 00000100:00100000:2.0:1746147253.535391:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465708416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3362us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.535392:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4777 00000100:00100000:2.0:1746147253.535398:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7897 00000100:00100000:3.0:1746147253.535420:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465708928 00000100:00100000:3.0:1746147253.535423:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465708928 00002000:00100000:3.0:1746147253.535443:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1785856->1789951) req@ffff880134f30380 x1830967465708928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.535451:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30380 with x1830967465708928 ext(1785856->1789951) 00002000:00010000:3.0:1746147253.535455:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f30380 00000100:00100000:3.0:1746147253.535480:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7358 00000100:00100000:3.0:1746147253.535485:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465708928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.535593:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465708928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 107us (344us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147253.535599:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7358 00002000:00100000:3.0:1746147253.535604:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1785856->1789951) req@ffff880134f30380 x1830967465708928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.535611:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30380 with x1830967465708928 ext(1785856->1789951) 00002000:00010000:3.0:1746147253.535613:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f30380 00000100:00100000:0.0:1746147253.539685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.539876:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465709056 00000100:00100000:3.0:1746147253.539883:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465709056 00000100:00100000:3.0:1746147253.539924:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15533 00000100:00100000:3.0:1746147253.539933:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:31827:x1830967465709056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147253.539965:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.539979:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec926 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.540001:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.540009:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.540015:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.540019:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.540021:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.540023:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 37 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.540048:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.540058:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 37 pid: 8480 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.540074:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034624:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.540169:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.540177:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.540184:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034752:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.540206:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.540213:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 21 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.540219:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034880:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.540233:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.542736:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034624:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147253.547251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.547314:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465709184 00000100:00100000:2.0:1746147253.547321:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465709184 00010000:00010000:2.0:1746147253.547351:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 38 pid: 8480 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.547387:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7898 00000100:00100000:2.0:1746147253.547394:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967465709184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.547404:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.547421:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 38 pid: 8480 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.547431:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 38 pid: 8480 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746147253.547449:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5765400/0xb4b2209fbdad0c7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8c4 expref: 38 pid: 8480 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746147253.547455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147253.547615:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.547656:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465709184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 263us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.547663:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7898 00000100:00100000:2.0:1746147253.547675:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465709440 00000100:00100000:2.0:1746147253.547679:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465709440 00010000:00010000:2.0:1746147253.547688:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 22 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.547702:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7899 00000100:00100000:2.0:1746147253.547705:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465709440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.547711:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.547718:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 22 pid: 17548 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.547724:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 22 pid: 17548 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.547734:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.547751:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465709440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.547756:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7899 00000100:00100000:3.0:1746147253.547771:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034752:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.547782:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d72e00/0xb4b2209fbdad0c3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec89a expref: 21 pid: 17548 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.547790:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467034880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.547816:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 36 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.547825:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b206e00, rc 0) 00000100:00100000:3.0:1746147253.547858:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:31827:x1830967465709056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7925us (8180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.547863:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15533 00000100:00100000:1.0:1746147253.548225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.548353:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465709312 00000100:00100000:3.0:1746147253.548357:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465709312 00010000:00010000:3.0:1746147253.548369:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.548384:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7900 00000100:00100000:3.0:1746147253.548388:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465709312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.548395:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.548402:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.548410:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.548420:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73a00/0xb4b2209fbdad0c4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8a8 expref: 21 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.548428:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.548429:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.548434:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.548442:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.548464:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.548474:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467035008:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147253.548516:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.550837:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467035008:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147253.550858:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.551143:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465709312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2742us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.551155:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7900 00000100:00100000:0.0:1746147253.554144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.554249:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465709696 00000100:00100000:3.0:1746147253.554260:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465709696 00002000:00100000:3.0:1746147253.554306:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2633728->2637823) req@ffff88009f66a680 x1830967465709696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.554315:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66a680 with x1830967465709696 ext(2633728->2637823) 00002000:00010000:3.0:1746147253.554319:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66a680 00000100:00100000:3.0:1746147253.554354:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7359 00000100:00100000:3.0:1746147253.554362:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465709696:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.554551:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465709696:12345-192.168.203.36@tcp:3:cat.0 Request processed in 190us (426us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147253.554562:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7359 00002000:00100000:3.0:1746147253.554567:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2633728->2637823) req@ffff88009f66a680 x1830967465709696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.554573:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66a680 with x1830967465709696 ext(2633728->2637823) 00002000:00010000:3.0:1746147253.554576:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66a680 00000100:00100000:0.0:1746147253.589884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.589996:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465709824 00000100:00100000:2.0:1746147253.590006:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465709824 00000100:00100000:2.0:1746147253.590071:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11433 00000100:00100000:2.0:1746147253.590079:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31835:x1830967465709824:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.590104:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.590122:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad0d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec92d expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.590188:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590203:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590213:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590224:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590228:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590232:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590334:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590345:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 333 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.590352:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.590387:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 333 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.590398:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 333 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.590410:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467035136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.590503:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.591722:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467035136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.591839:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147253.592052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.592100:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710080 00000100:00100000:3.0:1746147253.592107:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710080 00000100:00100000:3.0:1746147253.592157:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4778 00000100:00100000:3.0:1746147253.592164:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+334:19602:x1830967465710080:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147253.592621:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+335:19602:x1830967465710080:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 456us (568us total) trans 8589945434 rc 0/0 00000100:00100000:3.0:1746147253.592628:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4778 00000100:00100000:0.0:1746147253.595205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.595353:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710208 00000100:00100000:3.0:1746147253.595363:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710208 00010000:00010000:3.0:1746147253.595398:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 335 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.595445:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7901 00000100:00100000:3.0:1746147253.595453:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+335:1956:x1830967465710208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.595466:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.595472:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 335 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.595482:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 335 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.595508:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad0c9a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d2 expref: 335 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.595521:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.595525:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.595534:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.595540:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.595570:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.595620:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1956:x1830967465710208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 168us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.595627:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7901 00010000:00010000:2.0:1746147253.595736:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.595744:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147253.595785:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147253.595789:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147253.595929:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.595997:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596008:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596013:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596018:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596023:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c0800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.596027:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596033:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596045:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.596048:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.596051:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596056:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596320:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596327:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596330:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596334:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c0600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.596337:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596342:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596349:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13200) 00010000:00010000:2.0:1746147253.596351:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.596353:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596357:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.596393:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad0d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.596408:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.596413:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.596415:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147253.596417:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0c00, rc 0) 00000100:00100000:2.0:1746147253.596484:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31835:x1830967465709824:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6404us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.596492:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11433 00000100:00100000:0.0:1746147253.599174:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.599206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.599231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.599253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.599275:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710336 00000100:00100000:0.0:1746147253.599283:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710336 00000100:00100000:2.0:1746147253.599309:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710592 00000100:00100000:2.0:1746147253.599320:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710592 00000100:00100000:0.0:1746147253.599324:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710848 00000100:00100000:0.0:1746147253.599326:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710848 00000100:00100000:2.0:1746147253.599345:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710464 00000100:00100000:2.0:1746147253.599348:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710464 00000100:00100000:0.0:1746147253.599858:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15534 00000100:00100000:0.0:1746147253.599869:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465710336:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147253.599888:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.599908:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98c400/0xb4b2209fbdad0d34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec934 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.599963:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15535 00000100:00100000:3.0:1746147253.599973:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465710848:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147253.599980:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15536 00010000:00010000:3.0:1746147253.599981:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147253.599985:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467035264:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147253.599988:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465710464:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147253.599989:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0d3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec950 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.600002:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147253.600015:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467035392:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.600016:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c0a00/0xb4b2209fbdad0d42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec93b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.600057:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467035520:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.600067:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.600067:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.600108:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.600154:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15537 00000100:00100000:2.0:1746147253.600159:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465710592:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.600165:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.600171:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec942 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.600410:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.600413:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.600421:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.600435:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.600444:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1200, rc 0) 00000100:00100000:0.0:1746147253.600522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.600562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.600611:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710720 00000100:00100000:3.0:1746147253.600615:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710720 00000100:00100000:2.0:1746147253.600630:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465710592:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 470us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.600636:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15537 00000100:00100000:3.0:1746147253.600645:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465710976 00000100:00100000:3.0:1746147253.600647:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465710976 00000100:00100000:2.0:1746147253.600652:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15538 00000100:00100000:2.0:1746147253.600658:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465710720:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.600666:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.600675:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0d50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec949 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.600692:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15539 00000100:00100000:2.0:1746147253.600696:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467035648:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.600698:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465710976:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147253.600706:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.600715:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec957 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.600718:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147253.600727:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.600729:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.600735:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.600746:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.600753:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077400, rc 0) 00000100:00100000:3.0:1746147253.600774:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465710976:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.600780:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15539 00000100:00100000:0.0:1746147253.604050:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467035520:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147253.604086:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0a00/0xb4b2209fbdad0d42 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec93b expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.604103:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0a00/0xb4b2209fbdad0d42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec93b expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147253.604178:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467035264:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.604196:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d98c400/0xb4b2209fbdad0d34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec934 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.604205:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98c400/0xb4b2209fbdad0d34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec934 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.604214:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98c400, rc 0) 00000100:00100000:3.0:1746147253.604301:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467035392:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.604318:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0d3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec950 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.604326:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952c5c00/0xb4b2209fbdad0d3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec950 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.604337:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c5c00, rc 0) 00010000:00010000:0.0:1746147253.604681:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0a00, rc 0) 00000100:00100000:2.0:1746147253.604722:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465710336:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4854us (5555us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147253.604729:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15534 00000100:00100000:3.0:1746147253.604814:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465710848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4842us (5580us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.604819:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15535 00000100:00100000:0.0:1746147253.604863:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465710464:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4877us (5609us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147253.604868:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15536 00002000:00010000:3.0:1746147253.605160:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147252 -> 1746147253 00002000:00010000:3.0:1746147253.605163:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147252 -> 1746147253 00002000:00010000:3.0:1746147253.605165:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147252 -> 1746147253 00000100:00100000:3.0:1746147253.605174:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467035648:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.605188:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0d50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec949 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.605197:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0d50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec949 expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.605203:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1000, rc 0) 00000100:00100000:3.0:1746147253.605225:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1956:x1830967465710720:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4568us (4704us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.605230:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15538 00000100:00100000:1.0:1746147253.611188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.611262:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465711232 00000100:00100000:2.0:1746147253.611273:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465711232 00000100:00100000:2.0:1746147253.611333:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11434 00000100:00100000:2.0:1746147253.611341:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31835:x1830967465711232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.611361:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.611379:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec95e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.611473:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.611488:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.611493:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.611524:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.611536:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 18 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.611553:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467035776:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.611644:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.613123:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467035776:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.613155:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147253.613272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.613534:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465711360 00000100:00100000:0.0:1746147253.613540:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465711360 00010000:00010000:0.0:1746147253.613563:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 19 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.613591:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7902 00000100:00100000:0.0:1746147253.613597:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:1956:x1830967465711360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.613607:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.613613:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 19 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.613622:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 19 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.613640:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d2d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec92d expref: 19 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.613663:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147253.613667:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.613676:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.613681:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.613703:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147253.613731:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465711360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 134us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.613737:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7902 00010000:00010000:2.0:1746147253.613932:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.613954:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147253.613975:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.614128:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec95e expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.614310:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec95e expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.614316:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.614318:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147253.614321:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1c00, rc 0) 00000100:00100000:2.0:1746147253.614482:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:31835:x1830967465711232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3141us (3304us total) trans 8589945435 rc 0/0 00000100:00100000:2.0:1746147253.614489:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11434 00000100:00100000:0.0:1746147253.617747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.617785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.617817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.617860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.617930:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465711488 00000100:00100000:3.0:1746147253.617962:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465711488 00000100:00100000:3.0:1746147253.618004:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465711744 00000100:00100000:3.0:1746147253.618006:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465711744 00000100:00100000:3.0:1746147253.618022:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465711616 00000100:00100000:3.0:1746147253.618024:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465711616 00000100:00100000:3.0:1746147253.618036:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465711872 00000100:00100000:3.0:1746147253.618038:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465711872 00000100:00100000:3.0:1746147253.618053:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15540 00000100:00100000:3.0:1746147253.618061:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465711488:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147253.618078:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.618095:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b076800/0xb4b2209fbdad0d73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec965 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.618161:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467035904:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.618240:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.618258:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15541 00000100:00100000:3.0:1746147253.618263:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465711744:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147253.618269:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.618277:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0d7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec973 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.618300:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467036032:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.618321:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.618336:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15542 00000100:00100000:3.0:1746147253.618341:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465711616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147253.618348:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.618360:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad0d81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec96c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.618383:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467036160:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147253.618403:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.618637:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15543 00000100:00100000:2.0:1746147253.618646:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465711872:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.618653:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.618661:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec97a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.618686:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467036288:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147253.618709:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.622211:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467035904:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147253.622246:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b076800/0xb4b2209fbdad0d73 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec965 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.622262:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b076800/0xb4b2209fbdad0d73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec965 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.622285:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b076800, rc 0) 00000100:00100000:3.0:1746147253.622332:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465711488:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4271us (4601us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.622340:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15540 00000100:00100000:2.0:1746147253.622578:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467036032:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.622615:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0d7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec973 expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.622629:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d50ca00/0xb4b2209fbdad0d7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec973 expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147253.622646:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467036160:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.622659:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50ca00, rc 0) 00000100:00100000:2.0:1746147253.622712:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467036288:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147253.622727:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d88 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec97a expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.622735:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0600/0xb4b2209fbdad0d88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec97a expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.622741:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad0d81 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec96c expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.622743:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0600, rc 0) 00010000:00010000:3.0:1746147253.622754:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad0d81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec96c expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.622764:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537ee00, rc 0) 00000100:00100000:3.0:1746147253.622852:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465711616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4510us (5033us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147253.622855:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465711872:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4209us (4992us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147253.622858:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15542 00000100:00100000:2.0:1746147253.622864:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15543 00000100:00100000:2.0:1746147253.622893:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1957:x1830967465711744:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4629us (5107us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147253.622898:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15541 00000100:00100000:0.0:1746147253.629156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.629625:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712128 00000100:00100000:2.0:1746147253.629635:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712128 00000100:00100000:2.0:1746147253.629702:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11435 00000100:00100000:2.0:1746147253.629709:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:31835:x1830967465712128:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.629729:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.629732:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147253.629752:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad0d65 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec95e expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.629767:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.629771:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.629781:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1e00/0xb4b2209fbdad0d8f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec981 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.629852:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d96 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.629862:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d96 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.629870:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d96 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147253.629879:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.630000:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1e00/0xb4b2209fbdad0d8f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec981 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.630197:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d96 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec981 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.630204:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.630207:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147253.630209:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0c00, rc 0) 00000100:00100000:2.0:1746147253.630437:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31835:x1830967465712128:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 728us (1291us total) trans 8589945436 rc 0/0 00000100:00100000:2.0:1746147253.630444:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11435 00000100:00100000:1.0:1746147253.636384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.636412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.636439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.636442:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712256 00000100:00100000:2.0:1746147253.636452:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712256 00000100:00100000:1.0:1746147253.636453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.636476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.636478:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712512 00000100:00100000:3.0:1746147253.636486:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712512 00000100:00100000:1.0:1746147253.636913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.636994:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712768 00000100:00100000:2.0:1746147253.636998:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712768 00000100:00100000:2.0:1746147253.637011:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712384 00000100:00100000:2.0:1746147253.637013:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712384 00000100:00100000:3.0:1746147253.637645:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15544 00000100:00100000:3.0:1746147253.637655:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465712256:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147253.637693:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637707:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637714:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.637716:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.637718:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637743:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637754:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 19 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.637759:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712896 00000100:00100000:3.0:1746147253.637764:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467036416:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.637764:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712896 00000100:00100000:1.0:1746147253.637795:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15545 00000100:00100000:1.0:1746147253.637803:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465712512:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:3.0:1746147253.637829:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147253.637837:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.637848:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15546 00010000:00010000:1.0:1746147253.637853:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.637854:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465712896:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147253.637861:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.637869:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.637874:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.637875:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.637876:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.637879:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637884:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637890:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.637899:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.637901:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.637903:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637916:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.637923:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 10 pid: 4444 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746147253.637931:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467036544:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.637974:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.637982:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 27 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.637990:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467036672:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.638003:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.638265:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465712640 00000100:00100000:0.0:1746147253.638279:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465712640 00010000:00010000:1.0:1746147253.638316:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.638432:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.638448:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467036800:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147253.638508:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.638516:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 10 pid: 8480 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.638524:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467036928:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147253.638550:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.638558:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 26 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.638813:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15547 00000100:00100000:3.0:1746147253.638821:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465712384:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147253.638838:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.638841:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15548 00000100:00100000:2.0:1746147253.638847:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465712768:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147253.638852:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.638857:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.638859:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.638860:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.638863:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.638874:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.638880:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147253.638887:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147253.638890:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.638905:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.638913:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 35 pid: 4445 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.638927:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467037184:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.638969:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147253.639068:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467037056:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147253.639144:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15549 00000100:00100000:0.0:1746147253.639149:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465712640:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147253.639165:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.639174:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.639180:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147253.639181:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147253.639183:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.639239:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.639248:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 26 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.639256:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467037312:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.639269:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.639277:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00010000:00010000:0.0:1746147253.639360:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.639368:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 35 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.639375:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467037440:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147253.639611:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.646701:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467036416:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.646722:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.646867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.646965:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467037440:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147253.646985:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.647017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.647038:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713152 00000100:00100000:0.0:1746147253.647044:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713152 00010000:00010000:0.0:1746147253.647075:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 11 pid: 4444 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746147253.647103:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7903 00000100:00100000:0.0:1746147253.647110:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465713152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.647125:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.647162:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 11 pid: 4444 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746147253.647175:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 11 pid: 4444 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746147253.647199:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147253.647241:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465713152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.647247:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7903 00000100:00100000:0.0:1746147253.647283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.647297:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713408 00000100:00100000:0.0:1746147253.647300:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713408 00010000:00010000:0.0:1746147253.647311:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 11 pid: 8480 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746147253.647325:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7904 00000100:00100000:0.0:1746147253.647330:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465713408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.647338:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.647348:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 11 pid: 8480 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746147253.647356:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 11 pid: 8480 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746147253.647367:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147253.647381:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465713408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.647389:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7904 00000100:00100000:0.0:1746147253.647439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.647449:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713280 00000100:00100000:0.0:1746147253.647451:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713280 00010000:00010000:0.0:1746147253.647462:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.647477:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7905 00000100:00100000:0.0:1746147253.647482:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465713280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.647488:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.647495:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.647502:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 28 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.647512:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.647514:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.647518:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.647526:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.647541:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.647546:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467037184:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147253.647556:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465713280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 73us (117us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147253.647560:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.647563:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7905 00000100:00100000:3.0:1746147253.647583:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713024 00000100:00100000:3.0:1746147253.647589:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713024 00002000:00100000:3.0:1746147253.647621:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (1011712->1048575) req@ffff88008e91bb80 x1830967465713024/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.647629:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91bb80 with x1830967465713024 ext(1011712->1048575) 00000100:00100000:0.0:1746147253.647632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147253.647634:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 20 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.647643:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 20 pid: 8480 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.647649:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e91bb80 00000100:00100000:3.0:1746147253.647692:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713536 00000100:00100000:3.0:1746147253.647695:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713536 00002000:00100000:3.0:1746147253.647708:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2637823) req@ffff88008e91b480 x1830967465713536/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.647714:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b480 with x1830967465713536 ext(2097152->2637823) 00010000:00010000:3.0:1746147253.647718:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 36 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.647721:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad0d57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec957 expref: 10 pid: 4444 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746147253.647723:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2526 00010000:00010000:3.0:1746147253.647725:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 36 pid: 4445 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.647730:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e91b480 00000100:00100000:0.0:1746147253.647730:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465713024:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147253.647739:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467036544:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.647743:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2527 00000100:00100000:3.0:1746147253.647749:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465713536:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147253.647751:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d50da00/0xb4b2209fbdad0ca8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8d9 expref: 27 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.647759:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467036672:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.647769:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647776:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647781:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647802:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647809:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647819:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647825:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b077800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147253.647828:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647834:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647848:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.647853:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b077800/0xb4b2209fbdad0db2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.647911:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465712896:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10057us (10998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.647918:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15546 00000100:00100000:2.0:1746147253.648026:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467037312:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.648038:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.648677:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467036800:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147253.648703:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1200/0xb4b2209fbdad0d49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec942 expref: 8 pid: 8480 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.648724:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467036928:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.648742:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467037056:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147253.648761:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.650462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.650577:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713792 00000100:00100000:3.0:1746147253.650583:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713792 00002000:00100000:3.0:1746147253.650605:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1093631) req@ffff88012e2b9180 x1830967465713792/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.650614:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9180 with x1830967465713792 ext(1048576->1093631) 00010000:00010000:3.0:1746147253.650620:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 27 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.650629:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 27 pid: 8480 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.650636:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2b9180 00000100:00100000:3.0:1746147253.650647:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2528 00000100:00100000:3.0:1746147253.650652:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465713792:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147253.651485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.651504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.651527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.651529:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714048 00000100:00100000:1.0:1746147253.651533:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714048 00010000:00010000:1.0:1746147253.651550:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 29 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.651571:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713664 00000100:00100000:1.0:1746147253.651574:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713664 00010000:00010000:1.0:1746147253.651582:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.651594:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7906 00000100:00100000:1.0:1746147253.651598:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465714048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.651606:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.651618:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 29 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.651627:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 29 pid: 8481 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.651633:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7907 00000100:00100000:0.0:1746147253.651641:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465713664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.651647:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952c5400/0xb4b2209fbdad0beb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec877 expref: 29 pid: 8481 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.651649:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.651658:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147253.651661:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746147253.651671:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.651677:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465714048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.651683:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7906 00010000:00010000:0.0:1746147253.651683:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0c800/0xb4b2209fbdad0c77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8bd expref: 27 pid: 17548 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746147253.651707:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.651709:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.651713:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.651720:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.651743:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147253.651747:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.651754:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.651769:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.651773:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465713664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 132us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147253.651774:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.651779:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7907 00010000:00010000:1.0:1746147253.651780:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.651786:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0da00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147253.651789:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.651798:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465713920 00010000:00010000:1.0:1746147253.651800:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.651801:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465713920 00010000:00010000:1.0:1746147253.651809:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.651815:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0da00/0xb4b2209fbdad0dab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147253.651818:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1785856->2097151) req@ffff88012bfe2a00 x1830967465713920/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.651826:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe2a00 with x1830967465713920 ext(1785856->2097151) 00010000:00010000:0.0:1746147253.651832:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 38 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.651840:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 38 pid: 8480 timeout: 740 lvb_type: 0 00002000:00010000:0.0:1746147253.651846:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bfe2a00 00000100:00100000:1.0:1746147253.651853:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465712512:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14051us (15440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.651857:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2529 00000100:00100000:1.0:1746147253.651860:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15545 00000100:00100000:0.0:1746147253.651862:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465713920:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147253.658926:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465713792:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8265us (8460us total) trans 21474841364 rc 0/0 00000100:00100000:2.0:1746147253.658955:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2528 00002000:00100000:2.0:1746147253.658965:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1093631) req@ffff88012e2b9180 x1830967465713792/t21474841364(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.658974:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9180 with x1830967465713792 ext(1048576->1093631) 00010000:00010000:2.0:1746147253.658982:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.658994:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.659000:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2b9180 00000100:00100000:0.0:1746147253.661036:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465713024:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 13300us (14169us total) trans 17179874005 rc 0/0 00000100:00100000:0.0:1746147253.661045:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2526 00002000:00100000:0.0:1746147253.661053:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (1011712->1048575) req@ffff88008e91bb80 x1830967465713024/t17179874005(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.661061:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91bb80 with x1830967465713024 ext(1011712->1048575) 00010000:00010000:0.0:1746147253.661069:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 22 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.661084:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 22 pid: 8480 timeout: 740 lvb_type: 0 00002000:00010000:0.0:1746147253.661090:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e91bb80 00000100:00100000:3.0:1746147253.662217:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967465713536:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14466us (14583us total) trans 17179874006 rc 0/0 00000100:00100000:3.0:1746147253.662225:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2527 00002000:00100000:3.0:1746147253.662230:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2637823) req@ffff88008e91b480 x1830967465713536/t17179874006(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.662238:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b480 with x1830967465713536 ext(2097152->2637823) 00010000:00010000:3.0:1746147253.662244:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 40 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.662253:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 40 pid: 4445 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.662264:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e91b480 00000100:00100000:2.0:1746147253.665184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.665258:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714176 00000100:00100000:1.0:1746147253.665266:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714176 00010000:00010000:1.0:1746147253.665291:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.665321:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7908 00000100:00100000:1.0:1746147253.665328:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465714176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.665344:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.665368:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.665381:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.665404:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b207200/0xb4b2209fbdad0cd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8ee expref: 28 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.665425:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.665427:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.665430:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.665437:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.665459:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.665468:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.665476:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.665491:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465714176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 164us (313us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147253.665493:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.665497:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7908 00010000:00010000:2.0:1746147253.665499:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.665510:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.665516:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b92ee00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147253.665519:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.665525:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.665534:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.665539:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b92ee00/0xb4b2209fbdad0db9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.665652:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465712384:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 26832us (29196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.665659:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15547 00000100:00100000:2.0:1746147253.666415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.666434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.666449:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465713920:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14585us (14920us total) trans 17179874007 rc 0/0 00000100:00100000:0.0:1746147253.666457:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2529 00002000:00100000:0.0:1746147253.666465:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1785856->2097151) req@ffff88012bfe2a00 x1830967465713920/t17179874007(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147253.666474:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe2a00 with x1830967465713920 ext(1785856->2097151) 00010000:00010000:0.0:1746147253.666487:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 40 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.666496:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 40 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.666502:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714304 00000100:00100000:3.0:1746147253.666506:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714304 00010000:00010000:3.0:1746147253.666520:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 41 pid: 4445 timeout: 740 lvb_type: 0 00002000:00010000:0.0:1746147253.666553:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bfe2a00 00000100:00100000:1.0:1746147253.666630:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714432 00000100:00100000:3.0:1746147253.666634:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7909 00000100:00100000:1.0:1746147253.666634:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714432 00000100:00100000:3.0:1746147253.666640:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465714304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.666647:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 22 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.666648:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.666659:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 40 pid: 4445 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.666663:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7910 00010000:00010000:3.0:1746147253.666667:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 40 pid: 4445 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.666668:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465714432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.666675:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.666678:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b206e00/0xb4b2209fbdad0d11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec926 expref: 40 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.666684:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 22 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.666690:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.666691:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.666694:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666697:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 22 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.666700:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666708:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4200/0xb4b2209fbdad0cd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec8e7 expref: 22 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.666716:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147253.666716:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.666718:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.666720:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666726:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.666734:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465714304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.666738:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7909 00010000:00010000:1.0:1746147253.666738:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.666755:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465714432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (320us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147253.666756:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.666760:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7910 00010000:00010000:3.0:1746147253.666762:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.666774:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666776:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.666780:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666783:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.666786:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.666790:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c0200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147253.666793:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666795:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.666800:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666804:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666810:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.666812:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666814:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee9dc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147253.666816:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0200/0xb4b2209fbdad0dc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666817:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666822:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666831:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.666836:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9dc00/0xb4b2209fbdad0da4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.666847:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465712768:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 28000us (30407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.666852:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15548 00000100:00100000:1.0:1746147253.666865:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465712256:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 29212us (30490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.666871:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15544 00000100:00100000:0.0:1746147253.669752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.669796:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714560 00000100:00100000:2.0:1746147253.669802:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714560 00010000:00010000:2.0:1746147253.669823:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 39 pid: 8480 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.669850:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7911 00000100:00100000:2.0:1746147253.669854:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465714560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.669862:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.669876:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 39 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.669886:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 39 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.669898:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c0e00/0xb4b2209fbdad0cfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec911 expref: 39 pid: 8480 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.669907:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.669908:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.669911:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.669915:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.669947:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147253.669968:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.669977:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.669978:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967465714560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.669982:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7911 00010000:00010000:1.0:1746147253.669994:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.670000:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.670006:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.670011:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d98d000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147253.670013:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.670018:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.670027:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.670032:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98d000/0xb4b2209fbdad0dc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.670066:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1957:x1830967465712640:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 30917us (33589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.670073:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15549 00000100:00100000:0.0:1746147253.675253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.675432:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714816 00000100:00100000:2.0:1746147253.675440:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714816 00000100:00100000:2.0:1746147253.675565:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11436 00000100:00100000:2.0:1746147253.675573:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31835:x1830967465714816:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147253.675614:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746147253.675635:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0983 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec735 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675651:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdad0960 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec72e expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675660:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.675664:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.675686:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.675696:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675702:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 333 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675708:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 42 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675714:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 42 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675719:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 333 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675729:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 8/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.675754:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 333 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675764:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 333 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.675775:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037568:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.675847:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 42 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675854:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 42 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.675861:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.675880:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 42 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675886:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 42 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.675892:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037824:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.675907:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 333 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675916:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 333 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.675921:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.675960:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.675966:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 42 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.675972:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467038080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.675997:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.682584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.682604:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715072 00000100:00100000:0.0:1746147253.682611:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715072 00010000:00010000:0.0:1746147253.682639:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 43 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.682678:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7912 00000100:00100000:0.0:1746147253.682685:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+43:1956:x1830967465715072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.682696:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.682701:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 43 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.682711:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 43 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.682728:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147253.682733:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.682741:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.682760:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037568:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.682771:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1515a00/0xb4b2209fbdad0a40 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec790 expref: 43 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.682782:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+42:1956:x1830967465715072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.682783:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037696:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147253.682788:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7912 00000100:00100000:1.0:1746147253.682861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.682874:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465714944 00000100:00100000:0.0:1746147253.682877:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465714944 00010000:00010000:0.0:1746147253.682887:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 334 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.682908:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7913 00000100:00100000:1.0:1746147253.682911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.682913:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1956:x1830967465714944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147253.682917:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037824:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147253.682919:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147253.682922:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715328 00010000:00010000:0.0:1746147253.682922:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 334 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.682924:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467037952:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147253.682924:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715328 00010000:00010000:0.0:1746147253.682930:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 335 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.682931:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467038080:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147253.682934:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 335 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.682955:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c200/0xb4b2209fbdad0a6a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec79e expref: 335 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.682962:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7914 00010000:00010000:0.0:1746147253.682965:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00000100:00100000:1.0:1746147253.682967:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1956:x1830967465715328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.682968:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147253.682973:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.682973:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.682976:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147253.682976:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 334 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.682982:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 334 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.682987:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1956:x1830967465714944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.682992:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7913 00000100:00100000:0.0:1746147253.683033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.683046:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715200 00000100:00100000:3.0:1746147253.683049:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715200 00010000:00010000:3.0:1746147253.683062:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 42 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.683074:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7915 00000100:00100000:3.0:1746147253.683079:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+42:1956:x1830967465715200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.683084:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.683087:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 42 pid: 14047 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.683090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.683099:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715456 00000100:00100000:0.0:1746147253.683102:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715456 00010000:00010000:0.0:1746147253.683111:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 43 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.683123:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7916 00000100:00100000:0.0:1746147253.683128:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+43:1956:x1830967465715456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.683143:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.683146:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 43 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.683209:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dcd800/0xb4b2209fbdad04ba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec48e expref: 333 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.683221:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147253.683224:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147253.683229:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147253.683270:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 43 pid: 14047 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.683285:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5765600/0xb4b2209fbdad04c1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec495 expref: 43 pid: 14047 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.683310:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.683313:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.683317:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.683333:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+42:1956:x1830967465715200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 254us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.683337:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7915 00000100:00100000:1.0:1746147253.683412:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+332:1956:x1830967465715328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 282us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.683419:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7914 00010000:00010000:0.0:1746147253.683723:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 41 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.683736:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5379400/0xb4b2209fbdad04b3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec487 expref: 41 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.683745:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147253.683748:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.683755:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.683760:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.683786:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147253.683807:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+40:1956:x1830967465715456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 678us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.683813:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7916 00010000:00010000:2.0:1746147253.683966:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.683974:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000040:00080000:2.0:1746147253.684497:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3395, 88 off284248 00000004:00080000:2.0:1746147253.684504:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671566468ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684542:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3394, 88 off284160 00000004:00080000:2.0:1746147253.684546:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671608780ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684562:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3395, 88 off284248 00000004:00080000:2.0:1746147253.684565:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671627595ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684571:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3396, 88 off284336 00000004:00080000:2.0:1746147253.684573:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671635705ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684580:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3397, 88 off284424 00000004:00080000:2.0:1746147253.684582:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671645228ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684589:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3396, 88 off284336 00000004:00080000:2.0:1746147253.684591:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671653915ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684596:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3397, 88 off284424 00000004:00080000:2.0:1746147253.684598:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671660795ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684603:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3398, 88 off284512 00000004:00080000:2.0:1746147253.684604:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671667327ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684609:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3398, 88 off284512 00000004:00080000:2.0:1746147253.684611:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671673768ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684617:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3399, 88 off284600 00000004:00080000:2.0:1746147253.684618:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671681308ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684623:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3399, 88 off284600 00000004:00080000:2.0:1746147253.684625:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671687757ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684631:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3400, 88 off284688 00000004:00080000:2.0:1746147253.684634:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671696480ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.684638:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3400, 88 off284688 00000004:00080000:2.0:1746147253.684640:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671703290ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684657:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3401, 88 off284776 00000004:00080000:2.0:1746147253.684659:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671722190ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684664:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3402, 88 off284864 00000004:00080000:2.0:1746147253.684666:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671729347ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684671:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3403, 88 off284952 00000004:00080000:2.0:1746147253.684673:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640671736145ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.684679:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3401, 88 off284776 00000004:00080000:2.0:1746147253.684680:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640671743355ns, next at 607576201812ns, rc = 0 00000004:00010000:2.0:1746147253.705951:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008e918000 reply state ffff880136788400 transno 8589945437 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147253.705961:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147253.706049:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31835:x1830967465714816:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 30473us (30801us total) trans 8589945437 rc 0/0 00000100:00100000:2.0:1746147253.706057:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11436 00000001:00080000:0.0:1746147253.706271:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945403 is committed 00000001:00080000:0.0:1746147253.706280:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945387 is committed 00000001:00080000:0.0:1746147253.706284:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945424 is committed 00000001:00080000:0.0:1746147253.706287:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945413 is committed 00000001:00080000:0.0:1746147253.706293:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945401 is committed 00000001:00080000:0.0:1746147253.706325:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945437 is committed 00000004:00080000:0.0:1746147253.706329:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2528 committed 00000004:00080000:0.0:1746147253.706334:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2526 committed 00000004:00080000:0.0:1746147253.706339:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2525 committed 00000004:00080000:0.0:1746147253.706341:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2524 committed 00000004:00080000:0.0:1746147253.706343:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2523 committed 00000004:00080000:0.0:1746147253.706345:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2527 committed 00000004:00080000:0.0:1746147253.706346:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2522 committed 00000004:00080000:0.0:1746147253.706349:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2526 committed 00000004:00080000:0.0:1746147253.706350:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2521 committed 00000004:00080000:0.0:1746147253.706351:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2525 committed 00000004:00080000:0.0:1746147253.706353:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2524 committed 00000004:00080000:0.0:1746147253.706355:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2523 committed 00000004:00080000:0.0:1746147253.706356:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2520 committed 00000004:00080000:0.0:1746147253.706358:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2519 committed 00000004:00080000:0.0:1746147253.706359:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2522 committed 00000004:00080000:0.0:1746147253.706361:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2521 committed 00000004:00080000:0.0:1746147253.706362:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2518 committed 00000001:00080000:0.0:1746147253.706370:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945431 is committed 00000001:00080000:0.0:1746147253.706374:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945429 is committed 00000001:00080000:0.0:1746147253.706421:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945434 is committed 00000001:00080000:0.0:1746147253.706430:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945432 is committed 00000100:00100000:0.0:1746147253.706594:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467038208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.706630:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.706665:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467038720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.706680:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.706694:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147253.706699:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467038592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.706717:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.706727:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.706732:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.706737:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.706811:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038208 00000100:00100000:1.0:1746147253.706816:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038208 00000100:00100000:1.0:1746147253.706843:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038720 00000100:00100000:1.0:1746147253.706845:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038720 00000100:00100000:1.0:1746147253.706852:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038592 00000100:00100000:1.0:1746147253.706853:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038592 00000100:00100000:1.0:1746147253.706868:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039104 00000100:00100000:1.0:1746147253.706869:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039104 00000100:00100000:1.0:1746147253.706878:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15550 00000100:00100000:1.0:1746147253.706882:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3296:x1830967467038208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707364:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707383:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707398:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707412:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467039488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.707425:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707432:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467040000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.707442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707449:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746147253.707452:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707462:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707467:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707476:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707481:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467039360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.707490:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707494:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467039872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.707503:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.707515:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038464 00000100:00100000:2.0:1746147253.707518:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038464 00000100:00100000:2.0:1746147253.707528:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038976 00000100:00100000:2.0:1746147253.707529:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038976 00000100:00100000:2.0:1746147253.707534:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039488 00000100:00100000:2.0:1746147253.707535:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039488 00000100:00100000:2.0:1746147253.707543:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040000 00000100:00100000:2.0:1746147253.707544:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040000 00000100:00100000:2.0:1746147253.707549:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038336 00000100:00100000:2.0:1746147253.707550:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038336 00000100:00100000:2.0:1746147253.707555:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467038848 00000100:00100000:2.0:1746147253.707556:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467038848 00000100:00100000:2.0:1746147253.707561:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039360 00000100:00100000:2.0:1746147253.707562:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039360 00000100:00100000:2.0:1746147253.707565:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039872 00000100:00100000:2.0:1746147253.707566:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039872 00000100:00100000:2.0:1746147253.707572:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15551 00000100:00100000:2.0:1746147253.707576:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467038720:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147253.707604:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.707612:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.707618:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.707623:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0ca00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147253.707626:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.707632:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.707643:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:3.0:1746147253.707645:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147253.707649:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147253.707653:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdad0dce lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147253.707669:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967467038720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (988us total) trans 17179874009 rc 0/0 00000100:00100000:2.0:1746147253.707674:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15551 00000100:00100000:3.0:1746147253.707681:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15552 00000100:00100000:2.0:1746147253.707685:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15553 00000100:00100000:3.0:1746147253.707686:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467038592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707688:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467039104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707749:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15554 00000100:00100000:2.0:1746147253.707754:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3294:x1830967467038464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147253.707821:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3296:x1830967467039104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (1083us total) trans 17179874011 rc 0/0 00000100:00100000:3.0:1746147253.707827:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15553 00000100:00100000:2.0:1746147253.707833:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3294:x1830967467038464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (470us total) trans 17179874012 rc 0/0 00000100:00100000:2.0:1746147253.707837:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15554 00000100:00100000:3.0:1746147253.707840:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15555 00000100:00100000:3.0:1746147253.707844:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467038976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.707844:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15556 00000100:00100000:2.0:1746147253.707848:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467039488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.707921:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3294:x1830967467038976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (521us total) trans 17179874013 rc 0/0 00000100:00100000:3.0:1746147253.707926:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15555 00000100:00100000:2.0:1746147253.707926:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3294:x1830967467039488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (499us total) trans 21474841365 rc 0/0 00000100:00100000:2.0:1746147253.707930:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15556 00000100:00100000:3.0:1746147253.707949:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15557 00000100:00100000:2.0:1746147253.707952:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15558 00000100:00100000:3.0:1746147253.707954:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467040000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.707956:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467038336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147253.708024:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3294:x1830967467040000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (581us total) trans 21474841366 rc 0/0 00000100:00100000:2.0:1746147253.708024:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3294:x1830967467038336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (561us total) trans 17179874014 rc 0/0 00000100:00100000:2.0:1746147253.708029:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15558 00000100:00100000:3.0:1746147253.708031:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15557 00000100:00100000:2.0:1746147253.708038:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15559 00000100:00100000:3.0:1746147253.708040:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15560 00000100:00100000:2.0:1746147253.708042:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467038848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147253.708044:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467039360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.708110:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3294:x1830967467039360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (619us total) trans 21474841367 rc 0/0 00000100:00100000:2.0:1746147253.708110:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3294:x1830967467038848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (632us total) trans 17179874015 rc 0/0 00000100:00100000:2.0:1746147253.708114:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15559 00000100:00100000:3.0:1746147253.708116:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15560 00000100:00100000:2.0:1746147253.708122:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15561 00000100:00100000:2.0:1746147253.708125:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467039872:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147253.708190:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4673800/2, rc 0, transno 17179874011 00000100:00100000:0.0:1746147253.708199:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147253.708207:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1f80/2, rc 0, transno 17179874009 00000100:00100000:0.0:1746147253.708210:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467038720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.708218:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.708235:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.708242:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.708253:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.708259:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147253.708263:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.708272:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.708278:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467040128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.708289:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.708303:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039232 00000100:00100000:0.0:1746147253.708305:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039232 00000100:00100000:1.0:1746147253.708367:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967467038208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1483us (1735us total) trans 17179874008 rc 0/0 00000100:00100000:3.0:1746147253.709032:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039744 00000100:00100000:3.0:1746147253.709036:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039744 00000100:00100000:3.0:1746147253.709048:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467039616 00000100:00100000:3.0:1746147253.709049:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467039616 00000100:00100000:3.0:1746147253.709056:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15562 00000100:00100000:3.0:1746147253.709060:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967467039744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.709159:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967467039744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (904us total) trans 21474841369 rc 0/0 00000100:00100000:3.0:1746147253.709163:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15562 00000100:00100000:3.0:1746147253.709172:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040128 00000100:00100000:3.0:1746147253.709174:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040128 00000100:00100000:3.0:1746147253.709182:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15563 00000100:00100000:3.0:1746147253.709185:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967467039616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.709263:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3296:x1830967467039616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (989us total) trans 21474841370 rc 0/0 00000100:00100000:3.0:1746147253.709267:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15563 00000100:00100000:3.0:1746147253.709276:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15564 00000100:00100000:3.0:1746147253.709280:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967467040128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147253.709289:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:2.0:1746147253.709296:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147253.709298:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147253.709299:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147253.709301:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:2.0:1746147253.709322:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3294:x1830967467039872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1196us (1817us total) trans 21474841368 rc 0/0 00000100:00100000:2.0:1746147253.709327:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15561 00000100:00100000:3.0:1746147253.709344:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967467040128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1053us total) trans 21474841371 rc 0/0 00000100:00100000:3.0:1746147253.709348:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15564 00000100:00100000:3.0:1746147253.709379:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967467038592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1693us (2661us total) trans 17179874010 rc 0/0 00000100:00100000:3.0:1746147253.709384:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15552 00000100:00100000:0.0:1746147253.709419:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15565 00000100:00100000:0.0:1746147253.709426:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967467039232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147253.709585:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15550 00000004:00080000:2.0:1746147253.709742:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919500/2, rc 0, transno 17179874014 00000100:00100000:2.0:1746147253.709747:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147253.709758:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1c00/2, rc 0, transno 17179874015 00000100:00100000:2.0:1746147253.709760:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038848:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147253.709767:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2bb800/2, rc 0, transno 21474841367 00000100:00100000:2.0:1746147253.709770:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467039360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.710004:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967467039232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 579us (1769us total) trans 21474841372 rc 0/0 00000100:00100000:0.0:1746147253.710009:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15565 00000100:00080000:0.0:1746147253.710025:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147253.710028:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147253.710100:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467040256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.710184:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147253.710193:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040256 00000100:00100000:3.0:1746147253.710196:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040256 00000100:00100000:3.0:1746147253.710210:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15566 00000004:00080000:0.0:1746147253.710212:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2b8a80/2, rc 0, transno 21474841370 00000100:00100000:3.0:1746147253.710213:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467040256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.710215:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147253.710228:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0e680/2, rc 0, transno 21474841371 00000100:00100000:0.0:1746147253.710231:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467040128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147253.710237:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2b9880/2, rc 0, transno 21474841372 00000100:00100000:0.0:1746147253.710239:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147253.710243:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2bb100/2, rc 0, transno 21474841369 00000100:00100000:0.0:1746147253.710246:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467039744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147253.710251:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2680/2, rc 0, transno 17179874010 00000100:00100000:1.0:1746147253.710253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.710254:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467038592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147253.710260:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919c00/2, rc 0, transno 17179874008 00000100:00100000:0.0:1746147253.710262:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467038208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147253.710297:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967467040256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (112us total) trans 17179874016 rc 0/0 00000100:00100000:3.0:1746147253.710305:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15566 00000004:00080000:2.0:1746147253.710315:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2baa00/2, rc 0, transno 21474841368 00000100:00100000:2.0:1746147253.710319:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467039872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.710326:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2b8000/2, rc 0, transno 21474841365 00000100:00100000:2.0:1746147253.710329:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467039488:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.710340:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0e300/2, rc 0, transno 21474841366 00000100:00100000:2.0:1746147253.710343:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467040000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.710350:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c3800/2, rc 0, transno 17179874012 00000100:00100000:2.0:1746147253.710352:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038464:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147253.710357:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4670a80/2, rc 0, transno 17179874013 00000100:00100000:2.0:1746147253.710359:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467038976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.710374:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715584 00000100:00100000:2.0:1746147253.710377:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715584 00000100:00100000:2.0:1746147253.710409:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11437 00000100:00100000:2.0:1746147253.710414:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31835:x1830967465715584:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.710426:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.710437:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec988 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.710474:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.710484:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.710557:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.710560:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147253.710563:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b206400, rc 0) 00000100:00100000:2.0:1746147253.711685:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31835:x1830967465715584:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1269us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.711691:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11437 00000004:00080000:0.0:1746147253.711761:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e681c00/2, rc 0, transno 17179874016 00000100:00100000:0.0:1746147253.711765:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467040256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.718079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.718216:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715712 00000100:00100000:0.0:1746147253.718224:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715712 00000100:00100000:0.0:1746147253.718264:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11438 00000100:00100000:0.0:1746147253.718270:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31835:x1830967465715712:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147253.718287:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.718301:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98d800/0xb4b2209fbdad0ddc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec98f expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.718366:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0de3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.718377:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0de3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.718385:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0de3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147253.718407:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147253.718410:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147253.718421:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0de3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147253.718439:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98d800/0xb4b2209fbdad0ddc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec98f expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.718451:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0de3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec98f expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.718457:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:0.0:1746147253.718460:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147253.718462:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98da00, rc 0) 00000100:00100000:0.0:1746147253.718507:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31835:x1830967465715712:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 236us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.718513:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11438 00000100:00100000:0.0:1746147253.723311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.723345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.723369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.723382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.723394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.723420:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715968 00000100:00100000:1.0:1746147253.723427:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715968 00000100:00100000:0.0:1746147253.723453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.723458:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465715840 00000100:00100000:1.0:1746147253.723461:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465715840 00000100:00100000:0.0:1746147253.723470:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465716096 00000100:00100000:0.0:1746147253.723473:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465716096 00000100:00100000:1.0:1746147253.723488:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465716224 00000100:00100000:1.0:1746147253.723490:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465716224 00000100:00100000:0.0:1746147253.723490:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465716352 00000100:00100000:0.0:1746147253.723492:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465716352 00000100:00100000:1.0:1746147253.723501:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465716480 00000100:00100000:1.0:1746147253.723502:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465716480 00000100:00100000:0.0:1746147253.723505:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15567 00000100:00100000:0.0:1746147253.723512:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465715968:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:1.0:1746147253.723514:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15568 00000100:00100000:1.0:1746147253.723519:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465715840:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147253.723525:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.723526:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.723538:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec996 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.723539:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec99d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147253.723557:0:17530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417b5, atime: 0x681417b4, ctime: 0x681417b5, blocks: 0x7c9 00002000:00010000:0.0:1746147253.723557:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417b5, atime: 0x681417b4, ctime: 0x681417b5, blocks: 0x821 00010000:00010000:1.0:1746147253.723570:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.723570:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.723572:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.723572:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.723578:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.723578:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.723589:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.723592:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.723598:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094683e00, rc 0) 00010000:00010000:1.0:1746147253.723599:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a0e00, rc 0) 00000100:00100000:1.0:1746147253.723634:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465715840:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.723634:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465715968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 121us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.724187:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15567 00000100:00100000:1.0:1746147253.724215:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15568 00000100:00100000:3.0:1746147253.724232:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15569 00000100:00100000:3.0:1746147253.724249:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465716096:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147253.724253:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15570 00010000:00010000:3.0:1746147253.724257:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147253.724260:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465716224:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147253.724265:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9a4 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.724266:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.724273:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9ab expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147253.724276:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417b4, atime: 0x681417b4, ctime: 0x681417b4, blocks: 0x821 00010000:00010000:3.0:1746147253.724284:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.724285:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746147253.724286:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417b5, atime: 0x681417b4, ctime: 0x681417b5, blocks: 0x821 00010000:00010000:3.0:1746147253.724289:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.724292:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.724293:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.724297:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.724298:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147253.724304:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73e00, rc 0) 00010000:00010000:2.0:1746147253.724305:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.724310:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b207400, rc 0) 00000100:00100000:3.0:1746147253.724322:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465716096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 76us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.724322:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465716224:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 63us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.724326:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15569 00000100:00100000:2.0:1746147253.724336:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15570 00000100:00100000:2.0:1746147253.724350:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15571 00000100:00100000:0.0:1746147253.724354:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15572 00000100:00100000:2.0:1746147253.724355:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465716352:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:0.0:1746147253.724358:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465716480:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147253.724360:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.724362:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.724366:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9b2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.724367:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9b9 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147253.724376:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417b5, atime: 0x681417b5, ctime: 0x681417b5, blocks: 0x163d 00002000:00010000:0.0:1746147253.724376:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417b5, atime: 0x681417b5, ctime: 0x681417b5, blocks: 0x1029 00010000:00010000:2.0:1746147253.724383:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.724383:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.724384:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.724384:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.724388:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.724388:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.724396:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.724399:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.724402:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682a00, rc 0) 00010000:00010000:2.0:1746147253.724405:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b207200, rc 0) 00000100:00100000:2.0:1746147253.724416:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465716352:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 61us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.724416:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465716480:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 58us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.724420:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15572 00000100:00100000:2.0:1746147253.724422:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15571 00000100:00100000:0.0:1746147253.734533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.734585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.734602:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465716736 00000100:00100000:2.0:1746147253.734609:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465716736 00000100:00100000:2.0:1746147253.734652:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465716992 00000100:00100000:2.0:1746147253.734654:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465716992 00000100:00100000:2.0:1746147253.734671:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7360 00000100:00100000:2.0:1746147253.734677:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465716736:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147253.734703:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.734713:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.734715:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.734718:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.734729:0:1351:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.734856:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7361 00000100:00100000:3.0:1746147253.734863:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465716992:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147253.734878:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.734884:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.734886:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.734889:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.734895:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.737233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.738325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.738397:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465717504 00000100:00100000:3.0:1746147253.738405:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465717504 00000100:00100000:3.0:1746147253.738440:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465717248 00000100:00100000:3.0:1746147253.738442:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465717248 00000100:00100000:3.0:1746147253.738458:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7362 00000100:00100000:3.0:1746147253.738465:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465717504:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:0.0:1746147253.738475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147253.738489:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.738493:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465717760 00000100:00100000:0.0:1746147253.738496:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465717760 00010000:00010000:3.0:1746147253.738500:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.738501:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.738505:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.738514:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.738520:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7363 00000100:00100000:0.0:1746147253.738525:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465717248:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147253.738541:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.738551:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.738552:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.738555:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.738564:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.739497:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7364 00000100:00100000:3.0:1746147253.739504:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465717760:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147253.739519:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.739530:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.739532:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.739534:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.739542:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.740291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.740306:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465718016 00000100:00100000:2.0:1746147253.740310:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465718016 00000100:00100000:2.0:1746147253.740342:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7365 00000100:00100000:2.0:1746147253.740348:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967465718016:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147253.740367:0:25531:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.740378:0:25531:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.740379:0:25531:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.740382:0:25531:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.740391:0:25531:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744402:0:1351:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744416:0:1351:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744423:0:1351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744428:0:1351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b206c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147253.744431:0:1351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744438:0:1351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744454:0:1351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.744459:0:1351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b206c00/0xb4b2209fbdad0e14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.746370:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465716736:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 11686us (11837us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147253.746381:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7360 00000100:00100000:2.0:1746147253.746435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.746468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.746513:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465718272 00000100:00100000:1.0:1746147253.746519:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465718272 00000100:00100000:1.0:1746147253.746555:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465718528 00000100:00100000:1.0:1746147253.746557:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465718528 00000100:00100000:1.0:1746147253.746568:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7366 00000100:00100000:1.0:1746147253.746573:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465718272:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:2.0:1746147253.746579:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7367 00000100:00100000:2.0:1746147253.746588:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465718528:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147253.746593:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.746601:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.746602:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.746606:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.746607:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.746612:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.746614:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.746615:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.746618:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.746626:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754558:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754893:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754900:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754906:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147253.754909:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754915:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754929:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.754934:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0e1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.755034:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1959:x1830967465716992:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 20165us (20442us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.755043:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7361 00010000:00010000:3.0:1746147253.758059:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.758072:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.758079:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.758085:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147253.758088:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.758095:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.758108:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.758113:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad0e22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.758190:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465717504:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 19722us (20958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.758202:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7362 00010000:00010000:1.0:1746147253.767380:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.767393:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.767400:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.767405:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094682600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147253.767409:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.767415:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.767430:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.767435:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad0e29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.767506:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1958:x1830967465717248:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 28976us (29179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.767514:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7363 00010000:00010000:3.0:1746147253.774404:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.774418:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.774425:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.774431:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147253.774435:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.774442:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.774456:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.774462:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad0e30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.774537:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465717760:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 35028us (36057us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.774546:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7364 00010000:00010000:2.0:1746147253.778042:0:25531:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.778055:0:25531:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.778062:0:25531:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.778068:0:25531:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d98cc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147253.778072:0:25531:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.778078:0:25531:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.778093:0:25531:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.778099:0:25531:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d98cc00/0xb4b2209fbdad0e37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.778190:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465718016:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 37837us (37895us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.778200:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7365 00010000:00010000:1.0:1746147253.781387:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.781402:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.781413:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.781418:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f614a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147253.781421:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.781427:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.781442:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.781448:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f614a00/0xb4b2209fbdad0e3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147253.782207:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465718272:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 35628us (35768us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.782216:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7366 00010000:00010000:2.0:1746147253.783623:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.783635:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.783642:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.783648:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c1800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147253.783651:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.783658:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.783669:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.783674:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1800/0xb4b2209fbdad0e45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.784177:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465718528:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 37589us (37705us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.784186:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7367 00000100:00100000:0.0:1746147253.789726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.789792:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465718784 00000100:00100000:2.0:1746147253.789800:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465718784 00000100:00100000:2.0:1746147253.789856:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11439 00000100:00100000:2.0:1746147253.789864:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31835:x1830967465718784:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147253.789908:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147253.789927:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d98da00/0xb4b2209fbdad0de3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec98f expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.789976:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.789981:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147253.790011:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.790022:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.790030:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00010000:2.0:1746147253.790188:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f150700 reply state ffff88009faf3000 transno 8589945438 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147253.790194:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147253.791034:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31835:x1830967465718784:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 1169us (1313us total) trans 8589945438 rc 0/0 00000100:00100000:2.0:1746147253.791041:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11439 00010000:00010000:2.0:1746147253.792329:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.792339:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.792345:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.792353:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c0800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.792357:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.792363:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.792374:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.792376:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.792379:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147253.792384:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad0e4c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147253.793014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.793054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.793576:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465718912 00000100:00100000:1.0:1746147253.793576:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719040 00000100:00100000:2.0:1746147253.793583:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465718912 00000100:00100000:1.0:1746147253.793583:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719040 00000100:00100000:2.0:1746147253.793624:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15573 00000100:00100000:2.0:1746147253.793631:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465718912:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:1.0:1746147253.793633:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15574 00000100:00100000:1.0:1746147253.793638:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465719040:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147253.793769:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147253.793771:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:1.0:1746147253.793773:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147252 -> 1746147253 00002000:00010000:1.0:1746147253.793776:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:1.0:1746147253.793777:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147253.793811:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465719040:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 172us (756us total) trans 21474841373 rc 0/0 00000100:00100000:1.0:1746147253.793817:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15574 00002000:00010000:2.0:1746147253.794249:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147253.794252:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.794254:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147252 -> 1746147253 00002000:00010000:2.0:1746147253.794256:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.794257:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:2.0:1746147253.794285:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465718912:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 654us (1273us total) trans 17179874017 rc 0/0 00000100:00100000:2.0:1746147253.794291:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15573 00000100:00100000:0.0:1746147253.794484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.794545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.794569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.794585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.794619:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719168 00000100:00100000:1.0:1746147253.794623:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719168 00000100:00100000:1.0:1746147253.794646:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719296 00000100:00100000:1.0:1746147253.794648:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719296 00000100:00100000:3.0:1746147253.794656:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719424 00000100:00100000:3.0:1746147253.794660:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719424 00000100:00100000:1.0:1746147253.795029:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719552 00000100:00100000:1.0:1746147253.795031:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719552 00000100:00100000:1.0:1746147253.795212:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15575 00000100:00100000:3.0:1746147253.795219:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15576 00000100:00100000:1.0:1746147253.795219:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465719168:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:3.0:1746147253.795226:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465719296:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:0.0:1746147253.795261:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15577 00000100:00100000:0.0:1746147253.795267:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465719424:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147253.795301:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147253.795304:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147252 -> 1746147253 00002000:00010000:1.0:1746147253.795305:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147252 -> 1746147253 00002000:00010000:1.0:1746147253.795307:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147252 -> 1746147253 00002000:00010000:1.0:1746147253.795309:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147253.795332:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465719168:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 115us (849us total) trans 21474841374 rc 0/0 00002000:00010000:0.0:1746147253.795334:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00000100:00100000:1.0:1746147253.795337:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15575 00002000:00010000:0.0:1746147253.795338:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.795339:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.795342:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.795343:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:1.0:1746147253.795348:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15578 00000100:00100000:1.0:1746147253.795352:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465719552:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:0.0:1746147253.795361:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465719424:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 94us (791us total) trans 17179874018 rc 0/0 00000100:00100000:0.0:1746147253.795367:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15577 00002000:00010000:3.0:1746147253.795645:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147253.795648:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.795650:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147252 -> 1746147253 00002000:00010000:3.0:1746147253.795651:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.795653:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147253.795670:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465719296:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 445us (1124us total) trans 17179874019 rc 0/0 00000100:00100000:3.0:1746147253.795675:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15576 00002000:00010000:1.0:1746147253.796299:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147253.796302:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:1.0:1746147253.796304:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:1.0:1746147253.796306:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:1.0:1746147253.796308:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147253.796327:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465719552:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 973us (1740us total) trans 21474841375 rc 0/0 00000100:00100000:1.0:1746147253.796334:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15578 00000100:00100000:0.0:1746147253.798144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.798214:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719808 00000100:00100000:3.0:1746147253.798221:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719808 00000100:00100000:3.0:1746147253.798253:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4779 00000100:00100000:3.0:1746147253.798258:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31835:x1830967465719808:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:3.0:1746147253.798300:0:14051:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x39b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d96 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec981 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.798338:0:14051:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147253.798348:0:14051:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.798353:0:14051:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147253.798377:0:14051:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.798388:0:14051:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 9 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.798398:0:14051:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14051:1830967467040384:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.798478:0:14051:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.802263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.802340:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465719936 00000100:00100000:1.0:1746147253.802346:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465719936 00010000:00010000:1.0:1746147253.802373:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 10 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.802394:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7917 00000100:00100000:1.0:1746147253.802400:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465719936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.802409:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.802414:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 10 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.802423:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 10 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.802439:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:1.0:1746147253.802444:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147253.802451:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147253.802457:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14051 initiator: MDT0 00010000:00010000:1.0:1746147253.802471:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.802520:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465719936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.802527:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7917 00010000:00010000:3.0:1746147253.802609:0:14051:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b206400/0xb4b2209fbdad0dd5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec988 expref: 9 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.802625:0:14051:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14051:1830967467040384:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.802637:0:14051:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147253.802644:0:14051:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147253.802647:0:14051:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000040:00080000:3.0:1746147253.803186:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3404, 88 off285040 00000004:00080000:3.0:1746147253.803191:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790253865ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803224:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3402, 88 off284864 00000004:00080000:3.0:1746147253.803227:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790289859ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803237:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3403, 88 off284952 00000004:00080000:3.0:1746147253.803239:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790302011ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803246:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3405, 88 off285128 00000004:00080000:3.0:1746147253.803249:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790312251ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803256:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3406, 88 off285216 00000004:00080000:3.0:1746147253.803259:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790321397ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803264:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3404, 88 off285040 00000004:00080000:3.0:1746147253.803267:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790329385ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803272:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3405, 88 off285128 00000004:00080000:3.0:1746147253.803275:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790337576ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803280:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3406, 88 off285216 00000004:00080000:3.0:1746147253.803283:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790345795ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803289:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3407, 88 off285304 00000004:00080000:3.0:1746147253.803291:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790353795ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803296:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3407, 88 off285304 00000004:00080000:3.0:1746147253.803299:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790361579ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803304:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3408, 88 off285392 00000004:00080000:3.0:1746147253.803307:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790369670ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803313:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3408, 88 off285392 00000004:00080000:3.0:1746147253.803316:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790378651ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147253.803322:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3409, 88 off285480 00000004:00080000:3.0:1746147253.803324:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790387245ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803336:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3410, 88 off285568 00000004:00080000:3.0:1746147253.803338:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790401180ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803344:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3411, 88 off285656 00000004:00080000:3.0:1746147253.803347:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790409394ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803352:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3412, 88 off285744 00000004:00080000:3.0:1746147253.803355:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640790417759ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147253.803683:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3409, 88 off285480 00000004:00080000:3.0:1746147253.803688:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640790750459ns, next at 607576201812ns, rc = 0 00000004:00010000:2.0:1746147253.827176:0:14051:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f153b80 reply state ffff88012c918400 transno 8589945439 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000100:00100000:2.0:1746147253.827188:0:14051:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746147253.827197:0:14051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.827199:0:14051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147253.827207:0:14051:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0d96 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec981 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.827298:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31835:x1830967465719808:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 29038us (29172us total) trans 8589945439 rc 0/0 00000100:00100000:2.0:1746147253.827306:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4779 00000001:00080000:1.0:1746147253.827316:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945438 is committed 00000001:00080000:1.0:1746147253.827332:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945439 is committed 00000004:00080000:1.0:1746147253.827336:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2536 committed 00000004:00080000:1.0:1746147253.827341:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2535 committed 00000004:00080000:1.0:1746147253.827345:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2534 committed 00010000:00010000:2.0:1746147253.827346:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14051 initiator: MDT0 00000004:00080000:1.0:1746147253.827347:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2533 committed 00000004:00080000:1.0:1746147253.827349:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2532 committed 00000004:00080000:1.0:1746147253.827350:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2535 committed 00010000:00010000:2.0:1746147253.827352:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14051 initiator: MDT0 00000004:00080000:1.0:1746147253.827352:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2531 committed 00000004:00080000:1.0:1746147253.827353:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2534 committed 00000004:00080000:1.0:1746147253.827354:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2530 committed 00000004:00080000:1.0:1746147253.827356:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2533 committed 00000004:00080000:1.0:1746147253.827357:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2532 committed 00010000:00010000:2.0:1746147253.827358:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14051 initiator: MDT0 00000004:00080000:1.0:1746147253.827358:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2531 committed 00000004:00080000:1.0:1746147253.827360:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2529 committed 00000004:00080000:1.0:1746147253.827361:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2528 committed 00010000:00010000:2.0:1746147253.827363:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73c00 already unused, calling callback (ffffffffa136d690) 00000004:00080000:1.0:1746147253.827363:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2530 committed 00000004:00080000:1.0:1746147253.827365:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2529 committed 00000004:00080000:1.0:1746147253.827366:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2527 committed 00010000:00010000:2.0:1746147253.827367:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14051 initiator: MDT0 00010000:00010000:2.0:1746147253.827373:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14051 initiator: MDT0 00010000:00010000:2.0:1746147253.827383:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009f3f6300) 00010000:00010000:2.0:1746147253.827385:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147253.827388:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14051 initiator: MDT0 00010000:00010000:2.0:1746147253.827392:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e53 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14051 initiator: MDT0 00000100:00100000:2.0:1746147253.827420:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467040640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827496:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827510:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827521:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.827526:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467040896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827543:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467042176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.827554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827565:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746147253.827569:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467040512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827595:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827608:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827618:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.827629:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827636:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467042048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.827646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827658:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467040768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827668:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827676:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467041280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.827687:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827696:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467041792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.827708:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827714:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467042304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.827726:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.827744:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040640 00000100:00100000:2.0:1746147253.827750:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040640 00000100:00100000:2.0:1746147253.827770:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15579 00000100:00100000:2.0:1746147253.827775:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467040640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.827904:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041152 00002000:00010000:2.0:1746147253.827907:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746147253.827909:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041152 00002000:00010000:2.0:1746147253.827909:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.827911:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.827912:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.827914:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147253.827922:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041664 00000100:00100000:3.0:1746147253.827923:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041664 00000100:00100000:3.0:1746147253.827929:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467042176 00000100:00100000:3.0:1746147253.827930:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467042176 00000100:00100000:2.0:1746147253.827931:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467040640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (472us total) trans 21474841376 rc 0/0 00000100:00100000:2.0:1746147253.827948:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15579 00000100:00100000:3.0:1746147253.827951:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040512 00000100:00100000:3.0:1746147253.827953:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040512 00000100:00100000:2.0:1746147253.827955:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041024 00000100:00100000:2.0:1746147253.827957:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041024 00000100:00100000:3.0:1746147253.827960:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041536 00000100:00100000:3.0:1746147253.827961:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041536 00000100:00100000:2.0:1746147253.827963:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467042048 00000100:00100000:2.0:1746147253.827965:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467042048 00000100:00100000:3.0:1746147253.827967:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040768 00000100:00100000:3.0:1746147253.827968:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040768 00000100:00100000:2.0:1746147253.827972:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041280 00000100:00100000:3.0:1746147253.827974:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041792 00000100:00100000:2.0:1746147253.827974:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041280 00000100:00100000:3.0:1746147253.827976:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041792 00000100:00100000:3.0:1746147253.827981:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467042304 00000100:00100000:3.0:1746147253.827983:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467042304 00000100:00100000:2.0:1746147253.827983:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15580 00000100:00100000:2.0:1746147253.827987:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3294:x1830967467041152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.827991:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15581 00000100:00100000:3.0:1746147253.827995:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467041664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147253.828051:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:2.0:1746147253.828054:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147253.828056:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147253.828057:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147253.828059:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00002000:00010000:3.0:1746147253.828093:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147253.828096:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.828098:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.828099:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.828100:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147253.828219:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15582 00000100:00100000:0.0:1746147253.828226:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3294:x1830967467042176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.828655:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.828676:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467041408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.828687:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467041664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 620us (1082us total) trans 17179874020 rc 0/0 00000100:00100000:3.0:1746147253.828694:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15581 00000100:00100000:3.0:1746147253.828704:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467040896 00000100:00100000:3.0:1746147253.828707:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467040896 00000100:00100000:3.0:1746147253.828718:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15583 00000100:00100000:3.0:1746147253.828722:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3294:x1830967467040512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147253.828796:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147253.828799:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.828801:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.828803:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.828805:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147253.828825:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3294:x1830967467040512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (1238us total) trans 21474841378 rc 0/0 00000100:00100000:3.0:1746147253.828830:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15583 00000100:00100000:3.0:1746147253.828840:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15584 00000100:00100000:3.0:1746147253.828844:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3294:x1830967467041024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.828922:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3294:x1830967467041024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1312us total) trans 21474841379 rc 0/0 00000100:00100000:3.0:1746147253.828927:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15584 00000100:00100000:3.0:1746147253.828954:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15585 00000100:00100000:3.0:1746147253.828959:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3294:x1830967467041536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147253.829027:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147253.829030:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.829031:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.829033:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.829034:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:3.0:1746147253.829054:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467041536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1423us total) trans 17179874022 rc 0/0 00000100:00100000:3.0:1746147253.829059:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15585 00000100:00100000:3.0:1746147253.829067:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15586 00000100:00100000:3.0:1746147253.829072:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3294:x1830967467042048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147253.829155:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467042048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1508us total) trans 17179874023 rc 0/0 00000100:00100000:3.0:1746147253.829163:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15586 00000100:00100000:3.0:1746147253.829173:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15587 00000100:00100000:3.0:1746147253.829177:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830967467040768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147253.829242:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147253.829245:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.829246:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.829247:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.829249:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147253.829270:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830967467040768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1601us total) trans 21474841380 rc 0/0 00000100:00100000:3.0:1746147253.829275:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15587 00000100:00100000:3.0:1746147253.829284:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15588 00000100:00100000:3.0:1746147253.829288:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830967467041280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.829445:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3294:x1830967467042176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1219us (1888us total) trans 17179874021 rc 0/0 00000100:00100000:0.0:1746147253.829450:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15582 00000100:00100000:0.0:1746147253.829460:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15589 00000100:00100000:0.0:1746147253.829464:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467041792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147253.829531:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147253.829534:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.829536:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.829538:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.829539:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:2.0:1746147253.829549:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3294:x1830967467041152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1559us (2036us total) trans 21474841377 rc 0/0 00000100:00100000:2.0:1746147253.829555:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15580 00000100:00100000:0.0:1746147253.829557:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3295:x1830967467041792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (1847us total) trans 17179874024 rc 0/0 00000100:00100000:0.0:1746147253.829561:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15589 00000100:00100000:0.0:1746147253.829572:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15590 00000100:00100000:0.0:1746147253.829576:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467042304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.829647:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3295:x1830967467042304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1919us total) trans 17179874025 rc 0/0 00000100:00100000:2.0:1746147253.829651:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15591 00000100:00100000:2.0:1746147253.829658:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467040896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147253.829700:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.829714:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467041920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.829724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.829730:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467042432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.829743:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.829744:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967467040896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1088us total) trans 21474841381 rc 0/0 00000004:00080000:1.0:1746147253.829769:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050ad80/2, rc 0, transno 21474841381 00000100:00100000:1.0:1746147253.829773:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467040896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147253.829786:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041408 00000100:00100000:1.0:1746147253.829789:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041408 00000100:00100000:0.0:1746147253.829811:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15590 00000100:00100000:0.0:1746147253.829818:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467041920 00000100:00100000:0.0:1746147253.829820:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467041920 00000100:00100000:0.0:1746147253.829826:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467042432 00000100:00100000:0.0:1746147253.829827:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467042432 00000100:00100000:0.0:1746147253.829833:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15592 00000100:00100000:0.0:1746147253.829836:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3296:x1830967467041920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.829901:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15591 00000100:00100000:0.0:1746147253.829905:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967467041920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (179us total) trans 17179874026 rc 0/0 00000100:00100000:0.0:1746147253.829910:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15592 00000100:00100000:2.0:1746147253.829913:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15593 00000100:00100000:2.0:1746147253.829918:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3296:x1830967467042432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.829995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.830009:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465720064 00000100:00100000:0.0:1746147253.830011:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465720064 00000100:00100000:2.0:1746147253.830017:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967467042432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (271us total) trans 17179874027 rc 0/0 00000100:00100000:2.0:1746147253.830022:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15593 00000100:00100000:0.0:1746147253.830028:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11440 00000100:00100000:0.0:1746147253.830032:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31835:x1830967465720064:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147253.830043:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.830055:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9c0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746147253.830061:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050a300/2, rc 0, transno 21474841378 00000100:00100000:2.0:1746147253.830064:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467040512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.830071:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bfe2300/2, rc 0, transno 21474841379 00000100:00100000:2.0:1746147253.830074:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041024:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.830081:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401880/2, rc 0, transno 17179874022 00000100:00100000:2.0:1746147253.830089:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041536:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147253.830089:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746147253.830095:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401f80/2, rc 0, transno 17179874023 00000100:00100000:2.0:1746147253.830097:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467042048:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147253.830100:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746147253.830103:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094402a00/2, rc 0, transno 17179874020 00000100:00100000:2.0:1746147253.830105:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147253.830111:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b40b800/2, rc 0, transno 17179874021 00000100:00100000:2.0:1746147253.830113:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467042176:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147253.830113:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147253.830116:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147253.830118:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56fe00, rc 0) 00000004:00080000:2.0:1746147253.830119:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bfe3800/2, rc 0, transno 21474841377 00000100:00100000:2.0:1746147253.830121:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467041152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.830128:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b480/2, rc 0, transno 21474841376 00000100:00100000:2.0:1746147253.830145:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467040640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.830154:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31835:x1830967465720064:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 120us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.830159:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11440 00000100:00100000:1.0:1746147253.830346:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15594 00000100:00100000:1.0:1746147253.830352:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967467041408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.830362:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467042560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.830380:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.830402:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467042560 00000100:00100000:2.0:1746147253.830404:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467042560 00000100:00100000:2.0:1746147253.830418:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15595 00000100:00100000:2.0:1746147253.830422:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3293:x1830967467042560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.830438:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967467041408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (737us total) trans 21474841382 rc 0/0 00000100:00100000:1.0:1746147253.830443:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15594 00000004:00080000:1.0:1746147253.830467:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4faf480/2, rc 0, transno 21474841382 00000100:00100000:1.0:1746147253.830470:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467041408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147253.830476:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094402680/2, rc 0, transno 17179874026 00000100:00100000:1.0:1746147253.830479:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467041920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147253.830483:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b40a300/2, rc 0, transno 17179874027 00000100:00100000:1.0:1746147253.830485:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467042432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.830512:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967467042560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (130us total) trans 17179874028 rc 0/0 00000100:00100000:2.0:1746147253.830517:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15595 00000004:00080000:2.0:1746147253.830537:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012df79880/2, rc 0, transno 17179874028 00000100:00100000:2.0:1746147253.830541:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467042560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147253.831164:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830967467041280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1874us (3474us total) trans 21474841383 rc 0/0 00000100:00100000:3.0:1746147253.831170:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15588 00000004:00080000:2.0:1746147253.831197:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b800/2, rc 0, transno 21474841380 00000100:00100000:2.0:1746147253.831201:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467040768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.831208:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bfe2680/2, rc 0, transno 21474841383 00000100:00100000:2.0:1746147253.831210:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467041280:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147253.831216:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401180/2, rc 0, transno 17179874024 00000100:00100000:2.0:1746147253.831219:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467041792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147253.831225:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b40bb80/2, rc 0, transno 17179874025 00000100:00100000:2.0:1746147253.831227:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467042304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.832187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.832361:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465720320 00000100:00100000:2.0:1746147253.832366:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465720320 00000100:00100000:2.0:1746147253.832398:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4780 00000100:00100000:2.0:1746147253.832404:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31835:x1830967465720320:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147253.832578:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31835:x1830967465720320:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 172us (391us total) trans 8589945440 rc 0/0 00000100:00100000:2.0:1746147253.832584:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4780 00000100:00100000:0.0:1746147253.850244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.850342:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465720576 00000100:00100000:2.0:1746147253.850350:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465720576 00000100:00100000:2.0:1746147253.850388:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11441 00000100:00100000:2.0:1746147253.850395:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+300:31842:x1830967465720576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147253.850412:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.850427:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73800/0xb4b2209fbdad0e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9c7 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.850511:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850521:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850530:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850541:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850546:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850551:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850633:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850641:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850646:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147253.850653:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.850879:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850885:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850891:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850895:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.850898:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850903:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850912:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.850915:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.850918:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850922:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850973:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850981:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850985:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850988:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.850990:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850994:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.850999:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13700) 00010000:00010000:2.0:1746147253.851001:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.851003:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.851007:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.851036:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73800/0xb4b2209fbdad0e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.851045:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.851050:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147253.851051:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147253.851053:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73c00, rc 0) 00000100:00100000:2.0:1746147253.851275:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31842:x1830967465720576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 879us (1036us total) trans 8589945441 rc 0/0 00000100:00100000:2.0:1746147253.851282:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11441 00000100:00100000:0.0:1746147253.854922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.855611:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465720832 00000100:00100000:2.0:1746147253.855619:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465720832 00000100:00100000:2.0:1746147253.855667:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11442 00000100:00100000:2.0:1746147253.855674:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+6:31846:x1830967465720832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.855694:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.855715:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73800/0xb4b2209fbdad0e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9ce expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.855799:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855810:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855818:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855828:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855833:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855837:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855922:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855928:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.855934:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147253.855973:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147253.856083:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.856089:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.856093:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.856097:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.856100:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.856105:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.856114:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147253.856117:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.856120:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.856125:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73400/0xb4b2209fbdad0e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858207:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858216:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858226:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858233:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d73600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147253.858236:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858240:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858251:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13200) 00010000:00010000:2.0:1746147253.858254:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147253.858256:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858261:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad0e92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.858307:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73800/0xb4b2209fbdad0e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.858318:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.858323:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147253.858325:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147253.858327:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0200, rc 0) 00000100:00100000:2.0:1746147253.858401:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31846:x1830967465720832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2723us (3482us total) trans 8589945442 rc 0/0 00000100:00100000:2.0:1746147253.858409:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11442 00000100:00100000:0.0:1746147253.860830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.860915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.861262:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465721088 00000100:00100000:3.0:1746147253.861270:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465721088 00000100:00100000:0.0:1746147253.861286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.861959:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465721344 00000100:00100000:3.0:1746147253.861963:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465721344 00000100:00100000:3.0:1746147253.861991:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11443 00000100:00100000:3.0:1746147253.861997:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31843:x1830967465721088:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:0.0:1746147253.862007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147253.862016:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147253.862024:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465721728 00000100:00100000:0.0:1746147253.862027:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465721728 00010000:00010000:3.0:1746147253.862031:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9d5 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.862042:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11444 00000100:00100000:0.0:1746147253.862046:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31847:x1830967465721344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147253.862053:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.862058:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ee00/0xb4b2209fbdad0eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9dc expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.862105:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147253.862105:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147253.862115:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147253.862123:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147253.862124:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.862140:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1746147253.862140:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147253.862145:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.862168:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.862176:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 9 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.862185:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467042688:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147253.862223:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ee00/0xb4b2209fbdad0eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.862237:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.862243:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147253.862246:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147253.862247:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147253.862252:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147253.862256:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56ec00, rc 0) 00010000:00010000:3.0:1746147253.862263:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.862270:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 305 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.862276:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31847:x1830967465721344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 229us (989us total) trans 8589945443 rc 0/0 00000100:00100000:3.0:1746147253.862277:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467042816:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.862282:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11445 00000100:00100000:2.0:1746147253.862290:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31842:x1830967465721728:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:3.0:1746147253.862293:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b540 going to sleep for 11 seconds 00010000:00010000:2.0:1746147253.862298:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.862300:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147253.862306:0:14048:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 305 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.862308:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465721472 00000100:00100000:3.0:1746147253.862311:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465721472 00010000:00010000:2.0:1746147253.862318:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147253.862321:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.862326:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147253.862331:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.862336:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15596 00010000:00010000:2.0:1746147253.862338:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0eca lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9ea expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.862340:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31846:x1830967465721472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.862347:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.862356:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9e3 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.862359:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147253.862367:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.862368:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.862370:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.862372:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.862375:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.862378:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147253.862384:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.862389:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11444 00010000:00010000:3.0:1746147253.862391:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854c00, rc 0) 00010000:00010000:2.0:1746147253.862395:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.862402:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 305 pid: 23726 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.862406:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31846:x1830967465721472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 65us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.862408:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467042944:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147253.862410:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15596 00010000:00010000:2.0:1746147253.862433:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.862439:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 7 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.862446:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467043072:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.862457:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.864475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.864556:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467042944:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.864566:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467043072:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.864582:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147253.864677:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467042688:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.864687:0:14049:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from blocking AST (req@ffff88009e6f0e00 x1830967467042816) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 305 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.864698:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad0e76 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c7 expref: 305 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.864717:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467042816:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147253.864727:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147253.864731:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.864738:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147253.864743:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.864747:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147253.864752:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147253.864996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.865013:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.865029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.865452:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465721984 00000100:00100000:1.0:1746147253.865458:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465721984 00000100:00100000:1.0:1746147253.865488:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11446 00000100:00100000:1.0:1746147253.865494:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31846:x1830967465721984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.865508:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.865519:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9f1 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.865559:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147253.865565:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 11 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.865577:0:16361:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147253.865584:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 11 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.865593:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147253.865595:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147253.865597:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147253.865602:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ac5a00, rc 0) 00000100:00100000:1.0:1746147253.865634:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31846:x1830967465721984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 141us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.865639:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11446 00000100:00100000:0.0:1746147253.865795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.865895:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722112 00000100:00100000:2.0:1746147253.865899:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722112 00010000:00010000:2.0:1746147253.865916:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 305 pid: 23726 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.865955:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465721856 00000100:00100000:2.0:1746147253.865959:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465721856 00000100:00100000:3.0:1746147253.865967:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722240 00010000:00010000:2.0:1746147253.865969:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 11 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.865970:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722240 00010000:00010000:3.0:1746147253.865980:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 8 pid: 14125 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.865981:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7918 00000100:00100000:2.0:1746147253.865986:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1957:x1830967465722112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147253.865992:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7919 00010000:00010000:2.0:1746147253.865993:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147253.865996:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465721856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147253.865997:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 305 pid: 23726 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.866001:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.866003:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 11 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.866004:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 305 pid: 23726 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.866010:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 11 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746147253.866064:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7920 00000100:00100000:0.0:1746147253.866069:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465722240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147253.866075:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147253.866081:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 8 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.866191:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad0ebc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9dc expref: 305 pid: 23726 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.866194:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0e99 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ce expref: 11 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.866202:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147253.866205:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.866210:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.866216:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.866221:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147253.866226:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147253.866244:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 8 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.866254:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fe00/0xb4b2209fbdad0e5a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9c0 expref: 8 pid: 14125 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746147253.866261:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147253.866263:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147253.866267:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147253.866271:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147253.866276:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 10 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.866285:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147253.866300:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465722240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 232us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.866306:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7920 00000100:00100000:0.0:1746147253.866321:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722368 00000100:00100000:0.0:1746147253.866323:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722368 00000100:00100000:0.0:1746147253.866336:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11447 00000100:00100000:0.0:1746147253.866340:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:31847:x1830967465722368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147253.866348:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.866353:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad0ee6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9f8 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.866394:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147253.866399:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147253.866403:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147253.866409:0:23726:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 5/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147253.866414:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147253.866456:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147253.866458:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147253.866463:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147253.866468:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 10 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.866473:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147253.866477:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147253.866483:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.866492:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1957:x1830967465722112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 506us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.866494:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465721856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 498us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.866497:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7918 00000100:00100000:3.0:1746147253.866500:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7919 00010000:00010000:2.0:1746147253.866515:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147253.866519:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147253.866532:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147253.866537:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147253.866548:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147253.866642:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.866655:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 10 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.866661:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 10 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.866665:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855800, rc 0) 00000100:00100000:3.0:1746147253.866683:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31843:x1830967465721088:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4687us (5859us total) trans 8589945444 rc 0/0 00000100:00100000:3.0:1746147253.866688:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11443 00000040:00080000:2.0:1746147253.867603:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3413, 88 off285832 00000004:00080000:2.0:1746147253.867608:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640854670854ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.867641:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3410, 88 off285568 00000004:00080000:2.0:1746147253.867644:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640854707216ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868426:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3411, 88 off285656 00000004:00080000:2.0:1746147253.868430:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855492376ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868437:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3414, 88 off285920 00000004:00080000:2.0:1746147253.868439:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855502211ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868450:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3415, 88 off286008 00000004:00080000:2.0:1746147253.868452:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855515322ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868458:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3412, 88 off285744 00000004:00080000:2.0:1746147253.868461:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855523589ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868466:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3413, 88 off285832 00000004:00080000:2.0:1746147253.868468:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855530841ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868473:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3414, 88 off285920 00000004:00080000:2.0:1746147253.868475:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855537776ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868480:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3416, 88 off286096 00000004:00080000:2.0:1746147253.868482:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855544736ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868486:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3415, 88 off286008 00000004:00080000:2.0:1746147253.868489:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855551591ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868494:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3417, 88 off286184 00000004:00080000:2.0:1746147253.868495:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855558329ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868500:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3416, 88 off286096 00000004:00080000:2.0:1746147253.868502:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855565166ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147253.868507:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3418, 88 off286272 00000004:00080000:2.0:1746147253.868509:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855571376ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868513:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3419, 88 off286360 00000004:00080000:2.0:1746147253.868515:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855577786ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868520:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3420, 88 off286448 00000004:00080000:2.0:1746147253.868521:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855584254ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868526:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3421, 88 off286536 00000004:00080000:2.0:1746147253.868527:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640855590364ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147253.868532:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3417, 88 off286184 00000004:00080000:2.0:1746147253.868534:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 640855596612ns, next at 607576201812ns, rc = 0 00000100:00100000:1.0:1746147253.872721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.872917:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722496 00000100:00100000:1.0:1746147253.872926:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722496 00010000:00010000:1.0:1746147253.872974:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 10 pid: 14049 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746147253.873521:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7921 00000100:00100000:1.0:1746147253.873529:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465722496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.873555:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.873561:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 10 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.873572:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 10 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.873588:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad0eb5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9d5 expref: 10 pid: 14049 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746147253.873603:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147253.873607:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147253.873614:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147253.873620:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.873624:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147253.873628:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.873665:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465722496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 137us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.873671:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7921 00000001:00080000:0.0:1746147253.895527:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945443 is committed 00000001:00080000:0.0:1746147253.895538:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945445 is committed 00000004:00080000:0.0:1746147253.895541:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2544 committed 00000004:00080000:0.0:1746147253.895552:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2544 committed 00000004:00080000:0.0:1746147253.895557:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2543 committed 00000004:00080000:0.0:1746147253.895558:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2542 committed 00000004:00080000:0.0:1746147253.895561:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2541 committed 00000004:00080000:0.0:1746147253.895562:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2543 committed 00000004:00080000:0.0:1746147253.895563:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2540 committed 00000004:00080000:0.0:1746147253.895565:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2542 committed 00000004:00080000:0.0:1746147253.895566:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2539 committed 00000004:00080000:0.0:1746147253.895568:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2541 committed 00000004:00080000:0.0:1746147253.895569:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2540 committed 00000004:00080000:0.0:1746147253.895570:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2539 committed 00000004:00080000:0.0:1746147253.895572:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2538 committed 00000004:00080000:0.0:1746147253.895574:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2537 committed 00000004:00080000:0.0:1746147253.895575:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2538 committed 00000004:00080000:0.0:1746147253.895577:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2537 committed 00000004:00080000:0.0:1746147253.895578:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2536 committed 00000001:00080000:0.0:1746147253.895582:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945442 is committed 00000001:00080000:0.0:1746147253.895587:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945440 is committed 00000001:00080000:0.0:1746147253.895590:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945444 is committed 00000100:00100000:0.0:1746147253.895709:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467043328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.895756:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.895781:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467043200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.895799:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467043584:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147253.895853:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.895863:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147253.895865:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147253.895868:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147253.895875:0:14048:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147253.895879:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147253.895884:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 6 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.895890:0:14048:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 6 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.895895:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 6 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.895914:0:14048:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 6 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.895921:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467044224:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147253.895984:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147253.896195:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467043456:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147253.896694:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147253.896701:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147253.896732:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147253.896735:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147253.896747:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147253.896771:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad0ee6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.896787:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 304 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.896793:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147253.896795:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746147253.896797:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56f000, rc 0) 00000100:00100000:0.0:1746147253.896823:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31847:x1830967465722368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 30482us (31028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.896830:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11447 00000100:00100000:0.0:1746147253.896881:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467043840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.896899:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.896913:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467044480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.896926:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.896950:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467044992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.896965:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.896984:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043328 00000100:00100000:0.0:1746147253.896989:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043328 00000100:00100000:0.0:1746147253.897008:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043840 00000100:00100000:0.0:1746147253.897009:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043840 00000100:00100000:0.0:1746147253.897018:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044480 00000100:00100000:0.0:1746147253.897019:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044480 00000100:00100000:0.0:1746147253.897027:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044992 00000100:00100000:0.0:1746147253.897028:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044992 00000100:00100000:0.0:1746147253.897037:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15597 00000100:00100000:0.0:1746147253.897042:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3295:x1830967467043328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147253.897192:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147253.897196:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.897198:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.897200:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.897201:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147253.897221:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3295:x1830967467043328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (1465us total) trans 17179874029 rc 0/0 00000100:00100000:0.0:1746147253.897226:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15597 00000100:00100000:0.0:1746147253.897235:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15598 00000100:00100000:0.0:1746147253.897239:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3295:x1830967467043840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.897306:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3295:x1830967467043840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (406us total) trans 17179874030 rc 0/0 00000100:00100000:0.0:1746147253.897311:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15598 00000100:00100000:0.0:1746147253.897319:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15599 00000100:00100000:0.0:1746147253.897323:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3295:x1830967467044480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147253.897957:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.897977:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467043968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.897995:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.898005:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467044608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147253.898018:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147253.898025:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467045120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147253.898035:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.898157:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043456 00000100:00100000:2.0:1746147253.898162:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043456 00000100:00100000:2.0:1746147253.898176:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043968 00000100:00100000:2.0:1746147253.898177:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043968 00000100:00100000:2.0:1746147253.898183:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044608 00000100:00100000:2.0:1746147253.898184:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044608 00000100:00100000:2.0:1746147253.898190:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467045120 00000100:00100000:2.0:1746147253.898191:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467045120 00000100:00100000:2.0:1746147253.898198:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15600 00000100:00100000:2.0:1746147253.898203:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3295:x1830967467044992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147253.898302:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:2.0:1746147253.898305:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147253.898307:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147253.898309:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147253.898311:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:3.0:1746147253.898545:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15601 00000100:00100000:3.0:1746147253.898553:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967467043456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147253.898717:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147253.898720:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.898722:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.898724:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:0.0:1746147253.898725:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746147253.898880:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:3.0:1746147253.898883:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.898885:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.898886:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:3.0:1746147253.898888:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:0.0:1746147253.899166:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967467044480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1841us (2237us total) trans 21474841385 rc 0/0 00000100:00100000:0.0:1746147253.899172:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15599 00000100:00100000:2.0:1746147253.899182:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3295:x1830967467044992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 977us (2214us total) trans 21474841384 rc 0/0 00000100:00100000:0.0:1746147253.899185:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15602 00000100:00100000:3.0:1746147253.899187:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967467043456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 636us (1229us total) trans 17179874031 rc 0/0 00000100:00100000:2.0:1746147253.899188:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15600 00000100:00100000:0.0:1746147253.899191:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967467043968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.899273:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3296:x1830967467043968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1276us total) trans 17179874032 rc 0/0 00000100:00100000:3.0:1746147253.899345:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15601 00000100:00100000:2.0:1746147253.899350:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15603 00000100:00100000:2.0:1746147253.899356:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3296:x1830967467044608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147253.899433:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147253.899435:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899438:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899439:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899441:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147253.899442:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15604 00000100:00100000:3.0:1746147253.899448:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967467045120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.899461:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967467044608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (1441us total) trans 21474841386 rc 0/0 00000100:00100000:2.0:1746147253.899466:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15603 00000100:00100000:2.0:1746147253.899491:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.899516:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467043712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.899534:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.899546:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467044352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.899558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.899565:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467044864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.899576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.899583:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147253.899587:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467044736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.899596:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.899601:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467045248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.899611:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147253.899625:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043200 00000100:00100000:2.0:1746147253.899628:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043200 00000004:00080000:1.0:1746147253.899629:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044000/2, rc 0, transno 17179874031 00000100:00100000:2.0:1746147253.899638:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043712 00000100:00100000:1.0:1746147253.899638:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467043456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.899640:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043712 00000100:00100000:2.0:1746147253.899644:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044352 00000100:00100000:2.0:1746147253.899645:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044352 00000004:00080000:1.0:1746147253.899646:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 17179874032 00000100:00100000:1.0:1746147253.899648:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467043968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.899650:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044864 00000100:00100000:2.0:1746147253.899651:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044864 00000100:00100000:2.0:1746147253.899655:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044736 00000100:00100000:2.0:1746147253.899656:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044736 00000004:00080000:1.0:1746147253.899656:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f669180/2, rc 0, transno 21474841386 00000100:00100000:1.0:1746147253.899659:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467044608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147253.899660:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467045248 00000100:00100000:2.0:1746147253.899661:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467045248 00000100:00100000:2.0:1746147253.899667:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15605 00000100:00100000:2.0:1746147253.899670:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3294:x1830967467043200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.899694:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467045376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147253.899711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147253.899738:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147253.899741:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899743:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899744:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899746:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 1993 00000100:00100000:2.0:1746147253.899767:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3294:x1830967467043200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (275us total) trans 17179874033 rc 0/0 00000100:00100000:2.0:1746147253.899772:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15605 00000100:00100000:2.0:1746147253.899781:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467045376 00000100:00100000:2.0:1746147253.899783:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467045376 00000100:00100000:2.0:1746147253.899792:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15606 00000100:00100000:2.0:1746147253.899796:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3294:x1830967467043712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.899863:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3294:x1830967467043712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (328us total) trans 17179874034 rc 0/0 00000100:00100000:2.0:1746147253.899867:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15606 00000100:00100000:2.0:1746147253.899876:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15607 00000100:00100000:2.0:1746147253.899880:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467044352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.899885:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967467045120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 437us (1847us total) trans 21474841387 rc 0/0 00000100:00100000:3.0:1746147253.899891:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15604 00000100:00100000:3.0:1746147253.899901:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15608 00000100:00100000:3.0:1746147253.899906:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3294:x1830967467044864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.899920:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15602 00000100:00100000:0.0:1746147253.899933:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15609 00000100:00100000:0.0:1746147253.899951:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467044736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.899957:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15610 00000100:00100000:3.0:1746147253.899961:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467045248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.899963:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15611 00000100:00100000:0.0:1746147253.899966:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3294:x1830967467045376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147253.899973:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147253.899975:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899976:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899978:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147253 -> 1746147253 00002000:00010000:2.0:1746147253.899979:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147253.899998:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467044352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (438us total) trans 21474841388 rc 0/0 00000100:00100000:2.0:1746147253.900002:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15607 00000100:00100000:3.0:1746147253.900035:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467045248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (422us total) trans 21474841389 rc 0/0 00000100:00100000:0.0:1746147253.900038:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3294:x1830967467045376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (326us total) trans 17179874035 rc 0/0 00000100:00100000:3.0:1746147253.900040:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15610 00000100:00100000:0.0:1746147253.900043:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15611 00000100:00100000:3.0:1746147253.900056:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147253.900068:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f669880/2, rc 0, transno 21474841385 00000100:00100000:0.0:1746147253.900071:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467044480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147253.900073:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467044096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147253.900077:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f669f80/2, rc 0, transno 21474841384 00000100:00100000:0.0:1746147253.900080:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467044992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147253.900086:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046680/2, rc 0, transno 17179874029 00000100:00100000:3.0:1746147253.900088:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147253.900089:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467043328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147253.900094:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047800/2, rc 0, transno 17179874030 00000100:00100000:0.0:1746147253.900096:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467043840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.900105:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467043584 00000100:00100000:0.0:1746147253.900107:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467043584 00000100:00100000:3.0:1746147253.900114:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467044224:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147253.900117:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467044096 00000100:00100000:0.0:1746147253.900118:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467044096 00000100:00100000:0.0:1746147253.900144:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15612 00000100:00100000:0.0:1746147253.900148:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967467043584:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147253.900151:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73a00/0xb4b2209fbdad0eca lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 303 pid: 14048 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147253.900166:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147253.900175:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15613 00000100:00100000:2.0:1746147253.900181:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967467044096:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147253.900186:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0c00, rc 0) 00000100:00100000:3.0:1746147253.900213:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31842:x1830967465721728:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 37924us (38205us total) trans 8589945445 rc 0/0 00000100:00100000:3.0:1746147253.900218:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11445 00000100:00100000:0.0:1746147253.900225:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967467043584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (167us total) trans 17179874036 rc 0/0 00000100:00100000:0.0:1746147253.900233:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15612 00000004:00080000:3.0:1746147253.900242:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046d80/2, rc 0, transno 17179874036 00000100:00100000:3.0:1746147253.900245:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467043584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147253.900267:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967467044096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (177us total) trans 17179874037 rc 0/0 00000100:00100000:2.0:1746147253.900272:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15613 00000100:00100000:3.0:1746147253.900310:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009107ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467044864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 404us (733us total) trans 21474841390 rc 0/0 00000100:00100000:3.0:1746147253.900315:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15608 00000004:00080000:3.0:1746147253.900334:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047b80/2, rc 0, transno 17179874037 00000100:00100000:3.0:1746147253.900337:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467044096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.900356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:1.0:1746147253.900389:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f66bb80/2, rc 0, transno 21474841387 00000100:00100000:0.0:1746147253.900392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.900393:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467045120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147253.900404:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d5dd880/2, rc 0, transno 17179874035 00000100:00100000:1.0:1746147253.900407:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467045376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.900407:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722624 00000100:00100000:0.0:1746147253.900410:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722624 00000004:00080000:1.0:1746147253.900412:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f668e00/2, rc 0, transno 21474841389 00000100:00100000:1.0:1746147253.900414:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467045248:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147253.900420:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f668700/2, rc 0, transno 21474841388 00000100:00100000:1.0:1746147253.900422:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467044352:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147253.900426:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f66ad80/2, rc 0, transno 21474841390 00000100:00100000:0.0:1746147253.900427:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4781 00000100:00100000:1.0:1746147253.900428:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467044864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.900431:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31846:x1830967465722624:12345-192.168.203.36@tcp:49:cat.0 00000004:00080000:1.0:1746147253.900434:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045500/2, rc 0, transno 17179874033 00000100:00100000:1.0:1746147253.900437:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467043200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147253.900442:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047480/2, rc 0, transno 17179874034 00000100:00100000:1.0:1746147253.900444:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467043712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147253.900476:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31846:x1830967465722624:12345-192.168.203.36@tcp:49:cat.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.900480:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4781 00000100:00100000:3.0:1746147253.900510:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722752 00000100:00100000:3.0:1746147253.900514:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722752 00000100:00100000:1.0:1746147253.901105:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11448 00000100:00100000:1.0:1746147253.901112:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31847:x1830967465722752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.901121:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.901140:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614800/0xb4b2209fbdad0efb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ec9ff expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147253.901147:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467044736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1208us (1548us total) trans 21474841391 rc 0/0 00000100:00100000:0.0:1746147253.901152:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15609 00010000:00010000:1.0:1746147253.901185:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614800/0xb4b2209fbdad0efb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ff expref: 303 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.901222:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614800/0xb4b2209fbdad0efb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ff expref: 303 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.901234:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147253.901237:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147253.901274:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f614800, rc 0) 00000100:00100000:1.0:1746147253.901431:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31847:x1830967465722752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 319us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.901437:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11448 00000004:00080000:1.0:1746147253.901462:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f669500/2, rc 0, transno 21474841391 00000100:00100000:1.0:1746147253.901465:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467044736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147253.902881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.902970:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465722880 00000100:00100000:2.0:1746147253.902977:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465722880 00000100:00100000:2.0:1746147253.903017:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15614 00000100:00100000:2.0:1746147253.903022:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:31842:x1830967465722880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147253.903033:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.903046:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca06 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.903067:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.903075:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.903080:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.903082:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.903084:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [286720->491519] (req 286720->491519) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.903108:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.903119:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 21 pid: 4445 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746147253.903137:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467045504:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.903211:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.903219:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 10 pid: 17530 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.903554:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467045632:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147253.903761:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147253.904517:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467045504:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147253.908367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.908438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.908723:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723008 00000100:00100000:3.0:1746147253.908731:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723008 00000100:00100000:0.0:1746147253.908953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.909098:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 777 00000100:00100000:3.0:1746147253.909106:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967465723008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.909118:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.909147:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614800/0xb4b2209fbdad0efb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ff expref: 303 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.909161:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147253.909165:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147253.910609:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723136 00000100:00100000:2.0:1746147253.910615:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723136 00000100:00100000:2.0:1746147253.910641:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723264 00000100:00100000:2.0:1746147253.910643:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723264 00000100:00100000:2.0:1746147253.910656:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15615 00000100:00100000:2.0:1746147253.910662:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465723136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.910675:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.910688:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad0f09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca0d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.910703:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.910710:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad0f09 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca0d expref: 41 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.910719:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad0f09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca0d expref: 41 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.910728:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8c00, rc 0) 00000100:00100000:2.0:1746147253.910762:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465723136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 100us (2322us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147253.910767:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15615 00000100:00100000:2.0:1746147253.910781:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15616 00000100:00100000:2.0:1746147253.910785:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465723264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147253.910792:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147253.910799:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca14 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.910808:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.910810:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147253.910815:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.910826:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147253.910833:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9a00, rc 0) 00000100:00100000:2.0:1746147253.910844:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465723264:12345-192.168.203.36@tcp:101:cat.0 Request processed in 59us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.910849:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15616 00000100:00100000:0.0:1746147253.910881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.910926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.911159:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723392 00000100:00100000:1.0:1746147253.911162:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723392 00000100:00100000:1.0:1746147253.911178:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723776 00000100:00100000:1.0:1746147253.911180:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723776 00000100:00100000:1.0:1746147253.911191:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15617 00000100:00100000:1.0:1746147253.911195:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465723392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.911202:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.911208:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca1b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.911219:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.911220:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.911224:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.911232:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.911239:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f614200, rc 0) 00000100:00100000:1.0:1746147253.911254:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465723392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 59us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.911259:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15617 00000100:00100000:1.0:1746147253.911271:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15618 00000100:00100000:1.0:1746147253.911275:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465723776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147253.911280:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147253.911285:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca22 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147253.911293:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.911294:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147253.911297:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 41 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.911305:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 41 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147253.911311:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f614600, rc 0) 00000100:00100000:1.0:1746147253.911323:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465723776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.911328:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15618 00000100:00100000:0.0:1746147253.911396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.911421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.911462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.911503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.911516:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723904 00000100:00100000:0.0:1746147253.911519:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723904 00000100:00100000:0.0:1746147253.911547:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465724032 00000100:00100000:0.0:1746147253.911550:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465724032 00000100:00100000:0.0:1746147253.911562:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15619 00000100:00100000:0.0:1746147253.911566:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967465723904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147253.911572:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.911578:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca29 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.911587:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.911588:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.911592:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 42 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.911600:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 42 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.911607:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56f200, rc 0) 00000100:00100000:0.0:1746147253.911624:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465723904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.911629:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15619 00000100:00100000:0.0:1746147253.911639:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15620 00000100:00100000:0.0:1746147253.911643:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465724032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147253.911648:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147253.911653:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca30 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147253.911662:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.911663:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147253.911666:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.911674:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147253.911681:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56ea00, rc 0) 00000100:00100000:0.0:1746147253.911692:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465724032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147253.911696:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15620 00000100:00100000:1.0:1746147253.911844:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465724160 00000100:00100000:1.0:1746147253.911847:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465724160 00010000:00010000:1.0:1746147253.911860:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 11 pid: 17530 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746147253.911876:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7922 00000100:00100000:1.0:1746147253.911880:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465724160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147253.911887:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147253.911903:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 11 pid: 17530 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.911911:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 11 pid: 17530 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746147253.911923:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147253.911955:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465724160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147253.911960:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7922 00000100:00100000:3.0:1746147253.912032:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1956:x1830967465723008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2926us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.912038:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 777 00000100:00100000:2.0:1746147253.912508:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465723648 00000100:00100000:2.0:1746147253.912512:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465723648 00002000:00100000:2.0:1746147253.912534:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012df74a80 x1830967465723648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.912542:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74a80 with x1830967465723648 ext(0->1048575) 00010000:00010000:2.0:1746147253.912547:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.912556:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.912971:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df74a80 00000100:00100000:2.0:1746147253.912999:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2530 00000100:00100000:2.0:1746147253.913006:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465723648:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147253.914784:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a0e00/0xb4b2209fbdad0dea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec996 expref: 10 pid: 17530 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746147253.914803:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467045632:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147253.914826:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [286720->491519] (req 286720->491519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 41 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147253.914838:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8200, rc 0) 00000100:00100000:2.0:1746147253.914880:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:31842:x1830967465722880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11857us (12003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147253.914887:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15614 00000100:00100000:2.0:1746147253.918148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.918174:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465724288 00000100:00100000:3.0:1746147253.918182:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465724288 00000100:00100000:3.0:1746147253.918215:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15621 00000100:00100000:3.0:1746147253.918222:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:31847:x1830967465724288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.918236:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.918250:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca37 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.918271:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.918276:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [286720->491519] (req 286720->491519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.918286:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147253.918289:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 42 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.918315:0:4444:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [286720->491519] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.918327:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 42 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.918336:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855400, rc 0) 00000100:00100000:3.0:1746147253.919204:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:31847:x1830967465724288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 980us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.919211:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15621 00000100:00100000:2.0:1746147253.924113:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465723648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11100us (12709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.924122:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2530 00002000:00100000:2.0:1746147253.924139:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012df74a80 x1830967465723648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.924147:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74a80 with x1830967465723648 ext(0->1048575) 00010000:00010000:2.0:1746147253.924155:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.924166:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.924177:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df74a80 00000100:00100000:0.0:1746147253.932088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.932233:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465724416 00000100:00100000:3.0:1746147253.932240:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465724416 00000100:00100000:3.0:1746147253.932329:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15622 00000100:00100000:3.0:1746147253.932337:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31846:x1830967465724416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.932351:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.932365:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca3e expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.932385:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.932387:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.932394:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.932412:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.932421:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854a00, rc 0) 00000100:00100000:3.0:1746147253.933673:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31846:x1830967465724416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1332us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.933680:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15622 00000100:00100000:2.0:1746147253.933853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.934109:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465724544 00000100:00100000:3.0:1746147253.934114:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465724544 00010000:00010000:3.0:1746147253.934144:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.934173:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7923 00000100:00100000:3.0:1746147253.934178:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465724544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.934188:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.934208:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.934219:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.934235:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad0ed1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9e3 expref: 22 pid: 4445 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.934249:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.934251:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.934257:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 41 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.934264:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 41 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.934289:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 41 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.934299:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 41 pid: 4444 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.934309:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467045888:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147253.934381:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147253.936541:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467045888:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147253.936569:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.936628:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465724544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2448us (2774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.936638:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7923 00000100:00100000:0.0:1746147253.937044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147253.937138:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465724800 00000100:00100000:2.0:1746147253.937150:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465724800 00002000:00100000:2.0:1746147253.937192:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (286720->290815) req@ffff88012df77480 x1830967465724800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.937201:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77480 with x1830967465724800 ext(286720->290815) 00010000:00010000:2.0:1746147253.937209:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.937223:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.937230:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df77480 00000100:00100000:2.0:1746147253.937599:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2531 00000100:00100000:2.0:1746147253.937607:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465724800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147253.937767:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465724800:12345-192.168.203.36@tcp:3:cat.0 Request processed in 161us (724us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147253.937774:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2531 00002000:00100000:2.0:1746147253.937779:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (286720->290815) req@ffff88012df77480 x1830967465724800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.937786:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77480 with x1830967465724800 ext(286720->290815) 00010000:00010000:2.0:1746147253.937790:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746147253.937804:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746147253.937809:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df77480 00000100:00100000:0.0:1746147253.938044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.938074:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465725056 00000100:00100000:1.0:1746147253.938080:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465725056 00002000:00100000:1.0:1746147253.938101:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df77800 x1830967465725056/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.938108:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77800 with x1830967465725056 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.938112:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df77800 00000100:00100000:1.0:1746147253.938168:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7368 00000100:00100000:1.0:1746147253.938174:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465725056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.941932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.942036:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465725312 00000100:00100000:3.0:1746147253.942047:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465725312 00002000:00100000:3.0:1746147253.942092:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (487424->491519) req@ffff88012df74380 x1830967465725312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.942102:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74380 with x1830967465725312 ext(487424->491519) 00010000:00010000:3.0:1746147253.942112:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.942143:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.942149:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df74380 00000100:00100000:3.0:1746147253.942173:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2532 00000100:00100000:3.0:1746147253.942180:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967465725312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.942344:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967465725312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 164us (421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147253.942351:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2532 00002000:00100000:3.0:1746147253.942356:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (487424->491519) req@ffff88012df74380 x1830967465725312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.942363:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74380 with x1830967465725312 ext(487424->491519) 00010000:00010000:3.0:1746147253.942372:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.942380:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.942386:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df74380 00000100:00100000:0.0:1746147253.947537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.947617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.948339:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465725568 00000100:00100000:3.0:1746147253.948349:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465725568 00002000:00100000:3.0:1746147253.948398:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (286720->491519) req@ffff88012df77b80 x1830967465725568/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.948408:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77b80 with x1830967465725568 ext(286720->491519) 00010000:00010000:3.0:1746147253.948418:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.948433:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 42 pid: 4444 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.948441:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df77b80 00000100:00100000:3.0:1746147253.948486:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2533 00000100:00100000:3.0:1746147253.948496:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967465725568:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147253.949194:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465725824 00000100:00100000:2.0:1746147253.949200:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465725824 00000100:00100000:2.0:1746147253.949254:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4782 00000100:00100000:2.0:1746147253.949262:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:31842:x1830967465725824:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147253.949577:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31842:x1830967465725824:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 313us (1958us total) trans 8589945446 rc 0/0 00000100:00100000:2.0:1746147253.949585:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4782 00000100:00100000:1.0:1746147253.950839:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465725056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12656us (12788us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.950850:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7368 00002000:00100000:1.0:1746147253.950860:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df77800 x1830967465725056/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.950869:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77800 with x1830967465725056 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.950874:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df77800 00000100:00100000:3.0:1746147253.953581:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967465725568:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5075us (6047us total) trans 17179874038 rc 0/0 00000100:00100000:3.0:1746147253.953592:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2533 00002000:00100000:3.0:1746147253.953606:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (286720->491519) req@ffff88012df77b80 x1830967465725568/t17179874038(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/448 e 0 to 0 dl 1746147264 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.953615:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77b80 with x1830967465725568 ext(286720->491519) 00010000:00010000:3.0:1746147253.953627:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 44 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.953643:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 44 pid: 4444 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746147253.953650:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df77b80 00000100:00100000:0.0:1746147253.958237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.958336:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465725952 00000100:00100000:3.0:1746147253.958347:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465725952 00010000:00010000:3.0:1746147253.958389:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 44 pid: 4444 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746147253.958434:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7924 00000100:00100000:3.0:1746147253.958441:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465725952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147253.958456:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147253.958478:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 44 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.958490:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 44 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.958513:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->491519) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca06 expref: 44 pid: 4444 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746147253.958749:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.958753:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.958760:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 43 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.958769:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 43 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.958807:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 43 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147253.958821:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467046016:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147253.958911:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147253.960160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.960236:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465726080 00000100:00100000:3.0:1746147253.960242:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465726080 00000100:00100000:3.0:1746147253.960284:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15623 00000100:00100000:3.0:1746147253.960291:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31846:x1830967465726080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.960306:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.960321:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca45 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.960340:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.960342:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.960349:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.960360:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.960368:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855200, rc 0) 00000100:00100000:3.0:1746147253.960397:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31846:x1830967465726080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.960402:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15623 00000100:00100000:3.0:1746147253.962021:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467046016:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147253.962043:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147253.962404:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465725952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3960us (4172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.962413:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7924 00000100:00100000:0.0:1746147253.964172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.964535:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465726336 00000100:00100000:3.0:1746147253.964544:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465726336 00002000:00100000:3.0:1746147253.964596:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012df76300 x1830967465726336/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.964607:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76300 with x1830967465726336 ext(1048576->2097151) 00002000:00010000:3.0:1746147253.964613:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76300 00000100:00100000:3.0:1746147253.964655:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7369 00000100:00100000:3.0:1746147253.964665:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465726336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.972178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.972254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.972286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147253.972326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147253.972504:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465726592 00000100:00100000:1.0:1746147253.972516:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465726592 00002000:00100000:1.0:1746147253.972562:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012df74000 x1830967465726592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.972578:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74000 with x1830967465726592 ext(0->1048575) 00000100:00100000:2.0:1746147253.972579:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465726848 00002000:00010000:1.0:1746147253.972584:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df74000 00000100:00100000:2.0:1746147253.972591:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465726848 00002000:00100000:2.0:1746147253.972632:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df75180 x1830967465726848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.972642:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df75180 with x1830967465726848 ext(1048576->2097151) 00002000:00010000:2.0:1746147253.972648:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df75180 00000100:00100000:1.0:1746147253.972696:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465727104 00000100:00100000:1.0:1746147253.972700:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465727104 00002000:00100000:1.0:1746147253.972715:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f668380 x1830967465727104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.972728:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668380 with x1830967465727104 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.972732:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f668380 00000100:00100000:2.0:1746147253.972737:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465727360 00000100:00100000:2.0:1746147253.972741:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465727360 00000100:00100000:3.0:1746147253.972745:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7370 00000100:00100000:1.0:1746147253.972755:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7371 00002000:00100000:2.0:1746147253.972757:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009f66b100 x1830967465727360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/0 e 0 to 0 dl 1746147264 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147253.972758:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465726592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147253.972761:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465726848:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147253.972764:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b100 with x1830967465727360 ext(1048576->2097151) 00002000:00010000:2.0:1746147253.972767:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66b100 00000100:00100000:2.0:1746147253.972782:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7372 00000100:00100000:2.0:1746147253.972790:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465727104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147253.972857:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7373 00000100:00100000:0.0:1746147253.972864:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465727360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147253.979982:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465726336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15308us (15805us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.979995:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7369 00002000:00100000:3.0:1746147253.980007:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012df76300 x1830967465726336/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.980018:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76300 with x1830967465726336 ext(1048576->2097151) 00002000:00010000:3.0:1746147253.980024:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76300 00000100:00100000:3.0:1746147253.982108:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465726592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9347us (9933us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147253.982119:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7370 00002000:00100000:3.0:1746147253.982128:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012df74000 x1830967465726592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147253.982150:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74000 with x1830967465726592 ext(0->1048575) 00002000:00010000:3.0:1746147253.982155:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df74000 00000100:00100000:1.0:1746147253.986298:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465726848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13529us (14035us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147253.986308:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7371 00002000:00100000:1.0:1746147253.986317:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df75180 x1830967465726848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147253.986325:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df75180 with x1830967465726848 ext(1048576->2097151) 00002000:00010000:1.0:1746147253.986330:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df75180 00000100:00100000:2.0:1746147253.990239:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465727360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17367us (17905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.990251:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7373 00002000:00100000:2.0:1746147253.990260:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009f66b100 x1830967465727360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.990270:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b100 with x1830967465727360 ext(1048576->2097151) 00002000:00010000:2.0:1746147253.990275:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66b100 00000100:00100000:2.0:1746147253.991900:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465727104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19106us (19608us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147253.991908:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7372 00002000:00100000:2.0:1746147253.991915:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f668380 x1830967465727104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:629/0 lens 488/440 e 0 to 0 dl 1746147264 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147253.991923:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668380 with x1830967465727104 ext(1048576->2097151) 00002000:00010000:2.0:1746147253.991927:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f668380 00000100:00100000:0.0:1746147253.992454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147253.992961:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465727488 00000100:00100000:3.0:1746147253.992968:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465727488 00000100:00100000:3.0:1746147253.993006:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15624 00000100:00100000:3.0:1746147253.993012:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31846:x1830967465727488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147253.993025:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147253.993038:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca4c expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.993058:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.993059:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147253.993065:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.993145:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147253.993155:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855a00, rc 0) 00000100:00100000:3.0:1746147253.993333:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31846:x1830967465727488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 320us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147253.993338:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15624 00010000:00010000:2.0:1746147253.997314:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147254.000190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.001061:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465727744 00000100:00100000:2.0:1746147254.001074:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465727744 00002000:00100000:2.0:1746147254.001118:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009fb70380 x1830967465727744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.001128:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70380 with x1830967465727744 ext(1048576->2097151) 00002000:00010000:2.0:1746147254.001140:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70380 00000100:00100000:2.0:1746147254.001165:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7374 00000100:00100000:2.0:1746147254.001172:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465727744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.009333:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465727744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8154us (9145us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.009343:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7374 00002000:00100000:2.0:1746147254.009353:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009fb70380 x1830967465727744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.009362:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70380 with x1830967465727744 ext(1048576->2097151) 00002000:00010000:2.0:1746147254.009367:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70380 00000100:00100000:0.0:1746147254.014207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.014249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.014273:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465727872 00000100:00100000:3.0:1746147254.014280:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465727872 00000100:00100000:3.0:1746147254.014320:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465728000 00000100:00100000:3.0:1746147254.014323:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465728000 00000100:00100000:3.0:1746147254.014336:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15625 00000100:00100000:3.0:1746147254.014342:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31843:x1830967465727872:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147254.014355:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.014371:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca53 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.014374:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15626 00000100:00100000:2.0:1746147254.014382:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465728000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.014395:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.014397:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.014402:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca5a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.014404:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.014411:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 42 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.014411:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.014413:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.014415:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.014416:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.014417:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.014419:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.014428:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.014434:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1800, rc 0) 00010000:00010000:3.0:1746147254.014442:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 42 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.014452:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 42 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.014463:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046144:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.014464:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465728000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.014468:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15626 00000100:00100000:1.0:1746147254.014484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.014496:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465728128 00000100:00100000:2.0:1746147254.014498:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465728128 00000100:00100000:2.0:1746147254.014510:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15627 00000100:00100000:2.0:1746147254.014512:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465728128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.014516:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.014516:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.014520:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca61 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.014523:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.014527:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.014528:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147254.014530:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046272:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.014530:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.014535:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.014539:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1000, rc 0) 00000100:00100000:2.0:1746147254.014549:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465728128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 37us (67us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147254.014552:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147254.014552:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15627 00010000:00010000:3.0:1746147254.014559:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 9 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.014565:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046400:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.014580:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.014686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.014894:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465728256 00000100:00100000:0.0:1746147254.014898:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465728256 00000100:00100000:0.0:1746147254.014915:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15628 00000100:00100000:0.0:1746147254.014919:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465728256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.014926:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.014958:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca68 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.014970:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.014972:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.014976:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.014987:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.014994:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab30400, rc 0) 00000100:00100000:0.0:1746147254.015015:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465728256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.015020:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15628 00000100:00100000:0.0:1746147254.020514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.020546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.020571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.020587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.020600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.020643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.020670:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465729280 00000100:00100000:0.0:1746147254.020680:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465729280 00010000:00010000:0.0:1746147254.020714:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 26 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.020737:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465729408 00000100:00100000:0.0:1746147254.020739:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465729408 00010000:00010000:0.0:1746147254.020753:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 10 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.020766:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7925 00000100:00100000:0.0:1746147254.020771:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465729280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.020784:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147254.020804:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 26 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.020814:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 26 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.020839:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.020878:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465729280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.020885:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7925 00000100:00100000:0.0:1746147254.020900:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7926 00000100:00100000:0.0:1746147254.020905:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465729408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.020910:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147254.020916:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 10 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.020930:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 10 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.020968:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.020980:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465729408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.020985:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7926 00000100:00080000:0.0:1746147254.021021:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147254.021034:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465728512 00000100:00100000:3.0:1746147254.021044:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465728512 00000100:00080000:0.0:1746147254.021102:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1746147254.021110:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009fb73100 x1830967465728512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147254.021117:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465728768 00000100:00100000:0.0:1746147254.021120:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465728768 00002000:00100000:3.0:1746147254.021122:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb73100 with x1830967465728512 ext(2097152->3145727) 00002000:00010000:3.0:1746147254.021126:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb73100 00000100:00100000:3.0:1746147254.021149:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465729024 00000100:00100000:3.0:1746147254.021152:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465729024 00002000:00100000:0.0:1746147254.021152:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009fb70a80 x1830967465728768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.021160:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70a80 with x1830967465728768 ext(3145728->4194303) 00002000:00010000:0.0:1746147254.021166:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70a80 00002000:00100000:3.0:1746147254.021177:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009fb72d80 x1830967465729024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00080000:0.0:1746147254.021178:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746147254.021184:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb72d80 with x1830967465729024 ext(2097152->3145727) 00000100:00100000:0.0:1746147254.021184:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465729536 00000100:00100000:0.0:1746147254.021186:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465729536 00002000:00010000:3.0:1746147254.021187:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb72d80 00002000:00100000:0.0:1746147254.021197:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009fb71180 x1830967465729536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.021203:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71180 with x1830967465729536 ext(3145728->4194303) 00000100:00100000:3.0:1746147254.021205:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7375 00002000:00010000:0.0:1746147254.021206:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb71180 00000100:00100000:3.0:1746147254.021211:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967465728512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.021221:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7376 00000100:00100000:0.0:1746147254.021225:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967465728768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.021972:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7377 00000100:00100000:2.0:1746147254.021982:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465729024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147254.022368:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7378 00000100:00100000:3.0:1746147254.022378:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465729536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.023252:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046144:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.023267:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093855a00/0xb4b2209fbdad0f48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca4c expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.023291:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046272:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.023327:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b207400/0xb4b2209fbdad0dff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ab expref: 9 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.023337:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046400:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.023366:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.023378:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855c00, rc 0) 00000100:00100000:2.0:1746147254.023404:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31843:x1830967465727872:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9062us (9203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.023410:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15625 00000100:00100000:1.0:1746147254.027279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.027717:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465729664 00000100:00100000:3.0:1746147254.027728:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465729664 00010000:00010000:3.0:1746147254.027767:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 47 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.027812:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7927 00000100:00100000:3.0:1746147254.027819:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465729664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.027832:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.027853:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 47 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.027863:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 47 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.027882:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f614600/0xb4b2209fbdad0f1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca22 expref: 47 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.027908:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.027910:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.027916:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.027924:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.027991:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.028002:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467046528:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147254.028067:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.029592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.030034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.030118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.030225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.030508:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465730048 00000100:00100000:2.0:1746147254.030510:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465730560 00000100:00100000:1.0:1746147254.030516:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465730048 00000100:00100000:2.0:1746147254.030518:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465730560 00002000:00100000:1.0:1746147254.030551:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134f33b80 x1830967465730048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.030552:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e6f3100 x1830967465730560/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.030560:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33b80 with x1830967465730048 ext(2097152->3145727) 00002000:00100000:2.0:1746147254.030561:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3100 with x1830967465730560 ext(3145728->4194303) 00002000:00010000:2.0:1746147254.030565:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f3100 00002000:00010000:1.0:1746147254.030565:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f33b80 00000100:00100000:1.0:1746147254.030583:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465730176 00000100:00100000:1.0:1746147254.030585:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465730176 00000100:00100000:2.0:1746147254.030589:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465730432 00000100:00100000:2.0:1746147254.030592:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465730432 00002000:00100000:1.0:1746147254.030597:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009e6f2300 x1830967465730176/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.030603:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f0700 x1830967465730432/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.030608:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2300 with x1830967465730176 ext(3145728->4194303) 00002000:00100000:2.0:1746147254.030609:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0700 with x1830967465730432 ext(2097152->3145727) 00000100:00100000:0.0:1746147254.030610:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7379 00002000:00010000:1.0:1746147254.030611:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f2300 00002000:00010000:2.0:1746147254.030612:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0700 00000100:00100000:0.0:1746147254.030621:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465730048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.030626:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7380 00000100:00100000:1.0:1746147254.030633:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465730560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.030637:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7381 00000100:00100000:2.0:1746147254.030643:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465730176:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.030694:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7382 00000100:00100000:0.0:1746147254.030700:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465730432:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.038733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.038970:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467046528:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147254.038995:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.039049:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465729664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 11229us (11778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.039058:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7927 00000100:00100000:2.0:1746147254.039078:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967465728512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17865us (18571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.039087:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7375 00002000:00100000:2.0:1746147254.039099:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009fb73100 x1830967465728512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.039107:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb73100 with x1830967465728512 ext(2097152->3145727) 00002000:00010000:2.0:1746147254.039112:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb73100 00000100:00100000:2.0:1746147254.039139:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465730944 00000100:00100000:2.0:1746147254.039146:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465730944 00002000:00100000:2.0:1746147254.039174:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1507328->1511423) req@ffff88008d5dea00 x1830967465730944/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.039181:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967465730944 ext(1507328->1511423) 00002000:00010000:2.0:1746147254.039183:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dea00 00000100:00100000:3.0:1746147254.040872:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7383 00000100:00100000:3.0:1746147254.040884:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465730944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147254.041028:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465730944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 148us (2307us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147254.041032:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7383 00002000:00100000:3.0:1746147254.041038:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x425:0x0] (1507328->1511423) req@ffff88008d5dea00 x1830967465730944/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.041043:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967465730944 ext(1507328->1511423) 00002000:00010000:3.0:1746147254.041047:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dea00 00000100:00100000:1.0:1746147254.041422:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465729024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19438us (20844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.041432:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7377 00002000:00100000:1.0:1746147254.041439:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009fb72d80 x1830967465729024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.041448:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb72d80 with x1830967465729024 ext(2097152->3145727) 00002000:00010000:1.0:1746147254.041452:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb72d80 00000100:00100000:3.0:1746147254.049177:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465729536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26793us (28566us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.049188:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7378 00002000:00100000:3.0:1746147254.049198:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009fb71180 x1830967465729536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.049206:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71180 with x1830967465729536 ext(3145728->4194303) 00002000:00010000:3.0:1746147254.049211:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb71180 00000100:00100000:1.0:1746147254.049378:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967465728768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28145us (28824us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.049388:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7376 00002000:00100000:1.0:1746147254.049397:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009fb70a80 x1830967465728768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.049406:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70a80 with x1830967465728768 ext(3145728->4194303) 00002000:00010000:1.0:1746147254.049411:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70a80 00000100:00100000:2.0:1746147254.053714:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465730176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23062us (23588us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.053725:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7381 00002000:00100000:2.0:1746147254.053735:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009e6f2300 x1830967465730176/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.053744:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2300 with x1830967465730176 ext(3145728->4194303) 00002000:00010000:2.0:1746147254.053748:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f2300 00000100:00100000:2.0:1746147254.059666:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465730432:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28953us (29427us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.059680:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7382 00002000:00100000:2.0:1746147254.059694:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f0700 x1830967465730432/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.059708:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0700 with x1830967465730432 ext(2097152->3145727) 00002000:00010000:2.0:1746147254.059715:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0700 00000100:00100000:0.0:1746147254.063484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.063596:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465731072 00000100:00100000:3.0:1746147254.063606:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465731072 00000100:00100000:3.0:1746147254.063663:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15629 00000100:00100000:3.0:1746147254.063670:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465731072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.063683:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.063696:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b53c00/0xb4b2209fbdad0f6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca6f expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.063739:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046656:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.063817:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.064460:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465730560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 33826us (34431us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.064472:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7380 00002000:00100000:1.0:1746147254.064482:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e6f3100 x1830967465730560/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.064491:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3100 with x1830967465730560 ext(3145728->4194303) 00002000:00010000:1.0:1746147254.064497:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f3100 00000100:00100000:3.0:1746147254.068849:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046656:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147254.068878:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b53c00/0xb4b2209fbdad0f6b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca6f expref: 43 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.068889:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b53c00/0xb4b2209fbdad0f6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca6f expref: 43 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.068915:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53c00, rc 0) 00000100:00100000:3.0:1746147254.068973:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465731072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5303us (5497us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.068980:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15629 00000100:00100000:1.0:1746147254.069454:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465730048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 38835us (39867us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.069462:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7379 00002000:00100000:1.0:1746147254.069469:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134f33b80 x1830967465730048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.069477:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33b80 with x1830967465730048 ext(2097152->3145727) 00002000:00010000:1.0:1746147254.069481:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f33b80 00000100:00100000:1.0:1746147254.074145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.074195:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465731328 00000100:00100000:2.0:1746147254.074203:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465731328 00002000:00100000:2.0:1746147254.074240:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88008d5de300 x1830967465731328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.074249:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967465731328 ext(4194304->4976639) 00002000:00010000:2.0:1746147254.074254:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5de300 00000100:00100000:2.0:1746147254.074274:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7384 00000100:00100000:2.0:1746147254.074281:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967465731328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.074643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.074692:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465731456 00000100:00100000:3.0:1746147254.074696:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465731456 00000100:00100000:3.0:1746147254.074728:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15630 00000100:00100000:3.0:1746147254.074733:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31843:x1830967465731456:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147254.074741:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.074754:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca76 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.074773:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.074781:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.074786:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 43 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.074791:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.074792:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.074795:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.074817:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 43 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.074826:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 43 pid: 8481 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.074836:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046784:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.074912:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.074921:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.075180:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046912:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.075232:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.075240:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 8 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.075248:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467047040:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.075263:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.078885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.079018:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046784:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.079028:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467046912:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.079094:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465731712 00000100:00100000:1.0:1746147254.079100:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465731712 00002000:00100000:1.0:1746147254.079146:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009fb72a00 x1830967465731712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.079156:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb72a00 with x1830967465731712 ext(4194304->4976639) 00010000:00010000:1.0:1746147254.079164:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 26 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.079174:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 26 pid: 4445 timeout: 741 lvb_type: 1 00002000:00010000:1.0:1746147254.079180:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb72a00 00000100:00100000:1.0:1746147254.079209:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2534 00000100:00100000:1.0:1746147254.079217:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465731712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.080179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.080265:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465731840 00000100:00100000:2.0:1746147254.080269:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465731840 00010000:00010000:2.0:1746147254.080289:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 9 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.080306:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7928 00000100:00100000:2.0:1746147254.080311:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465731840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.080324:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.080335:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 9 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.080347:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 9 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.080354:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467047040:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.080362:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b207200/0xb4b2209fbdad0e06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b2 expref: 9 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.080379:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.080386:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147254.080393:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53e00, rc 0) 00000100:00100000:2.0:1746147254.080406:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465731840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.080411:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7928 00000100:00100000:3.0:1746147254.080413:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31843:x1830967465731456:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5680us (5771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.080419:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15630 00000100:00100000:2.0:1746147254.083987:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967465731328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9572us (9725us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147254.084051:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7384 00002000:00100000:2.0:1746147254.084065:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88008d5de300 x1830967465731328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.084074:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967465731328 ext(4194304->4976639) 00010000:00010000:2.0:1746147254.084088:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 42 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.084100:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 42 pid: 8481 timeout: 741 lvb_type: 1 00002000:00010000:2.0:1746147254.084107:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5de300 00000100:00100000:1.0:1746147254.084160:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465731712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 4934us (5274us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147254.084168:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2534 00002000:00100000:1.0:1746147254.084177:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009fb72a00 x1830967465731712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.084185:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb72a00 with x1830967465731712 ext(4194304->4976639) 00010000:00010000:1.0:1746147254.084193:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.084208:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00002000:00010000:1.0:1746147254.084214:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb72a00 00000100:00100000:0.0:1746147254.088811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.088846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.088894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.088896:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465731968 00000100:00100000:3.0:1746147254.088906:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465731968 00000100:00100000:0.0:1746147254.088915:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732096 00000100:00100000:0.0:1746147254.088921:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732096 00000100:00100000:3.0:1746147254.089170:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732224 00000100:00100000:3.0:1746147254.089173:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732224 00000100:00100000:0.0:1746147254.089338:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15631 00000100:00100000:0.0:1746147254.089348:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465731968:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147254.089349:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15632 00000100:00100000:3.0:1746147254.089355:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15633 00000100:00100000:2.0:1746147254.089358:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465732096:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147254.089359:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465732224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.089371:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.089381:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.089382:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.089389:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab30200/0xb4b2209fbdad0f79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca7d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.089394:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b52e00/0xb4b2209fbdad0f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca8b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.089394:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad0f87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca84 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.089412:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.089416:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.089431:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab30200/0xb4b2209fbdad0f79 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca7d expref: 26 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.089433:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b52e00/0xb4b2209fbdad0f80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca8b expref: 45 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147254.089433:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467047168:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147254.089441:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab30200/0xb4b2209fbdad0f79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca7d expref: 26 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.089442:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b52e00/0xb4b2209fbdad0f80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca8b expref: 45 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.089456:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab30200, rc 0) 00010000:00010000:3.0:1746147254.089458:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b52e00, rc 0) 00000100:00100000:3.0:1746147254.089482:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967465732224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 123us (588us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.089488:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15633 00000100:00100000:0.0:1746147254.089488:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465731968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (686us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147254.089494:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15631 00000100:00100000:2.0:1746147254.089572:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.090650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.092051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.092291:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732352 00000100:00100000:2.0:1746147254.092300:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732352 00000100:00100000:3.0:1746147254.092332:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732480 00010000:00010000:2.0:1746147254.092337:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.092343:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732480 00000100:00100000:2.0:1746147254.092363:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7929 00000100:00100000:2.0:1746147254.092369:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465732352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.092374:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 44 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.092385:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147254.092402:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7930 00010000:00010000:2.0:1746147254.092405:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.092409:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967465732480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.092415:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.092421:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.092435:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1000/0xb4b2209fbdad0f5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca61 expref: 25 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.092438:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 44 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.092596:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 44 pid: 8481 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.092781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.092993:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467047168:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147254.093049:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732608 00000100:00100000:0.0:1746147254.093052:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732608 00010000:00010000:2.0:1746147254.093103:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.093159:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465732352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 789us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.093169:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7929 00010000:00010000:3.0:1746147254.093226:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56f200/0xb4b2209fbdad0f25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca29 expref: 44 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.093239:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.093241:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.093247:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.093255:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.093358:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad0f87 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca84 expref: 43 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.093370:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad0f87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca84 expref: 43 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.093389:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9800, rc 0) 00000100:00100000:1.0:1746147254.093411:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967465732096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4055us (4564us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147254.093420:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15632 00000100:00100000:1.0:1746147254.093459:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15634 00000100:00100000:1.0:1746147254.093463:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31846:x1830967465732608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147254.093475:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.093485:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca92 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.094067:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.094076:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147254.094078:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147254.094082:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.094108:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.094119:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.094140:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.094140:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467047424:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.094156:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.094168:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467047296:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147254.094210:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.094224:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.096407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.096448:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732736 00000100:00100000:0.0:1746147254.096457:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732736 00000100:00100000:3.0:1746147254.096486:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467047296:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147254.096496:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15635 00000100:00100000:0.0:1746147254.096503:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:31847:x1830967465732736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.096507:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147254.096518:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.096532:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eca99 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.096543:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465732480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4134us (4495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.096551:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7930 00010000:00010000:0.0:1746147254.096555:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147254.096560:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.096571:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.096579:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab31200, rc 0) 00000100:00100000:0.0:1746147254.096596:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:31847:x1830967465732736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.096601:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15635 00000100:00100000:2.0:1746147254.096623:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467047424:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.096643:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.096652:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0200, rc 0) 00000100:00100000:2.0:1746147254.096670:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31846:x1830967465732608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3207us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.096676:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15634 00000100:00100000:0.0:1746147254.098781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.098983:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465732992 00000100:00100000:1.0:1746147254.098991:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465732992 00002000:00100000:1.0:1746147254.099032:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2453504->2457599) req@ffff8800b52e3100 x1830967465732992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.099042:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3100 with x1830967465732992 ext(2453504->2457599) 00010000:00010000:1.0:1746147254.099050:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.099062:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.099069:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e3100 00000100:00100000:1.0:1746147254.099093:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2535 00000100:00100000:1.0:1746147254.099100:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465732992:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.099280:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465732992:12345-192.168.203.36@tcp:3:cat.0 Request processed in 179us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147254.099286:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2535 00002000:00100000:1.0:1746147254.099291:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2453504->2457599) req@ffff8800b52e3100 x1830967465732992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.099297:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3100 with x1830967465732992 ext(2453504->2457599) 00010000:00010000:1.0:1746147254.099302:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.099310:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.099315:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e3100 00000100:00100000:0.0:1746147254.101161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.101551:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465733376 00000100:00100000:2.0:1746147254.101561:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465733376 00000100:00100000:0.0:1746147254.101625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:1.0:1746147254.101689:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147254.101727:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465733504 00000100:00100000:3.0:1746147254.101731:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465733504 00002000:00100000:3.0:1746147254.101764:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2457599) req@ffff8800b52e3480 x1830967465733504/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.101772:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3480 with x1830967465733504 ext(2097152->2457599) 00010000:00010000:3.0:1746147254.101780:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.101792:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.101799:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e3480 00000100:00100000:3.0:1746147254.101814:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2536 00000100:00100000:3.0:1746147254.101822:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465733504:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147254.101992:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4783 00000100:00100000:2.0:1746147254.102001:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31843:x1830967465733376:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147254.102211:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31843:x1830967465733376:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 212us (1058us total) trans 8589945447 rc 0/0 00000100:00100000:2.0:1746147254.102217:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4783 00000100:00100000:3.0:1746147254.107841:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465733504:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6009us (6204us total) trans 17179874039 rc 0/0 00000100:00100000:3.0:1746147254.107854:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2536 00002000:00100000:3.0:1746147254.107866:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2457599) req@ffff8800b52e3480 x1830967465733504/t17179874039(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.107876:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3480 with x1830967465733504 ext(2097152->2457599) 00010000:00010000:3.0:1746147254.107886:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.107901:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.107908:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e3480 00000100:00100000:1.0:1746147254.112518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.112595:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465733632 00000100:00100000:3.0:1746147254.112604:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465733632 00010000:00010000:3.0:1746147254.112639:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.113278:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7931 00000100:00100000:3.0:1746147254.113289:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465733632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.113303:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.113326:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.113339:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.113364:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b53e00/0xb4b2209fbdad0f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca76 expref: 27 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.113510:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.113513:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.113520:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.113529:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.113536:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.113538:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.113541:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.113548:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.113580:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.113591:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467047552:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147254.114679:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.114693:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467047680:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147254.114720:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.117067:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467047552:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147254.117431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.118045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.118123:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467047680:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147254.118153:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465733760 00010000:00010000:3.0:1746147254.118156:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.118160:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465733760 00000100:00100000:3.0:1746147254.118199:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465733632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4913us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.118204:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15636 00000100:00100000:3.0:1746147254.118208:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7931 00000100:00100000:2.0:1746147254.118210:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465733760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.118226:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147254.118231:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465734016 00000100:00100000:3.0:1746147254.118234:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465734016 00010000:00010000:2.0:1746147254.118241:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecaa0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147254.118255:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff8800b52e2300 x1830967465734016/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.118263:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2300 with x1830967465734016 ext(4972544->4976639) 00002000:00010000:3.0:1746147254.118267:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2300 00000100:00100000:2.0:1746147254.118289:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467047808:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.118292:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7385 00000100:00100000:3.0:1746147254.118297:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465734016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.118341:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.118486:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465734016:12345-192.168.203.36@tcp:3:cat.0 Request processed in 188us (442us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147254.118492:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7385 00002000:00100000:3.0:1746147254.118498:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff8800b52e2300 x1830967465734016/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.118505:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2300 with x1830967465734016 ext(4972544->4976639) 00002000:00010000:3.0:1746147254.118509:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2300 00000100:00100000:2.0:1746147254.121541:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467047808:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.121580:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f9c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa0 expref: 43 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.121595:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad0f9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa0 expref: 43 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.121627:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8200, rc 0) 00000100:00100000:2.0:1746147254.121675:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465733760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3463us (4244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.121683:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15636 00000100:00100000:0.0:1746147254.125360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.125794:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465734272 00000100:00100000:2.0:1746147254.125804:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465734272 00000100:00100000:2.0:1746147254.125848:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4784 00000100:00100000:2.0:1746147254.125855:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31846:x1830967465734272:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147254.126100:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31846:x1830967465734272:12345-192.168.203.36@tcp:35:cat.0 Request processed in 244us (749us total) trans 8589945448 rc 0/0 00000100:00100000:2.0:1746147254.126107:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4784 00000100:00100000:2.0:1746147254.130353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.130452:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465734528 00000100:00100000:1.0:1746147254.130460:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465734528 00002000:00100000:1.0:1746147254.130497:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff880134f33100 x1830967465734528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.130507:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33100 with x1830967465734528 ext(4972544->4976639) 00002000:00010000:1.0:1746147254.130512:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f33100 00000100:00100000:1.0:1746147254.130538:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7386 00000100:00100000:1.0:1746147254.130544:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465734528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.130707:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465734528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 162us (361us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147254.130713:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7386 00002000:00100000:1.0:1746147254.130718:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff880134f33100 x1830967465734528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.130726:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33100 with x1830967465734528 ext(4972544->4976639) 00002000:00010000:1.0:1746147254.130729:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f33100 00000100:00100000:0.0:1746147254.138753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.138801:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465734784 00000100:00100000:2.0:1746147254.138810:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465734784 00000100:00080000:1.0:1746147254.138853:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147254.138867:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4785 00000100:00100000:2.0:1746147254.138872:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:31847:x1830967465734784:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147254.139077:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31847:x1830967465734784:12345-192.168.203.36@tcp:35:cat.0 Request processed in 205us (335us total) trans 8589945449 rc 0/0 00000100:00100000:2.0:1746147254.139083:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4785 00000100:00100000:1.0:1746147254.173080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.173379:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465735040 00000100:00100000:2.0:1746147254.173388:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465735040 00000100:00100000:2.0:1746147254.173623:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11449 00000100:00100000:2.0:1746147254.173632:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:31854:x1830967465735040:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147254.173650:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.173664:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecaa7 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.173812:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173823:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173834:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173846:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173851:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173855:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173969:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173977:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.173983:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147254.173991:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147254.174055:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174060:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174065:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174069:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b8a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147254.174072:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174078:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174085:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147254.174087:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147254.174090:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174094:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad0faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174116:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174120:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174139:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174143:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b9c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147254.174145:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174149:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174154:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13000) 00010000:00010000:2.0:1746147254.174156:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147254.174157:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174161:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad0fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.174189:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 307 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.174198:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.174203:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.174204:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147254.174206:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8000, rc 0) 00000100:00100000:2.0:1746147254.174257:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31854:x1830967465735040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 627us (1188us total) trans 8589945450 rc 0/0 00000100:00100000:2.0:1746147254.174263:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11449 00000100:00100000:0.0:1746147254.220568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.221488:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465735296 00000100:00100000:2.0:1746147254.221498:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465735296 00000100:00100000:2.0:1746147254.221642:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11450 00000100:00100000:2.0:1746147254.221650:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31856:x1830967465735296:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147254.221671:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.221688:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad0fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecaae expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.221879:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.221891:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.221899:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.221909:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.221915:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.221920:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222044:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222052:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222058:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147254.222065:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147254.222146:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222152:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222157:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222162:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b8400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147254.222165:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222170:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222178:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147254.222180:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147254.222183:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222187:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8400/0xb4b2209fbdad0fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222215:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222220:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222224:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222231:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b9e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147254.222233:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222237:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222243:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13700) 00010000:00010000:2.0:1746147254.222245:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147254.222247:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222250:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad0fd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.222280:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad0fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.222290:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.222296:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.222297:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147254.222299:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9400, rc 0) 00000100:00100000:2.0:1746147254.222343:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31856:x1830967465735296:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 695us (1785us total) trans 8589945451 rc 0/0 00000100:00100000:2.0:1746147254.222349:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11450 00000100:00100000:0.0:1746147254.253754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.253850:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465735552 00000100:00100000:2.0:1746147254.253857:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465735552 00000100:00100000:3.0:1746147254.254033:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11451 00000100:00100000:3.0:1746147254.254043:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31859:x1830967465735552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.254062:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.254077:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53800/0xb4b2209fbdad0fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecab5 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.254164:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147254.254176:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147254.254185:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147254.254194:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147254.254285:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53800/0xb4b2209fbdad0fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 14 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.254303:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 13 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.254310:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.254313:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147254.254315:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53400, rc 0) 00000100:00100000:3.0:1746147254.254366:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31859:x1830967465735552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 324us (617us total) trans 8589945452 rc 0/0 00000100:00100000:3.0:1746147254.254371:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11451 00000100:00100000:0.0:1746147254.263714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.264126:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465735808 00000100:00100000:1.0:1746147254.264143:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465735808 00002000:00100000:1.0:1746147254.264184:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8801312a5180 x1830967465735808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.264194:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5180 with x1830967465735808 ext(0->1048575) 00002000:00010000:1.0:1746147254.264198:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5180 00000100:00100000:1.0:1746147254.264230:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7387 00000100:00100000:1.0:1746147254.264237:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465735808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.265466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.267272:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465736064 00000100:00100000:3.0:1746147254.267282:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465736064 00002000:00100000:3.0:1746147254.267329:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1507327) req@ffff8801312a6a00 x1830967465736064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.267339:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967465736064 ext(1048576->1507327) 00002000:00010000:3.0:1746147254.267344:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a6a00 00000100:00100000:3.0:1746147254.267386:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7388 00000100:00100000:3.0:1746147254.267395:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465736064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.277555:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465735808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13048us (13580us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.277570:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7387 00002000:00100000:1.0:1746147254.277585:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8801312a5180 x1830967465735808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.277594:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5180 with x1830967465735808 ext(0->1048575) 00002000:00010000:1.0:1746147254.277600:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5180 00000100:00100000:3.0:1746147254.282181:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465736064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14775us (16705us total) trans 0 rc 458752/458752 00000100:00100000:3.0:1746147254.282195:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7388 00002000:00100000:3.0:1746147254.282208:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1507327) req@ffff8801312a6a00 x1830967465736064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 458752/458752 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.282217:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967465736064 ext(1048576->1507327) 00002000:00010000:3.0:1746147254.282223:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a6a00 00000100:00100000:2.0:1746147254.300437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.300481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.300618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.300777:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465736448 00000100:00100000:1.0:1746147254.300787:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465736448 00002000:00100000:1.0:1746147254.300832:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134f30e00 x1830967465736448/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.300843:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30e00 with x1830967465736448 ext(2097152->3145727) 00002000:00010000:1.0:1746147254.300849:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f30e00 00000100:00100000:1.0:1746147254.300866:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465736576 00000100:00100000:1.0:1746147254.300868:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465736576 00002000:00100000:1.0:1746147254.300878:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f33480 x1830967465736576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.300884:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33480 with x1830967465736576 ext(3145728->4194303) 00002000:00010000:1.0:1746147254.300887:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f33480 00000100:00100000:1.0:1746147254.300899:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7389 00000100:00100000:1.0:1746147254.300905:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465736448:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147254.300952:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7390 00000100:00100000:3.0:1746147254.300966:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465736576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.303268:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465736192 00000100:00100000:0.0:1746147254.303279:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465736192 00000100:00100000:0.0:1746147254.303332:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15637 00000100:00100000:0.0:1746147254.303341:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31854:x1830967465736192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147254.303360:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.303378:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecabc expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.303408:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.303416:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.303422:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.303428:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.303430:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.303434:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1294336->2097151] (req 1294336->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.303465:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.303478:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.303491:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467047936:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.303588:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.303597:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 29 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.303605:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048064:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.303632:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.303641:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 11 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.303648:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048192:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.303664:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.316096:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465736576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15121us (15468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.316108:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7390 00002000:00100000:3.0:1746147254.316120:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f33480 x1830967465736576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.316138:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33480 with x1830967465736576 ext(3145728->4194303) 00002000:00010000:3.0:1746147254.316144:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f33480 00000100:00100000:0.0:1746147254.319513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.319840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.319868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.319919:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465737088 00000100:00100000:0.0:1746147254.319919:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465736832 00000100:00100000:1.0:1746147254.319927:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465737088 00000100:00100000:0.0:1746147254.319927:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465736832 00010000:00010000:1.0:1746147254.320001:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 12 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.320025:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465736960 00000100:00100000:1.0:1746147254.320028:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465736960 00000100:00100000:2.0:1746147254.320051:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467047936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.320063:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048064:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.320070:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048192:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.320103:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1294336->2097151] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.320116:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bdc00, rc 0) 00000100:00100000:3.0:1746147254.320220:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7932 00000100:00100000:2.0:1746147254.320242:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:31854:x1830967465736192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 16828us (19745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.320249:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15637 00010000:00010000:1.0:1746147254.320359:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.320360:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.320377:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7933 00000100:00100000:1.0:1746147254.320382:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465736960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147254.320384:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465737088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.320394:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147254.320394:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.320412:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 12 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.320412:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.320422:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.320429:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 12 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.320460:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f614200/0xb4b2209fbdad0f17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca1b expref: 30 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.320465:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d73e00/0xb4b2209fbdad0df8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9a4 expref: 12 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.320474:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147254.320475:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.320489:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465737088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 263us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.320489:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465736960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.320494:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7932 00000100:00100000:1.0:1746147254.320496:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7933 00000100:00100000:1.0:1746147254.320506:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7934 00000100:00100000:1.0:1746147254.320510:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465736832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147254.320518:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147254.320525:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.320532:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.320542:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093855200/0xb4b2209fbdad0f41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca45 expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.320551:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.320553:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.320558:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.320565:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.320591:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.320697:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467048320:192.168.203.36@tcp:105: 00000100:00080000:0.0:1746147254.321988:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147254.324011:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.325342:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465736448:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24427us (24852us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.325355:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7389 00002000:00100000:1.0:1746147254.325369:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134f30e00 x1830967465736448/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.325378:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30e00 with x1830967465736448 ext(2097152->3145727) 00002000:00010000:1.0:1746147254.325383:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f30e00 00000100:00100000:1.0:1746147254.326125:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467048320:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147254.326155:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147254.326193:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465736832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5681us (6689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.326202:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7934 00000100:00100000:0.0:1746147254.327982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.328072:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465737344 00000100:00100000:1.0:1746147254.328080:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465737344 00002000:00100000:1.0:1746147254.328120:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1294336->1298431) req@ffff88012eced500 x1830967465737344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.328139:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967465737344 ext(1294336->1298431) 00002000:00010000:1.0:1746147254.328143:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:1.0:1746147254.328179:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7391 00000100:00100000:1.0:1746147254.328186:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465737344:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147254.328486:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465737344:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 301us (511us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147254.328492:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7391 00002000:00100000:1.0:1746147254.328496:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1294336->1298431) req@ffff88012eced500 x1830967465737344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.328501:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967465737344 ext(1294336->1298431) 00002000:00010000:1.0:1746147254.328503:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:2.0:1746147254.340338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.340558:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465737472 00000100:00100000:0.0:1746147254.340565:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465737472 00000100:00100000:0.0:1746147254.340599:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15638 00000100:00100000:0.0:1746147254.340605:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465737472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.340619:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.340631:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952c4600/0xb4b2209fbdad1005 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecac3 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.340674:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048448:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147254.340742:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.345094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.345156:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465737600 00000100:00100000:2.0:1746147254.345164:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465737600 00000100:00100000:2.0:1746147254.345212:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15639 00000100:00100000:2.0:1746147254.345219:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:31854:x1830967465737600:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147254.345233:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.345248:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecaca expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.345271:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.345278:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.345280:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.345283:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1122303] (req 1048576->1122303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.345392:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.345402:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 25 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.345412:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467048576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.345609:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.349743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147254.349852:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147253 -> 1746147254 00002000:00010000:2.0:1746147254.349856:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147253 -> 1746147254 00000100:00100000:2.0:1746147254.349874:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048448:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.349899:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952c4600/0xb4b2209fbdad1005 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecac3 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.349910:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952c4600/0xb4b2209fbdad1005 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecac3 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.349923:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c4600, rc 0) 00000100:00100000:2.0:1746147254.349980:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465737472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9374us (9648us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.349987:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15638 00000100:00100000:3.0:1746147254.350125:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467048576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.350153:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1122303] (req 1048576->1122303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.350164:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8200, rc 0) 00000100:00100000:3.0:1746147254.350184:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:31854:x1830967465737600:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4967us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.350189:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15639 00000100:00100000:1.0:1746147254.350331:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465737728 00000100:00100000:1.0:1746147254.350336:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465737728 00002000:00100000:1.0:1746147254.350364:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1507328->2097151) req@ffff88012d49b100 x1830967465737728/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.350372:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967465737728 ext(1507328->2097151) 00010000:00010000:1.0:1746147254.350378:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 26 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.350387:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 26 pid: 4444 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.350392:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d49b100 00000100:00100000:1.0:1746147254.350404:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2537 00000100:00100000:1.0:1746147254.350408:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465737728:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147254.365901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.366099:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465737984 00000100:00100000:3.0:1746147254.366107:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465737984 00002000:00100000:3.0:1746147254.366154:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4972543) req@ffff880134f30000 x1830967465737984/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.366164:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30000 with x1830967465737984 ext(4194304->4972543) 00002000:00010000:3.0:1746147254.366169:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f30000 00000100:00100000:3.0:1746147254.366193:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7392 00000100:00100000:3.0:1746147254.366200:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465737984:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.375536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.377466:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465737728:12345-192.168.203.36@tcp:4:cat.0 Request processed in 27053us (27727us total) trans 17179874040 rc 0/0 00000100:00100000:1.0:1746147254.377475:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2537 00002000:00100000:1.0:1746147254.377483:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1507328->2097151) req@ffff88012d49b100 x1830967465737728/t17179874040(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.377491:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967465737728 ext(1507328->2097151) 00010000:00010000:1.0:1746147254.377499:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.377510:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.377521:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d49b100 00000100:00100000:2.0:1746147254.377600:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465738240 00000100:00100000:2.0:1746147254.377606:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465738240 00000100:00100000:2.0:1746147254.377637:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11452 00000100:00100000:2.0:1746147254.377643:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+306:31863:x1830967465738240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.377658:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.377672:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9000/0xb4b2209fbdad1013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecad1 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.377739:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.377750:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.377759:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147254.377766:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147254.377858:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9000/0xb4b2209fbdad1013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 309 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.377878:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.377885:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.377887:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746147254.377889:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9200, rc 0) 00000100:00100000:2.0:1746147254.377907:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31863:x1830967465738240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 264us (2380us total) trans 8589945453 rc 0/0 00000100:00100000:2.0:1746147254.377912:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11452 00000100:00100000:2.0:1746147254.382306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.382578:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465737984:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16377us (16683us total) trans 0 rc 778240/778240 00000100:00100000:3.0:1746147254.382587:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7392 00002000:00100000:3.0:1746147254.382595:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4972543) req@ffff880134f30000 x1830967465737984/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.382604:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30000 with x1830967465737984 ext(4194304->4972543) 00002000:00010000:3.0:1746147254.382608:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f30000 00000100:00100000:0.0:1746147254.382986:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465738368 00000100:00100000:0.0:1746147254.382992:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465738368 00000100:00100000:0.0:1746147254.383030:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11453 00000100:00100000:0.0:1746147254.383036:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:31862:x1830967465738368:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147254.383050:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.383065:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad1028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecad8 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.383115:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383124:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383142:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383154:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383159:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383164:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383242:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383248:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383253:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147254.383276:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147254.383279:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147254.383289:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383296:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383303:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383307:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383312:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383316:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f56f600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147254.383319:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383325:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383333:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147254.383335:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147254.383338:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383342:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f600/0xb4b2209fbdad102f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383354:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383358:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383362:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383366:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f56fc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147254.383369:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383373:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383379:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a447a200) 00010000:00010000:0.0:1746147254.383381:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147254.383383:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147254.383388:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56fc00/0xb4b2209fbdad1036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00080000:2.0:1746147254.383402:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746147254.383408:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad1028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.383417:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.383422:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147254.383424:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147254.383426:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56f400, rc 0) 00000100:00100000:0.0:1746147254.383447:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31862:x1830967465738368:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 411us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.383452:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11453 00000100:00100000:2.0:1746147254.383472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.383584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.383953:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465738496 00000100:00100000:3.0:1746147254.383957:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465738496 00000100:00100000:3.0:1746147254.383991:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15640 00000100:00100000:3.0:1746147254.383997:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465738496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.384003:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.384013:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b52a00/0xb4b2209fbdad1044 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecadf expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.384050:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467048704:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.384563:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.385382:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465738624 00000100:00100000:0.0:1746147254.385388:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465738624 00010000:00010000:0.0:1746147254.385501:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 28 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.385542:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7935 00000100:00100000:0.0:1746147254.385549:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465738624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.385559:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147254.385572:0:7120:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147253 -> 1746147254 00010000:00010000:0.0:1746147254.385577:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 28 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.385587:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 28 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.385603:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.385604:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.385610:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 44 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.385617:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 44 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.385638:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 44 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.385646:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467048832:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147254.386004:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.386109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.386139:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465738752 00000100:00100000:2.0:1746147254.386143:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465738752 00000100:00100000:2.0:1746147254.386165:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15641 00000100:00100000:2.0:1746147254.386169:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465738752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.386179:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.386188:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad104b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecae6 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.386214:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048960:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147254.386234:0:17548:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88009e6f2d80 x1830967467048704) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 28 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.386251:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147254.386255:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad0f4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca53 expref: 28 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.386267:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467048704:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147254.386285:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b52a00/0xb4b2209fbdad1044 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecadf expref: 44 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.386293:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b52a00/0xb4b2209fbdad1044 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecadf expref: 44 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.386299:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b52a00, rc 0) 00000100:00100000:3.0:1746147254.386318:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465738496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2321us (2846us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.386323:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15640 00000100:00100000:0.0:1746147254.387703:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.387815:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465738880 00000100:00100000:3.0:1746147254.387819:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465738880 00000100:00100000:3.0:1746147254.387853:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15642 00000100:00100000:3.0:1746147254.387859:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465738880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.387867:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.387875:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b52800/0xb4b2209fbdad1052 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecaed expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.387899:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467049088:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.387983:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.388912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.389488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.389549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.389564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.389600:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467048832:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147254.389611:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.389642:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465738624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4094us (6058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.389650:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7935 00000100:00100000:3.0:1746147254.389741:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465739008 00000100:00100000:3.0:1746147254.389745:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465739008 00000100:00100000:3.0:1746147254.389764:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465739264 00000100:00100000:3.0:1746147254.389766:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465739264 00000100:00100000:3.0:1746147254.389779:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465739136 00000100:00100000:3.0:1746147254.389780:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465739136 00000100:00100000:3.0:1746147254.389790:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465739392 00000100:00100000:3.0:1746147254.389791:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465739392 00000100:00100000:2.0:1746147254.389960:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467048960:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.389979:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad104b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecae6 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.389990:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad104b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecae6 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147254.390098:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15643 00000100:00100000:3.0:1746147254.390105:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465739008:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.390115:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.390123:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecaf4 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.390373:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.390374:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.390381:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.390392:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.390398:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53800, rc 0) 00000100:00100000:3.0:1746147254.390415:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465739008:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 311us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.390419:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15643 00000100:00100000:3.0:1746147254.390430:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15644 00000100:00100000:3.0:1746147254.390435:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465739264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.390440:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.390446:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b52200/0xb4b2209fbdad1060 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb02 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.390468:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467049216:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.390495:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934553c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147254.390527:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8c00, rc 0) 00000100:00100000:2.0:1746147254.390545:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465738752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4376us (4437us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.390551:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15641 00000100:00100000:2.0:1746147254.390561:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15645 00000100:00100000:2.0:1746147254.390565:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465739136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147254.390572:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.390578:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdad1067 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecafb expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.390594:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467049344:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147254.390608:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.390663:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15646 00000100:00100000:1.0:1746147254.390669:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465739392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147254.390675:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.390681:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb09 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.390690:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.390691:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.390696:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.390709:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.390716:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab30000, rc 0) 00000100:00100000:1.0:1746147254.390731:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465739392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 61us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.390736:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15646 00002000:00010000:3.0:1746147254.390909:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147253 -> 1746147254 00002000:00010000:3.0:1746147254.390912:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147253 -> 1746147254 00000100:00100000:3.0:1746147254.390922:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467049088:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147254.390934:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b52800/0xb4b2209fbdad1052 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaed expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.390962:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b52800/0xb4b2209fbdad1052 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaed expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.390969:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b52800, rc 0) 00000100:00100000:3.0:1746147254.390988:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465738880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3129us (3287us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.390992:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15642 00000100:00100000:0.0:1746147254.391725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.391807:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465739648 00000100:00100000:3.0:1746147254.391811:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465739648 00002000:00100000:3.0:1746147254.391835:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1118208->1122303) req@ffff88012c85e300 x1830967465739648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.391843:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e300 with x1830967465739648 ext(1118208->1122303) 00002000:00010000:3.0:1746147254.392004:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85e300 00000100:00100000:3.0:1746147254.392024:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7393 00000100:00100000:3.0:1746147254.392030:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465739648:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147254.392150:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465739648:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 119us (424us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147254.392156:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7393 00002000:00100000:3.0:1746147254.392161:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1118208->1122303) req@ffff88012c85e300 x1830967465739648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.392168:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e300 with x1830967465739648 ext(1118208->1122303) 00002000:00010000:3.0:1746147254.392171:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85e300 00000100:00100000:3.0:1746147254.396134:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467049216:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147254.396174:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b52200/0xb4b2209fbdad1060 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb02 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.396185:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b52200/0xb4b2209fbdad1060 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb02 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.396196:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b52200, rc 0) 00000100:00100000:3.0:1746147254.396252:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465739264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5815us (6762us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.396261:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15644 00002000:00010000:3.0:1746147254.396494:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147253 -> 1746147254 00000100:00100000:1.0:1746147254.396497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.396508:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467049344:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147254.396517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147254.396529:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdad1067 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecafb expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.396542:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9600/0xb4b2209fbdad1067 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecafb expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147254.396546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147254.396550:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9600, rc 0) 00000100:00100000:3.0:1746147254.396571:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465739136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6004us (7021us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.396576:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15645 00000100:00100000:3.0:1746147254.396589:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465740032 00000100:00100000:3.0:1746147254.396596:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465740032 00000100:00100000:2.0:1746147254.396656:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465739904 00000100:00100000:2.0:1746147254.396664:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465739904 00000100:00100000:2.0:1746147254.396698:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4786 00000100:00100000:2.0:1746147254.396704:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31854:x1830967465739904:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147254.396743:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465740160 00000100:00100000:3.0:1746147254.396746:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465740160 00000100:00100000:3.0:1746147254.396763:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15647 00000100:00100000:3.0:1746147254.396769:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465740032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.396783:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.396797:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b53000/0xb4b2209fbdad1075 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb10 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.396837:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467049472:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.396897:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934553c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.396919:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15648 00000100:00100000:3.0:1746147254.396926:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465740160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.396933:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.396956:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b52400/0xb4b2209fbdad107c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb17 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.396985:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467049600:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147254.397004:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.397142:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:31854:x1830967465739904:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 437us (649us total) trans 8589945454 rc 0/0 00000100:00100000:2.0:1746147254.397152:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4786 00000100:00100000:2.0:1746147254.398500:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467049600:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.398527:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b52400/0xb4b2209fbdad107c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb17 expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.398538:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b52400/0xb4b2209fbdad107c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb17 expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.398547:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b52400, rc 0) 00000100:00100000:2.0:1746147254.398582:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465740160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1656us (2035us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.398587:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15648 00000100:00100000:3.0:1746147254.398775:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467049472:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147254.398789:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b53000/0xb4b2209fbdad1075 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb10 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.398798:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b53000/0xb4b2209fbdad1075 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb10 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.398805:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53000, rc 0) 00000100:00100000:3.0:1746147254.398821:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465740032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2052us (2303us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.398826:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15647 00000100:00100000:0.0:1746147254.400745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.400873:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465740416 00000100:00100000:3.0:1746147254.400882:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465740416 00000100:00100000:3.0:1746147254.400922:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11454 00000100:00100000:3.0:1746147254.400929:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:31862:x1830967465740416:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.400972:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.400990:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b52e00/0xb4b2209fbdad1083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb1e expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.401083:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.401097:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.401105:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.401111:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.401117:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.401123:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 7/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.401404:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.401416:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 8 pid: 14048 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.401429:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467049728:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.402311:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.402321:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.402329:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467049856:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.402364:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.402372:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 308 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.402377:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467049984:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.402396:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.402401:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.402408:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467050112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.402420:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.402997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.403349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.405864:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465740672 00000100:00100000:2.0:1746147254.405878:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465740672 00002000:00100000:2.0:1746147254.405928:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1294335) req@ffff8800936df480 x1830967465740672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.405956:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df480 with x1830967465740672 ext(1048576->1294335) 00002000:00010000:2.0:1746147254.405962:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df480 00000100:00100000:2.0:1746147254.405987:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465740928 00000100:00100000:2.0:1746147254.405989:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465740928 00002000:00100000:2.0:1746147254.406004:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1122304->2097151) req@ffff8800936dfb80 x1830967465740928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.406011:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830967465740928 ext(1122304->2097151) 00002000:00010000:2.0:1746147254.406014:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:2.0:1746147254.406033:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7394 00000100:00100000:2.0:1746147254.406040:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465740672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.406450:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7395 00000100:00100000:2.0:1746147254.406456:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465740928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.409456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.409483:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741056 00000100:00100000:0.0:1746147254.409490:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741056 00000100:00100000:1.0:1746147254.409515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147254.409527:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 9 pid: 14048 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.409596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.409618:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467049728:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.409636:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467049856:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.409646:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467049984:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.409655:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467050112:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.410142:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.410199:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741184 00000100:00100000:0.0:1746147254.410203:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741184 00000100:00100000:1.0:1746147254.410211:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741312 00010000:00010000:0.0:1746147254.410216:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 13 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.410217:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741312 00000100:00100000:2.0:1746147254.410222:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7936 00000100:00100000:2.0:1746147254.410232:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465741056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147254.410237:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7937 00010000:00010000:1.0:1746147254.410241:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 309 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.410243:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147254.410244:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465741184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.410249:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 9 pid: 14048 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.410255:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.410259:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 9 pid: 14048 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.410261:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 13 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.410262:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7938 00000100:00100000:1.0:1746147254.410266:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1956:x1830967465741312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147254.410272:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147254.410275:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 309 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.410277:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad103d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad8 expref: 9 pid: 14048 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.410279:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 13 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.410288:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 309 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.410758:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147254.410760:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9400/0xb4b2209fbdad0fdb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaae expref: 13 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.410763:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.410770:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.410774:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147254.410779:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8000/0xb4b2209fbdad0fb8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaa7 expref: 309 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.410786:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147254.410790:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.410796:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.410802:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147254.410802:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147254.410805:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147254.410808:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465741056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 578us (1363us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147254.410810:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147254.410813:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7936 00010000:00010000:1.0:1746147254.410814:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.410831:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465741184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 588us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.410832:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1956:x1830967465741312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 565us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.410836:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7938 00000100:00100000:0.0:1746147254.410840:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7937 00000100:00100000:2.0:1746147254.410860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.411059:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741440 00000100:00100000:2.0:1746147254.411063:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741440 00010000:00010000:2.0:1746147254.411197:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.411214:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7939 00000100:00100000:2.0:1746147254.411219:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1956:x1830967465741440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.411225:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.411228:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.411235:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.411244:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad0eed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f8 expref: 308 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.411252:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.411255:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.411270:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.411276:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.411292:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147254.411305:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.411312:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147254.411315:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1956:x1830967465741440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.411320:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7939 00000004:00200000:3.0:1746147254.411334:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147254.411441:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b52e00/0xb4b2209fbdad1083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.411453:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.411465:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.411467:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147254.411469:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53600, rc 0) 00000100:00100000:3.0:1746147254.411502:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31862:x1830967465740416:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10574us (10765us total) trans 8589945455 rc 0/0 00000100:00100000:3.0:1746147254.411508:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11454 00000100:00100000:2.0:1746147254.412156:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465740672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6116us (9160us total) trans 0 rc 245760/245760 00000100:00100000:2.0:1746147254.412164:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7394 00002000:00100000:2.0:1746147254.412171:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1294335) req@ffff8800936df480 x1830967465740672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 245760/245760 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.412179:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df480 with x1830967465740672 ext(1048576->1294335) 00002000:00010000:2.0:1746147254.412183:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df480 00000100:00100000:2.0:1746147254.415809:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465740928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9345us (12452us total) trans 0 rc 974848/974848 00000100:00100000:2.0:1746147254.415820:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7395 00002000:00100000:2.0:1746147254.415828:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1122304->2097151) req@ffff8800936dfb80 x1830967465740928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.415842:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830967465740928 ext(1122304->2097151) 00002000:00010000:2.0:1746147254.415846:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746147254.417424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.417534:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741568 00000100:00100000:3.0:1746147254.417541:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741568 00000100:00100000:3.0:1746147254.417588:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11455 00000100:00100000:3.0:1746147254.417594:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31862:x1830967465741568:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.417612:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.417624:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b52600/0xb4b2209fbdad1098 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb25 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.417681:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.417691:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.417696:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.417722:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.417731:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 9 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.417739:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467050240:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.417791:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934553c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.427491:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467050240:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.427519:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.430782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.430905:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741696 00000100:00100000:2.0:1746147254.430915:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741696 00010000:00010000:2.0:1746147254.430981:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 10 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.431011:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7940 00000100:00100000:2.0:1746147254.431019:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465741696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.431209:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.431218:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 10 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.431718:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 10 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.431743:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad108a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb1e expref: 10 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.431772:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.431777:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.431785:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.431791:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.431825:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.431884:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465741696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 865us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.431892:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7940 00010000:00010000:3.0:1746147254.432098:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.432108:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147254.432156:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147254.432159:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147254.432172:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.432201:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b52600/0xb4b2209fbdad1098 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.432235:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.432246:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.432248:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147254.432251:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53200, rc 0) 00000100:00100000:3.0:1746147254.432292:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31862:x1830967465741568:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 14696us (14869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.432299:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11455 00000100:00100000:0.0:1746147254.437317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.437369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.437409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.437510:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465742336 00000100:00100000:1.0:1746147254.437521:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465742336 00000100:00100000:1.0:1746147254.437567:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15649 00000100:00100000:1.0:1746147254.437575:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465742336:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147254.437594:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.437612:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad10a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb2c expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.437671:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467050368:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147254.437758:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.437827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.437903:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465742464 00000100:00100000:2.0:1746147254.437906:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465742464 00000100:00100000:2.0:1746147254.437964:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15650 00000100:00100000:2.0:1746147254.437970:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465742464:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147254.437978:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.437988:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad10ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb33 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.438014:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467050496:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147254.438048:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.438081:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465742080 00000100:00100000:2.0:1746147254.438084:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465742080 00002000:00100000:2.0:1746147254.438109:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800936df800 x1830967465742080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.438118:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830967465742080 ext(3145728->4194303) 00002000:00010000:2.0:1746147254.438122:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:2.0:1746147254.438149:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465741952 00000100:00100000:2.0:1746147254.438151:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465741952 00002000:00100000:2.0:1746147254.438163:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b6b8000 x1830967465741952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.438169:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8000 with x1830967465741952 ext(2097152->3145727) 00002000:00010000:2.0:1746147254.438172:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b8000 00000100:00100000:2.0:1746147254.438189:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7396 00000100:00100000:2.0:1746147254.438194:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967465742080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147254.439384:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7397 00000100:00100000:3.0:1746147254.439396:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967465741952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.445015:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467050496:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147254.445015:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467050368:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.445043:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad10ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb33 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.445043:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad10a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb2c expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.445054:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9e00/0xb4b2209fbdad10ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb33 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.445054:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fac000/0xb4b2209fbdad10a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb2c expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.445081:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fac000, rc 0) 00010000:00010000:2.0:1746147254.445083:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9e00, rc 0) 00000100:00100000:1.0:1746147254.445135:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465742336:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7550us (7714us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.445137:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465742464:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7155us (7297us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147254.445143:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15649 00000100:00100000:2.0:1746147254.445146:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15650 00000100:00100000:2.0:1746147254.446271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.446347:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465742592 00000100:00100000:1.0:1746147254.446353:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465742592 00000100:00100000:1.0:1746147254.446385:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15651 00000100:00100000:1.0:1746147254.446391:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31856:x1830967465742592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147254.446403:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.446417:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb3a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.446438:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.446446:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.446452:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 46 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.446457:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.446459:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.446462:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.446484:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 46 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.446494:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 46 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.446503:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467050624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.446577:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.446586:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 9 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.446593:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467050752:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.446616:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.446624:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.446630:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467050880:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.446644:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.449748:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967465742080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11543us (12434us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.449760:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7396 00002000:00100000:2.0:1746147254.449771:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800936df800 x1830967465742080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.449779:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830967465742080 ext(3145728->4194303) 00010000:00010000:2.0:1746147254.449790:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 45 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.449802:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 45 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746147254.449809:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936df800 00000100:00100000:0.0:1746147254.450872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.451857:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465741952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12460us (14483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.451866:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7397 00002000:00100000:3.0:1746147254.451873:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b6b8000 x1830967465741952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.451881:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8000 with x1830967465741952 ext(2097152->3145727) 00010000:00010000:3.0:1746147254.451888:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.451898:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.451904:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b8000 00000100:00100000:3.0:1746147254.451927:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465742848 00000100:00100000:3.0:1746147254.451932:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465742848 00000100:00100000:3.0:1746147254.451997:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11456 00000100:00100000:3.0:1746147254.452004:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31862:x1830967465742848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.452015:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.452028:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53e00/0xb4b2209fbdad10bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb41 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.452094:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452104:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452112:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452120:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452125:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452141:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452146:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b53a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.452149:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452154:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452162:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.452164:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147254.452167:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452172:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53a00/0xb4b2209fbdad10c2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.452201:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53e00/0xb4b2209fbdad10bb lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb41 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.452207:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53e00/0xb4b2209fbdad10bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb41 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.452213:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53e00, rc 0) 00000100:00100000:3.0:1746147254.452231:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31862:x1830967465742848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 228us (1366us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147254.452236:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11456 00000100:00100000:1.0:1746147254.452265:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467050624:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.452324:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467050752:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.452441:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467050880:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.452468:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.452479:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134faca00, rc 0) 00000100:00100000:1.0:1746147254.452509:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31856:x1830967465742592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6118us (6242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.452515:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15651 00000100:00100000:0.0:1746147254.454272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.454378:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465742976 00000100:00100000:2.0:1746147254.454385:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465742976 00010000:00010000:2.0:1746147254.454410:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 10 pid: 8480 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.454439:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7941 00000100:00100000:2.0:1746147254.454444:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465742976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.454453:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.454469:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 10 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.454478:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 10 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.454492:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab30000/0xb4b2209fbdad106e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb09 expref: 10 pid: 8480 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.454506:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.454646:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465742976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 199us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.454651:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7941 00000100:00100000:0.0:1746147254.457808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.458677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.458712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.458780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.458833:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465743360 00000100:00100000:0.0:1746147254.458842:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465743360 00010000:00010000:0.0:1746147254.458876:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.458901:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465743616 00000100:00100000:0.0:1746147254.458903:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465743616 00010000:00010000:0.0:1746147254.458914:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.458929:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7942 00000100:00100000:0.0:1746147254.458953:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465743360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147254.458965:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7943 00010000:00010000:0.0:1746147254.458967:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147254.458982:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465743616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.458989:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.458997:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147254.458999:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.459032:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.459043:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465743232 00010000:00010000:3.0:1746147254.459045:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.459048:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465743232 00010000:00010000:3.0:1746147254.459063:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab31200/0xb4b2209fbdad0f95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca99 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.459074:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4787 00000100:00100000:2.0:1746147254.459079:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:31862:x1830967465743232:12345-192.168.203.36@tcp:35:lfs.0 00010000:00010000:3.0:1746147254.459081:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.459083:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.459089:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.459092:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdad0f8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca92 expref: 28 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.459095:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.459122:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.459142:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467051008:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147254.459214:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934553c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147254.459247:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.459260:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31862:x1830967465743232:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 179us (1461us total) trans 8589945456 rc 0/0 00000100:00100000:0.0:1746147254.459261:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465743360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 325us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.459266:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7942 00000100:00100000:2.0:1746147254.459267:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4787 00000100:00100000:0.0:1746147254.459291:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465743488 00000100:00100000:0.0:1746147254.459294:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465743488 00000100:00100000:0.0:1746147254.459309:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15652 00000100:00100000:0.0:1746147254.459314:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:31863:x1830967465743488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.459324:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.459335:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb48 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.459351:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.459358:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147254.459359:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147254.459362:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 44 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.459385:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.459396:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 26 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.459406:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467051136:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.459433:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.461623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.461710:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467051008:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147254.461727:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.461749:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467051136:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.461771:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 44 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.461778:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967465743616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2803us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.461786:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7943 00010000:00010000:0.0:1746147254.461786:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98da00, rc 0) 00000100:00100000:0.0:1746147254.461815:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:31863:x1830967465743488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2500us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.461816:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465743872 00000100:00100000:3.0:1746147254.461821:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465743872 00000100:00100000:0.0:1746147254.461824:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15652 00002000:00100000:3.0:1746147254.461847:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3072000->3076095) req@ffff88012db2ce00 x1830967465743872/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.461855:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ce00 with x1830967465743872 ext(3072000->3076095) 00010000:00010000:3.0:1746147254.461862:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.461879:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.461889:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012db2ce00 00000100:00100000:3.0:1746147254.461902:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2538 00000100:00100000:3.0:1746147254.461908:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465743872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147254.462257:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465743872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 348us (640us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147254.462263:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2538 00002000:00100000:3.0:1746147254.462268:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3072000->3076095) req@ffff88012db2ce00 x1830967465743872/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.462275:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ce00 with x1830967465743872 ext(3072000->3076095) 00010000:00010000:3.0:1746147254.462279:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.462287:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.462292:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012db2ce00 00000100:00100000:0.0:1746147254.466364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.466415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.466499:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465744128 00000100:00100000:2.0:1746147254.466506:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465744128 00000100:00100000:3.0:1746147254.466677:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465744256 00000100:00100000:3.0:1746147254.466681:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465744256 00002000:00100000:3.0:1746147254.466707:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3072000->3145727) req@ffff880134f84700 x1830967465744256/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.466715:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84700 with x1830967465744256 ext(3072000->3145727) 00010000:00010000:3.0:1746147254.466722:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.466742:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 27 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.466748:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f84700 00000100:00100000:3.0:1746147254.466763:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2539 00000100:00100000:3.0:1746147254.466769:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465744256:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147254.467051:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15653 00000100:00100000:2.0:1746147254.467057:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31856:x1830967465744128:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147254.467065:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.467078:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb4f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.467096:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.467104:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.467109:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.467114:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.467115:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.467118:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->2985983] (req 2097152->2985983) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.467152:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.467161:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 28 pid: 8481 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.467170:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051264:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.467230:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.467237:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.467244:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051392:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.467263:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.467270:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 10 pid: 21080 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.467276:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051520:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.467287:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.469590:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465744256:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2815us (3167us total) trans 17179874041 rc 0/0 00000100:00100000:3.0:1746147254.469598:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2539 00002000:00100000:3.0:1746147254.469607:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3072000->3145727) req@ffff880134f84700 x1830967465744256/t17179874041(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.469615:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84700 with x1830967465744256 ext(3072000->3145727) 00010000:00010000:3.0:1746147254.469622:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.469631:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.469637:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f84700 00000100:00100000:2.0:1746147254.470014:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.470022:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051392:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.470175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.470231:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051520:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.470256:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->2985983] (req 2097152->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.470268:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854000, rc 0) 00000100:00100000:2.0:1746147254.470337:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31856:x1830967465744128:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3280us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.470343:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15653 00000100:00100000:3.0:1746147254.470652:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465744384 00000100:00100000:3.0:1746147254.470657:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465744384 00010000:00010000:3.0:1746147254.470676:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 11 pid: 21080 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.470855:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7944 00000100:00100000:3.0:1746147254.470861:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465744384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.470869:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.470885:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 11 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.470893:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 11 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.470909:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682a00/0xb4b2209fbdad0e0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9b9 expref: 11 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.470918:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.470959:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465744384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.470964:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7944 00000100:00100000:0.0:1746147254.472764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.472879:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465744512 00000100:00100000:1.0:1746147254.472886:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465744512 00010000:00010000:1.0:1746147254.472910:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 29 pid: 8481 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.472963:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7945 00000100:00100000:1.0:1746147254.472969:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465744512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147254.472980:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147254.472996:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 29 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.473005:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 29 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.473020:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56ea00/0xb4b2209fbdad0f2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca30 expref: 29 pid: 8481 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746147254.473047:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147254.473075:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465744512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.473081:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7945 00000100:00100000:0.0:1746147254.473299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.473348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.473360:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465744640 00000100:00100000:0.0:1746147254.473363:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465744640 00010000:00010000:0.0:1746147254.473375:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.473386:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465744768 00000100:00100000:0.0:1746147254.473388:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465744768 00010000:00010000:0.0:1746147254.473396:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.473407:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7946 00000100:00100000:0.0:1746147254.473411:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465744640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.473417:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147254.473425:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.473431:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.473441:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab30400/0xb4b2209fbdad0f64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca68 expref: 30 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.473452:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.473454:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.473459:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.473465:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.473488:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.473497:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467051648:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147254.473542:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.473760:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7947 00000100:00100000:3.0:1746147254.473769:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465744768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.473778:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147254.473789:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147253 -> 1746147254 00002000:00010000:3.0:1746147254.473791:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147253 -> 1746147254 00010000:00010000:3.0:1746147254.473795:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.473807:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.473819:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134faca00/0xb4b2209fbdad10b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb3a expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.473827:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.473828:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.473833:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.473838:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.473854:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.473861:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467051776:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147254.473880:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.486209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.486246:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.486278:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465745024 00000100:00100000:0.0:1746147254.486284:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465745024 00002000:00100000:0.0:1746147254.486318:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094d78e00 x1830967465745024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.486326:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78e00 with x1830967465745024 ext(3145728->4194303) 00002000:00010000:0.0:1746147254.486330:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d78e00 00000100:00100000:0.0:1746147254.486342:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465745280 00000100:00100000:0.0:1746147254.486344:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465745280 00002000:00100000:0.0:1746147254.486353:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2981888->2985983) req@ffff880094d78700 x1830967465745280/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.486363:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78700 with x1830967465745280 ext(2981888->2985983) 00002000:00010000:0.0:1746147254.486366:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d78700 00000100:00100000:0.0:1746147254.486375:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7398 00000100:00100000:0.0:1746147254.486380:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465745024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.487183:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467051648:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147254.487197:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147254.487234:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465744640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 13821us (13935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.487241:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7946 00000100:00100000:2.0:1746147254.487382:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7399 00000100:00100000:2.0:1746147254.487393:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465745280:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147254.487479:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465745280:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 85us (1230us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147254.487485:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7399 00002000:00100000:2.0:1746147254.487490:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2981888->2985983) req@ffff880094d78700 x1830967465745280/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.487496:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78700 with x1830967465745280 ext(2981888->2985983) 00002000:00010000:2.0:1746147254.487499:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d78700 00000100:00100000:3.0:1746147254.487695:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467051776:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147254.487711:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.487901:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465744768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 14134us (14550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.487907:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7947 00000100:00100000:2.0:1746147254.491992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.492081:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465745536 00000100:00100000:3.0:1746147254.492089:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465745536 00000100:00100000:3.0:1746147254.492124:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4788 00000100:00100000:3.0:1746147254.492140:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31856:x1830967465745536:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147254.492305:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31856:x1830967465745536:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 165us (320us total) trans 8589945457 rc 0/0 00000100:00100000:3.0:1746147254.492311:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4788 00000100:00100000:2.0:1746147254.497451:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465745024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11062us (11241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.497462:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7398 00002000:00100000:2.0:1746147254.497472:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094d78e00 x1830967465745024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.497480:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78e00 with x1830967465745024 ext(3145728->4194303) 00002000:00010000:2.0:1746147254.497484:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d78e00 00000100:00100000:0.0:1746147254.504580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.504700:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465745664 00000100:00100000:2.0:1746147254.504707:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465745664 00000100:00100000:2.0:1746147254.504742:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15654 00000100:00100000:2.0:1746147254.504748:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31863:x1830967465745664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.504763:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.504777:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb56 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.504800:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.504806:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.504808:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.504810:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.504832:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.504841:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 28 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.504851:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051904:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.505364:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.507098:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467051904:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.507134:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.507154:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855e00, rc 0) 00000100:00100000:2.0:1746147254.507189:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31863:x1830967465745664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2441us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.507196:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15654 00000100:00100000:0.0:1746147254.509122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.509241:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465745792 00000100:00100000:2.0:1746147254.509249:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465745792 00002000:00100000:2.0:1746147254.509286:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2985983) req@ffff8800998e4450 x1830967465745792/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.509294:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e4450 with x1830967465745792 ext(2097152->2985983) 00010000:00010000:2.0:1746147254.509302:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.509312:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746147254.509318:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800998e4450 00000100:00100000:2.0:1746147254.509347:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2540 00000100:00100000:2.0:1746147254.509353:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465745792:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147254.522477:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465745792:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 13114us (13351us total) trans 21474841392 rc 0/0 00000100:00100000:3.0:1746147254.522489:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2540 00002000:00100000:3.0:1746147254.522499:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2985983) req@ffff8800998e4450 x1830967465745792/t21474841392(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.522508:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e4450 with x1830967465745792 ext(2097152->2985983) 00010000:00010000:3.0:1746147254.522516:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 31 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.522530:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 31 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.522536:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800998e4450 00000100:00100000:0.0:1746147254.527155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.527217:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465745920 00000100:00100000:2.0:1746147254.527225:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465745920 00010000:00010000:2.0:1746147254.527255:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 31 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.527292:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7948 00000100:00100000:2.0:1746147254.527300:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1958:x1830967465745920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.527311:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147254.527329:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147253 -> 1746147254 00002000:00010000:2.0:1746147254.527332:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147253 -> 1746147254 00010000:00010000:2.0:1746147254.527338:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 31 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.527349:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 31 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.527368:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad10d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2985983) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb4f expref: 31 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.527384:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.527386:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.527393:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.527400:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.527456:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.527468:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467052032:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147254.527549:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.534211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.534241:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465746176 00000100:00100000:3.0:1746147254.534248:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465746176 00002000:00100000:3.0:1746147254.534283:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800b52e0e00 x1830967465746176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.534291:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0e00 with x1830967465746176 ext(3145728->4194303) 00002000:00010000:3.0:1746147254.534295:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0e00 00000100:00100000:3.0:1746147254.534321:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7400 00000100:00100000:3.0:1746147254.534328:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465746176:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.534402:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467052032:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147254.534417:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.534461:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465745920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7161us (7313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.534469:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7948 00000100:00100000:3.0:1746147254.542837:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465746176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8500us (8623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.542851:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7400 00002000:00100000:3.0:1746147254.542862:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800b52e0e00 x1830967465746176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.542870:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0e00 with x1830967465746176 ext(3145728->4194303) 00002000:00010000:3.0:1746147254.542875:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0e00 00000100:00100000:0.0:1746147254.548672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.548828:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465746432 00000100:00100000:3.0:1746147254.548835:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465746432 00002000:00100000:3.0:1746147254.548889:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094d7a680 x1830967465746432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.548898:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7a680 with x1830967465746432 ext(4194304->4976639) 00002000:00010000:3.0:1746147254.548903:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7a680 00000100:00100000:3.0:1746147254.548931:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7401 00000100:00100000:3.0:1746147254.548962:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465746432:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147254.554883:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465746432:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5914us (6217us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147254.554906:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7401 00002000:00100000:3.0:1746147254.554916:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880094d7a680 x1830967465746432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.554924:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7a680 with x1830967465746432 ext(4194304->4976639) 00002000:00010000:3.0:1746147254.554930:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7a680 00000100:00100000:0.0:1746147254.580624:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.580705:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465746560 00000100:00100000:3.0:1746147254.580711:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465746560 00000100:00100000:3.0:1746147254.580766:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11457 00000100:00100000:3.0:1746147254.580773:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31869:x1830967465746560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.580792:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.580806:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49000/0xb4b2209fbdad10de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb5d expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.580854:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.580864:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.580873:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.580884:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.580890:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.580895:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581677:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581686:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581696:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147254.581722:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147254.581725:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147254.581736:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581745:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581751:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581756:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581760:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581765:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc49200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.581769:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581774:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581781:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147254.581784:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.581787:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.581791:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad10e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582875:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582882:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582886:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582890:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc49400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.582892:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582896:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582903:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473300) 00010000:00010000:3.0:1746147254.582905:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.582908:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.582912:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad10ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.583699:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49000/0xb4b2209fbdad10de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb5d expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.583712:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb5d expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.583718:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.583720:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147254.583722:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49600, rc 0) 00000100:00100000:3.0:1746147254.583781:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465746560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3007us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.583788:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11457 00000100:00100000:0.0:1746147254.587094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.587143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.587155:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465746816 00000100:00100000:2.0:1746147254.587163:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465746816 00000100:00100000:0.0:1746147254.587183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.587223:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465746944 00000100:00100000:2.0:1746147254.587225:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465746944 00000100:00100000:0.0:1746147254.587228:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15655 00000100:00100000:0.0:1746147254.587236:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465746816:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147254.587249:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.587274:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f444200/0xb4b2209fbdad10fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb64 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.587275:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15656 00000100:00100000:2.0:1746147254.587281:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465746944:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147254.587288:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.587298:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9b3600/0xb4b2209fbdad1101 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb6b expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.587313:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467052160:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147254.587322:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467052288:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147254.587376:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465746688 00000100:00100000:0.0:1746147254.587378:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.587380:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465746688 00000100:00100000:1.0:1746147254.587406:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 778 00000100:00100000:1.0:1746147254.587411:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465746688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147254.587420:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147254.587435:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad10f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb5d expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.587452:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147254.587456:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.587624:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.587732:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465746688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 319us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.587738:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 778 00000100:00100000:3.0:1746147254.587798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.587855:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747072 00000100:00100000:2.0:1746147254.587858:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747072 00000100:00100000:2.0:1746147254.587893:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15657 00000100:00100000:2.0:1746147254.587899:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465747072:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147254.587905:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.587911:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb72 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.587921:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.587923:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.587929:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.587960:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.587972:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e798200, rc 0) 00000100:00100000:2.0:1746147254.587988:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465747072:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.587993:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15657 00000100:00100000:2.0:1746147254.588680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.588799:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747200 00000100:00100000:3.0:1746147254.588803:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747200 00000100:00100000:3.0:1746147254.588822:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15658 00000100:00100000:3.0:1746147254.588827:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465747200:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.588834:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.588841:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb79 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.588851:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.588852:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.588857:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.588865:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147254.588872:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49800, rc 0) 00000100:00100000:3.0:1746147254.588891:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465747200:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.588896:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15658 00000100:00100000:0.0:1746147254.589113:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467052160:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147254.589138:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f444200/0xb4b2209fbdad10fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb64 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.589148:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f444200/0xb4b2209fbdad10fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb64 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.589168:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f444200, rc 0) 00000100:00100000:0.0:1746147254.589193:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465746816:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1959us (2105us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147254.589199:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15655 00000100:00100000:2.0:1746147254.589527:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467052288:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.589543:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9b3600/0xb4b2209fbdad1101 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb6b expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.589552:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f9b3600/0xb4b2209fbdad1101 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb6b expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.589572:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9b3600, rc 0) 00000100:00100000:2.0:1746147254.589592:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465746944:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2311us (2408us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.589597:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15656 00000100:00100000:1.0:1746147254.592099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.592213:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747456 00000100:00100000:3.0:1746147254.592221:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747456 00000100:00100000:3.0:1746147254.592251:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11458 00000100:00100000:3.0:1746147254.592257:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:31869:x1830967465747456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.592270:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.592282:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb80 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.592350:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.592361:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.592368:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.592391:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.592400:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 10 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.592410:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467052416:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.592467:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.596048:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467052416:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.596070:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.596174:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.596245:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747584 00000100:00100000:1.0:1746147254.596251:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747584 00010000:00010000:1.0:1746147254.596275:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 11 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.596295:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7949 00000100:00100000:1.0:1746147254.596301:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465747584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147254.596312:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147254.596317:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 11 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.596325:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 11 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.596341:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53200/0xb4b2209fbdad109f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb25 expref: 11 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.596357:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147254.596361:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.596368:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.596373:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.596398:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147254.596420:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.596427:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147254.596430:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465747584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.596436:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7949 00000004:00200000:3.0:1746147254.596442:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147254.596555:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.596571:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.596577:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.596580:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147254.596582:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49e00, rc 0) 00000100:00100000:3.0:1746147254.596985:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465747456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4727us (4890us total) trans 8589945458 rc 0/0 00000100:00100000:3.0:1746147254.596992:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11458 00000100:00100000:0.0:1746147254.600321:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.600501:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747712 00000100:00100000:3.0:1746147254.600509:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747712 00000100:00100000:3.0:1746147254.600559:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11459 00000100:00100000:3.0:1746147254.600566:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465747712:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.600585:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.600599:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad112b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb87 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.600661:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.600672:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.600679:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.600703:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.600713:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 11 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.600722:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467052544:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.600795:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.603031:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467052544:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.603050:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.603711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.603779:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747840 00000100:00100000:2.0:1746147254.603785:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747840 00010000:00010000:2.0:1746147254.603809:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.603843:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7950 00000100:00100000:2.0:1746147254.603849:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465747840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.603860:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.603864:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.603873:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.603889:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad111d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb80 expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.604029:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.604033:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.604041:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.604046:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.604064:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147254.604072:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.604078:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147254.604093:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465747840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 244us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.604098:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7950 00000004:00200000:3.0:1746147254.604109:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147254.604112:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147254.604123:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.604158:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad112b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb87 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.604267:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb87 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.604274:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.604276:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147254.604278:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49200, rc 0) 00000100:00100000:3.0:1746147254.604316:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465747712:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3751us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.604322:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11459 00000100:00100000:0.0:1746147254.612441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.612680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.613363:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465747968 00000100:00100000:2.0:1746147254.613371:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465747968 00000100:00100000:2.0:1746147254.613412:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465748096 00000100:00100000:2.0:1746147254.613415:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465748096 00000100:00100000:2.0:1746147254.613431:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15659 00000100:00100000:2.0:1746147254.613437:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465747968:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147254.613450:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.613461:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e798a00/0xb4b2209fbdad1139 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb8e expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.613497:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467052672:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147254.613564:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.613587:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15660 00000100:00100000:2.0:1746147254.613592:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465748096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147254.613599:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.613607:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e799000/0xb4b2209fbdad1140 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb95 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.613628:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467052800:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147254.613648:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.615861:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467052672:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.615888:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e798a00/0xb4b2209fbdad1139 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb8e expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.615900:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e798a00/0xb4b2209fbdad1139 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb8e expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.616160:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e798a00, rc 0) 00000100:00100000:2.0:1746147254.616199:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465747968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2761us (3764us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.616206:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15659 00000100:00100000:2.0:1746147254.617359:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467052800:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147254.617378:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e799000/0xb4b2209fbdad1140 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb95 expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.617387:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e799000/0xb4b2209fbdad1140 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb95 expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.617394:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e799000, rc 0) 00000100:00100000:2.0:1746147254.617424:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465748096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3831us (4744us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147254.617430:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15660 00000100:00100000:0.0:1746147254.622159:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.622217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.622342:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465748352 00000100:00100000:3.0:1746147254.622353:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465748352 00000100:00100000:3.0:1746147254.622398:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465748608 00000100:00100000:3.0:1746147254.622400:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465748608 00000100:00100000:3.0:1746147254.622432:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11460 00000100:00100000:3.0:1746147254.622439:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465748352:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147254.622458:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.622477:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49000/0xb4b2209fbdad1147 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecb9c expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.622568:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622581:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622592:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147254.622602:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147254.622713:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49000/0xb4b2209fbdad1147 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 13 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.622731:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.622738:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.622741:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147254.622745:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49400, rc 0) 00000100:00100000:3.0:1746147254.622791:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:31869:x1830967465748352:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 352us (643us total) trans 8589945459 rc 0/0 00000100:00100000:3.0:1746147254.622798:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11460 00000100:00100000:3.0:1746147254.622811:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11461 00000100:00100000:3.0:1746147254.622817:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31871:x1830967465748608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147254.622825:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.622831:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad115c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecba3 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.622890:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622898:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622904:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622915:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622921:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.622926:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.623024:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.623035:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.623042:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.623069:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.623081:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 11 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.623093:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467052928:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.623158:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.625315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.625397:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465748864 00000100:00100000:1.0:1746147254.625406:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465748864 00000100:00100000:1.0:1746147254.625441:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11462 00000100:00100000:1.0:1746147254.625448:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+307:31874:x1830967465748864:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147254.625468:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.625482:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbaa expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.625571:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625583:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625592:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625602:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625607:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625612:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625709:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625717:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.625723:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147254.626165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.626194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.626220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.626241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.626253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.626278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.626329:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465748992 00000100:00100000:1.0:1746147254.626333:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465748992 00000100:00100000:1.0:1746147254.626351:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749248 00000100:00100000:1.0:1746147254.626353:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749248 00000100:00100000:1.0:1746147254.626365:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749504 00000100:00100000:1.0:1746147254.626366:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749504 00000100:00100000:1.0:1746147254.626374:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749120 00000100:00100000:1.0:1746147254.626376:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749120 00000100:00100000:1.0:1746147254.626383:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749376 00000100:00100000:1.0:1746147254.626384:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749376 00000100:00100000:1.0:1746147254.626389:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749632 00000100:00100000:1.0:1746147254.626391:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749632 00000100:00100000:1.0:1746147254.626399:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15661 00000100:00100000:1.0:1746147254.626404:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465748992:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147254.626431:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626445:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 42 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626452:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.626459:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.626464:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.626466:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.626468:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626496:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.626511:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 27 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.626526:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467053056:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.626597:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.626608:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 12 pid: 4444 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.626615:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467053184:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.626633:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 42 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626639:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 42 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.626646:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467053312:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.626657:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.626672:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15662 00000100:00100000:1.0:1746147254.626677:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465749248:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147254.626694:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626704:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626708:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147254.626710:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147254.626711:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626728:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626735:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 28 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.626742:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467053440:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.626755:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.626770:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15663 00000100:00100000:1.0:1746147254.626775:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465749504:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147254.626798:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626806:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626812:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.626816:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.626817:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.626819:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626830:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.626837:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 12 pid: 21080 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.626886:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467053568:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.626976:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.626984:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 42 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.627003:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467053696:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.627050:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.627063:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15664 00000100:00100000:1.0:1746147254.627068:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465749120:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147254.627092:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.627101:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.627117:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.627139:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.627144:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.627145:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.627147:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.627160:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.627165:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 28 pid: 17548 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.627172:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467053824:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.627213:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.627221:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 29 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.627227:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467053952:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.627266:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.627272:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746147254.627294:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467054080:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.627303:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.627423:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15665 00000100:00100000:2.0:1746147254.627430:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465749376:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147254.627456:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627471:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 42 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627476:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.627477:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.627479:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627496:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 42 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627502:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 42 pid: 17548 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.627508:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467054208:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.627532:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.627585:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15666 00000100:00100000:2.0:1746147254.627590:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465749632:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147254.627608:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627624:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627630:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.627634:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.627635:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.627636:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627658:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.627665:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 13 pid: 17548 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.627684:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467054336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.627712:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.627718:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 28 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.627736:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467054464:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.627746:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.630046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.630142:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467052928:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.630176:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147254.630677:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749760 00000100:00100000:2.0:1746147254.630696:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749760 00010000:00010000:2.0:1746147254.630741:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.631007:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7951 00000100:00100000:2.0:1746147254.631014:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465749760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.631027:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.631033:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.631043:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.631063:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49400/0xb4b2209fbdad114e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb9c expref: 12 pid: 23726 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746147254.632269:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467053056:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.632361:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.632366:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.632376:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.632381:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147254.632389:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147254.632393:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147254.632396:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632500:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632507:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147254.632522:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147254.632624:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632629:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632634:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632639:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dd600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147254.632642:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632647:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632654:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147254.632656:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147254.632658:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632666:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd600/0xb4b2209fbdad118d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632682:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632686:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632690:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632694:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dd800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147254.632696:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632700:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632706:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147254.632708:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147254.632710:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632714:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd800/0xb4b2209fbdad117f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632722:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632727:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632731:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632736:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dda00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147254.632738:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632743:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632748:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473e00) 00010000:00010000:1.0:1746147254.632750:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147254.632752:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632756:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dda00/0xb4b2209fbdad1186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147254.632792:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1178 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbaa expref: 309 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.632799:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbaa expref: 309 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.632808:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9ddc00, rc 0) 00000100:00100000:1.0:1746147254.632866:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31874:x1830967465748864:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7417us (7557us total) trans 8589945460 rc 301/301 00000100:00100000:1.0:1746147254.632875:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11462 00010000:00010000:2.0:1746147254.633851:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.633885:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465749760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2869us (3844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.633894:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7951 00010000:00010000:3.0:1746147254.633960:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.633967:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147254.633980:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147254.634074:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634081:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634090:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634095:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc49c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.634098:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634104:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634114:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.634116:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147254.634119:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634124:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49c00/0xb4b2209fbdad1171 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634163:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634168:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634207:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634231:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc49600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.634233:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634238:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634248:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147254.634267:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.634269:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634285:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49600/0xb4b2209fbdad1163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634309:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634313:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634317:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634321:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc48e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.634323:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634338:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634343:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473e00) 00010000:00010000:3.0:1746147254.634345:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.634357:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634361:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48e00/0xb4b2209fbdad116a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.634412:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad115c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecba3 expref: 15 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.634429:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49e00/0xb4b2209fbdad115c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecba3 expref: 15 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.634456:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49e00, rc 0) 00000100:00100000:3.0:1746147254.634510:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31871:x1830967465748608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11692us (12292us total) trans 8589945461 rc 301/301 00000100:00100000:3.0:1746147254.634516:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11461 00000100:00100000:1.0:1746147254.635084:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467053184:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.635106:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467053312:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.635145:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.638891:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467053568:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.638905:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467053696:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.638926:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.639101:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467053440:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.639146:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.639593:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467053952:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147254.639611:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467054080:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.639984:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467054208:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.640030:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.640117:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467054336:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.640137:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467054464:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.640154:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.640162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.640234:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467053824:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147254.640253:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.640352:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750144 00000100:00100000:3.0:1746147254.640358:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750144 00010000:00010000:3.0:1746147254.640390:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.640414:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7952 00000100:00100000:3.0:1746147254.640421:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967465750144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.640437:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.640457:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.640467:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.640493:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e798200/0xb4b2209fbdad1108 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb72 expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.640512:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.640554:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465750144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 133us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.640559:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7952 00000100:00100000:2.0:1746147254.640608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.640960:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750272 00000100:00100000:3.0:1746147254.640963:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750272 00002000:00100000:3.0:1746147254.640990:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1294336->2097151) req@ffff8800b52e3800 x1830967465750272/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.640998:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3800 with x1830967465750272 ext(1294336->2097151) 00010000:00010000:3.0:1746147254.641004:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.641012:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.641017:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e3800 00000100:00100000:3.0:1746147254.641085:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2541 00000100:00100000:3.0:1746147254.641090:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465750272:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147254.646644:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147254.646667:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467054592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147254.646731:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147254.646824:0:11221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467054592 00000100:00100000:3.0:1746147254.646831:0:11221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467054592 00000100:00100000:3.0:1746147254.646870:0:11221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1746147254.646876:0:11221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967467054592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746147254.646899:0:11221:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 587268096 pending 34078720 free 3847225344 avail 3845128192 00000100:00100000:3.0:1746147254.646933:0:11221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967467054592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.646956:0:11221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746147254.647063:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467054592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147254.654280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.654700:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.654766:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750912 00000100:00100000:2.0:1746147254.654774:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750912 00010000:00010000:2.0:1746147254.654804:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 14 pid: 17548 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.654828:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7953 00000100:00100000:2.0:1746147254.654835:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1958:x1830967465750912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.654845:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.654864:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 14 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.654875:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 14 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.654892:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xb4b2209fbdad110f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb79 expref: 14 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.654923:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.654974:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1958:x1830967465750912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 139us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.654980:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7953 00000100:00100000:2.0:1746147254.655014:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750784 00000100:00100000:2.0:1746147254.655016:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750784 00010000:00010000:2.0:1746147254.655026:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.655040:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7954 00000100:00100000:2.0:1746147254.655044:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465750784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.655049:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.655066:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655072:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655082:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98da00/0xb4b2209fbdad10c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb48 expref: 43 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655090:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.655092:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.655095:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.655102:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.655140:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.655154:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967465750784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.655159:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7954 00010000:00010000:0.0:1746147254.655184:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.655194:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.655197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.655209:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465751040 00000100:00100000:2.0:1746147254.655211:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465751040 00010000:00010000:0.0:1746147254.655212:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.655220:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 31 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.655220:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.655226:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.655231:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7955 00000100:00100000:2.0:1746147254.655235:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465751040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.655237:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5f4000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147254.655241:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147254.655241:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.655248:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.655250:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 31 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.655258:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.655260:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 31 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.655264:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f4000/0xb4b2209fbdad11a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.655270:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9a00/0xb4b2209fbdad0f10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca14 expref: 31 pid: 17548 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.655279:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.655292:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465751040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.655296:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7955 00000100:00100000:0.0:1746147254.655305:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465749504:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 28529us (29084us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.655313:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15663 00000100:00100000:2.0:1746147254.655340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.655356:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465749888 00000100:00100000:2.0:1746147254.655359:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465749888 00010000:00010000:2.0:1746147254.655369:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 28 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.655384:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7956 00000100:00100000:2.0:1746147254.655388:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465749888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.655393:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.655402:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 28 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.655413:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 28 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.655423:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad0f56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca5a expref: 28 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.655431:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.655449:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465749888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.655454:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7956 00000100:00100000:2.0:1746147254.655484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.655492:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750400 00000100:00100000:2.0:1746147254.655494:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750400 00010000:00010000:2.0:1746147254.655504:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.655516:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7957 00000100:00100000:2.0:1746147254.655520:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465750400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.655526:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.655533:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655539:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655555:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093854a00/0xb4b2209fbdad0f3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca3e expref: 30 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655562:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.655573:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465750400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.655578:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7957 00000100:00100000:2.0:1746147254.655608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.655621:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750656 00000100:00100000:2.0:1746147254.655624:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750656 00002000:00100000:2.0:1746147254.655641:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1122303) req@ffff8800b52e3100 x1830967465750656/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.655650:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3100 with x1830967465750656 ext(1048576->1122303) 00010000:00010000:2.0:1746147254.655655:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 42 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.655673:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 42 pid: 17548 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746147254.655679:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e3100 00000100:00100000:3.0:1746147254.655684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.655696:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2542 00000100:00100000:2.0:1746147254.655701:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465750656:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147254.655704:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750016 00000100:00100000:3.0:1746147254.655710:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750016 00010000:00010000:3.0:1746147254.655735:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 11 pid: 4444 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.655757:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7958 00000100:00100000:3.0:1746147254.655763:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465750016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.655772:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.655787:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 11 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.655797:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 11 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.655817:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b53800/0xb4b2209fbdad1059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaf4 expref: 11 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.655834:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.655858:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465750016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.655864:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7958 00000100:00100000:2.0:1746147254.656659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.656763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.656777:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465750528 00000100:00100000:2.0:1746147254.656780:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465750528 00010000:00010000:2.0:1746147254.656793:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.656807:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465751168 00000100:00100000:2.0:1746147254.656809:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465751168 00010000:00010000:2.0:1746147254.656816:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 30 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.656829:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7959 00000100:00100000:2.0:1746147254.656833:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465750528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.656839:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.656848:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.656856:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.656866:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094683e00/0xb4b2209fbdad0df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec99d expref: 13 pid: 21080 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.656875:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.656876:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.656879:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.656885:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.656904:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.656921:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465750528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.656926:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7959 00000100:00100000:2.0:1746147254.656951:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7960 00000100:00100000:2.0:1746147254.656956:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465751168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.656962:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.656971:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 30 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.656978:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 30 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.656988:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093855e00/0xb4b2209fbdad10d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb56 expref: 30 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.656995:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.656996:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.656998:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657004:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657014:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.657025:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465751168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.657030:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7960 00000100:00100000:2.0:1746147254.657101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.657115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.657122:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465751296 00000100:00100000:2.0:1746147254.657135:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465751296 00010000:00010000:2.0:1746147254.657145:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 44 pid: 4444 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.657156:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7961 00000100:00100000:2.0:1746147254.657160:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465751296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.657165:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.657172:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 44 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.657179:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 44 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.657188:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093855400/0xb4b2209fbdad0f33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eca37 expref: 44 pid: 4444 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.657193:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.657195:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.657197:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657203:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657217:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.657228:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465751296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.657232:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7961 00010000:00010000:2.0:1746147254.657244:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657250:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657262:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657267:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657273:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657277:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dc800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147254.657280:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657285:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657296:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657300:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.657324:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465748992:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 30920us (31161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.657329:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15661 00000100:00100000:2.0:1746147254.657359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.657366:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465751680 00000100:00100000:2.0:1746147254.657368:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465751680 00000100:00100000:2.0:1746147254.657378:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15667 00000100:00100000:2.0:1746147254.657382:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31871:x1830967465751680:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147254.657390:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.657397:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbb8 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657407:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657412:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.657413:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147254.657416:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1765376->1892351] (req 1765376->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657427:0:8481:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657435:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1765376->1892351] (req 1765376->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.657441:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e798e00, rc 0) 00000100:00100000:2.0:1746147254.657450:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31871:x1830967465751680:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 68us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.657454:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15667 00000100:00100000:3.0:1746147254.657546:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465751552 00000100:00100000:3.0:1746147254.657551:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465751552 00000100:00100000:3.0:1746147254.657583:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11463 00000100:00100000:3.0:1746147254.657588:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31876:x1830967465751552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.657606:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.657621:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad11d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbb1 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657674:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657681:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657694:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657704:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657710:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.657714:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.657714:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5f4a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147254.657717:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657722:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.657725:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.657729:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.657730:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.657733:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.657734:0:8480:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.657740:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.657745:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657750:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657755:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147254.657760:0:8480:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.657770:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467054720:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147254.657804:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40820c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147254.657848:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657856:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657862:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.657862:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657868:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746147254.657870:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147254.657880:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657884:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657890:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657894:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e798c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147254.657896:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657901:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657909:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.657914:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e798c00/0xb4b2209fbdad11b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.657964:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.657967:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465749632:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 30377us (31688us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147254.657971:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.657973:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15666 00010000:00010000:3.0:1746147254.657975:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657980:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8ed000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.657984:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657989:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.657997:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.657999:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147254.658001:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658006:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed000/0xb4b2209fbdad11e8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658016:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658020:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658025:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658032:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8ecc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.658034:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658037:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658042:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147254.658043:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.658045:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658048:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad11da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658054:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658058:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658062:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658065:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8ece00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.658066:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658070:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658075:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473e00) 00010000:00010000:3.0:1746147254.658076:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.658078:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658082:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ece00/0xb4b2209fbdad11e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147254.658107:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad11d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb1 expref: 16 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.658112:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad11d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb1 expref: 16 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.658120:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8eca00, rc 0) 00000100:00100000:3.0:1746147254.658148:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31876:x1830967465751552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 559us (1046us total) trans 8589945462 rc 301/301 00000100:00100000:3.0:1746147254.658153:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11463 00000100:00100000:2.0:1746147254.661615:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467055232:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.661660:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147254.661681:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746147254.661685:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b57d6275-d138-4373-818f-9bad59bb9e6f:3295:1830967467054848:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.661704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147254.661722:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830967467055360:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.661739:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147254.661759:0:14045:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467054848 00000100:00100000:2.0:1746147254.661765:0:14045:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467054848 00000100:00100000:2.0:1746147254.661792:0:14045:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1746147254.661798:0:14045:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3295:x1830967467054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.661828:0:14045:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3295:x1830967467054848:12345-0@lo:400:kworker.0 Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.661833:0:14045:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1746147254.661860:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b57d6275-d138-4373-818f-9bad59bb9e6f:3295:1830967467054848:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.661882:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467055360 00000100:00100000:2.0:1746147254.661884:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467055360 00000100:00100000:2.0:1746147254.661901:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1746147254.661905:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830967467055360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.661929:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830967467055360:12345-0@lo:400:kworker.0 Request processed in 24us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.661934:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1746147254.661970:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830967467055360:0@lo:400:kworker.0 00000100:00100000:1.0:1746147254.662187:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830967467055104:0@lo:400:kworker.0 00000100:00100000:1.0:1746147254.662210:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147254.662224:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147254.662227:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830967467054976:0@lo:400:kworker.0 00000100:00100000:1.0:1746147254.662239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147254.662287:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467054720:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147254.662302:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.662311:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f4a00/0xb4b2209fbdad11a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.662358:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465749120:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 35288us (36114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.662364:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15664 00000100:00100000:1.0:1746147254.662376:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467055232 00000100:00100000:1.0:1746147254.662379:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467055232 00000100:00100000:1.0:1746147254.662391:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746147254.662395:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967467055232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147254.662417:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967467055232:12345-0@lo:400:kworker.0 Request processed in 22us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.662495:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465750656:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6792us (6884us total) trans 17179874042 rc 0/0 00000100:00100000:1.0:1746147254.662500:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746147254.662502:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2542 00002000:00100000:2.0:1746147254.662510:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1122303) req@ffff8800b52e3100 x1830967465750656/t17179874042(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.662518:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3100 with x1830967465750656 ext(1048576->1122303) 00010000:00010000:2.0:1746147254.662525:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.662534:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746147254.662540:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e3100 00000100:00100000:2.0:1746147254.662562:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467055232:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.662573:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467055104 00000100:00100000:2.0:1746147254.662576:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467055104 00000100:00100000:2.0:1746147254.662620:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467054976 00000100:00100000:2.0:1746147254.662622:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467054976 00000100:00100000:2.0:1746147254.662635:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1746147254.662639:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830967467055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.662667:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830967467055104:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.662671:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1746147254.662690:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1746147254.662695:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967467054976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147254.662706:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830967467055104:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.662713:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967467054976:12345-0@lo:400:kworker.0 Request processed in 18us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.662716:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830967467054976:0@lo:400:kworker.0 00000100:00100000:2.0:1746147254.662717:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1746147254.662729:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147254.663118:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465750272:12345-192.168.203.36@tcp:4:cat.0 Request processed in 22026us (22509us total) trans 21474841393 rc 0/0 00000100:00100000:3.0:1746147254.663135:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2541 00002000:00100000:3.0:1746147254.663140:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1294336->2097151) req@ffff8800b52e3800 x1830967465750272/t21474841393(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.663147:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3800 with x1830967465750272 ext(1294336->2097151) 00010000:00010000:3.0:1746147254.663152:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.663160:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746147254.663169:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e3800 00000100:00100000:0.0:1746147254.663639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.663671:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465751936 00000100:00100000:3.0:1746147254.663674:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465751936 00002000:00100000:3.0:1746147254.663693:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1765376->1769471) req@ffff88009e584e00 x1830967465751936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.663700:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584e00 with x1830967465751936 ext(1765376->1769471) 00002000:00010000:3.0:1746147254.663703:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584e00 00000100:00100000:3.0:1746147254.663715:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7402 00000100:00100000:3.0:1746147254.663720:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465751936:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147254.663807:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465751936:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 86us (168us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147254.663813:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7402 00002000:00100000:3.0:1746147254.663817:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1765376->1769471) req@ffff88009e584e00 x1830967465751936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.663824:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584e00 with x1830967465751936 ext(1765376->1769471) 00002000:00010000:3.0:1746147254.663826:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584e00 00000100:00100000:0.0:1746147254.665577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.665682:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465752064 00000100:00100000:2.0:1746147254.665687:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465752064 00010000:00010000:2.0:1746147254.665706:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.665737:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7962 00000100:00100000:2.0:1746147254.665742:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465752064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.665756:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.665769:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.665778:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.665800:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad0ffe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecabc expref: 29 pid: 21080 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.665811:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.665812:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.665815:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.665822:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.665849:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.665878:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465752064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.665883:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7962 00010000:00010000:1.0:1746147254.665955:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.665964:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.665979:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.665986:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.665991:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.665997:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c1000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147254.666000:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.666006:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.666014:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.666019:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad119b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.666054:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465749248:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 39376us (39859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.666061:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15662 00000100:00100000:0.0:1746147254.666911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.666934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.666951:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465752192 00000100:00100000:2.0:1746147254.666954:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465752192 00010000:00010000:2.0:1746147254.666967:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.666986:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7963 00000100:00100000:2.0:1746147254.666991:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465752192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.666998:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.667010:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746147254.667018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147254.667023:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.667035:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8200/0xb4b2209fbdad100c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecaca expref: 43 pid: 17548 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.667044:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.667045:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.667047:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667053:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667067:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.667085:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465752192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.667090:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7963 00010000:00010000:2.0:1746147254.667106:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667113:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667137:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667148:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667154:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.667155:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465752448 00000100:00100000:3.0:1746147254.667159:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465752448 00010000:00010000:2.0:1746147254.667159:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e799200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147254.667161:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667168:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.667180:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.667181:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4789 00010000:00010000:2.0:1746147254.667186:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e799200/0xb4b2209fbdad11b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.667191:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31876:x1830967465752448:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147254.667219:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465749376:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 39790us (40964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.667225:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15665 00000100:00100000:3.0:1746147254.667314:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31876:x1830967465752448:12345-192.168.203.36@tcp:35:cat.0 Request processed in 128us (379us total) trans 8589945463 rc 0/0 00000100:00100000:3.0:1746147254.667320:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4789 00000100:00100000:3.0:1746147254.667338:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465752704 00000100:00100000:3.0:1746147254.667341:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465752704 00002000:00100000:3.0:1746147254.667356:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1888256->1892351) req@ffff88009e587100 x1830967465752704/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.667585:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587100 with x1830967465752704 ext(1888256->1892351) 00002000:00010000:3.0:1746147254.667589:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587100 00000100:00100000:3.0:1746147254.667615:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7403 00000100:00100000:3.0:1746147254.667621:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465752704:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147254.667725:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465752704:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 104us (705us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147254.667731:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7403 00002000:00100000:3.0:1746147254.667736:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1888256->1892351) req@ffff88009e587100 x1830967465752704/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.667743:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587100 with x1830967465752704 ext(1888256->1892351) 00002000:00010000:3.0:1746147254.667745:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587100 00000100:00100000:0.0:1746147254.668506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.668549:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465752960 00000100:00100000:2.0:1746147254.668552:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465752960 00000100:00100000:2.0:1746147254.668574:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11464 00000100:00100000:2.0:1746147254.668577:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:31869:x1830967465752960:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147254.668597:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.668607:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc49200/0xb4b2209fbdad1132 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecb87 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.668616:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.668637:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.668729:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465752960:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 150us (223us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746147254.668735:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11464 00000100:00100000:0.0:1746147254.670187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.670222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.670237:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465753344 00000100:00100000:3.0:1746147254.670241:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465753344 00000100:00100000:3.0:1746147254.670265:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4790 00000100:00100000:3.0:1746147254.670270:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31871:x1830967465753344:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147254.671774:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31871:x1830967465753344:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1500us (1548us total) trans 8589945464 rc 0/0 00000100:00100000:3.0:1746147254.671782:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4790 00000100:00100000:1.0:1746147254.671903:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.671984:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465753600 00000100:00100000:3.0:1746147254.671988:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465753600 00000100:00100000:3.0:1746147254.672008:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4791 00000100:00100000:3.0:1746147254.672014:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:31869:x1830967465753600:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147254.672100:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:31869:x1830967465753600:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 86us (198us total) trans 8589945465 rc 0/0 00000100:00100000:3.0:1746147254.672105:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4791 00000100:00100000:2.0:1746147254.672226:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465753088 00000100:00100000:2.0:1746147254.672231:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465753088 00000100:00100000:2.0:1746147254.672687:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11465 00000100:00100000:2.0:1746147254.672694:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31876:x1830967465753088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.672703:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.672715:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799600/0xb4b2209fbdad11f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbbf expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.672757:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147254.672766:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147254.672774:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147254.672788:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147254.672791:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147254.672798:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147254.672813:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799600/0xb4b2209fbdad11f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.672824:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.672830:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.672832:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147254.672834:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e799800, rc 0) 00000100:00100000:2.0:1746147254.672980:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31876:x1830967465753088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 286us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.672985:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11465 00000100:00100000:1.0:1746147254.677468:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147254.677484:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467055488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147254.677534:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147254.677603:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467055488 00000100:00100000:0.0:1746147254.677609:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467055488 00000100:00100000:0.0:1746147254.677636:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1746147254.677641:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3294:x1830967467055488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147254.677659:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 609288192 pending 39190528 free 3843031040 avail 3840933888 00000100:00100000:0.0:1746147254.677690:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3294:x1830967467055488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.677695:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1746147254.680296:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467055488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147254.680676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.680704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.680738:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465753984 00000100:00100000:3.0:1746147254.680743:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465753984 00000100:00100000:3.0:1746147254.680771:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4792 00000100:00100000:3.0:1746147254.680778:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:31869:x1830967465753984:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147254.680778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.680821:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465753728 00000100:00100000:1.0:1746147254.680824:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465753728 00000100:00100000:1.0:1746147254.680841:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465754112 00000100:00100000:1.0:1746147254.680842:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465754112 00000100:00100000:1.0:1746147254.680853:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15668 00000100:00100000:1.0:1746147254.680857:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465753728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147254.680865:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.680878:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbc6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147254.680896:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417b5, atime: 0x681417b5, ctime: 0x681417b5, blocks: 0x7c9 00010000:00010000:1.0:1746147254.680908:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.680910:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.680917:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147254.680926:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:31869:x1830967465753984:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 149us (221us total) trans 8589945466 rc 0/0 00010000:00010000:1.0:1746147254.680929:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147254.680932:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4792 00010000:00010000:1.0:1746147254.680954:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f5c00, rc 0) 00000100:00100000:1.0:1746147254.680969:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465753728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.680973:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15668 00000100:00100000:1.0:1746147254.680982:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15669 00000100:00100000:1.0:1746147254.680986:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465754112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147254.680992:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.681001:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbcd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147254.681012:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417b6, atime: 0x681417b6, ctime: 0x681417b6, blocks: 0x821 00010000:00010000:1.0:1746147254.681019:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.681020:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.681029:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 31 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.681039:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 31 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.681046:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f5800, rc 0) 00000100:00100000:1.0:1746147254.681062:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465754112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.681067:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15669 00000100:00100000:0.0:1746147254.681489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.684287:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465754240 00000100:00100000:2.0:1746147254.684296:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465754240 00000100:00100000:2.0:1746147254.684328:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15670 00000100:00100000:2.0:1746147254.684334:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465754240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147254.684346:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.684359:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbd4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147254.684377:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417b6, atime: 0x681417b6, ctime: 0x681417b6, blocks: 0x821 00010000:00010000:2.0:1746147254.684390:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.684392:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.684398:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.684409:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.684418:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e799a00, rc 0) 00000100:00100000:2.0:1746147254.684452:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465754240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 119us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.684457:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15670 00000100:00100000:1.0:1746147254.685475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.685507:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465754368 00000100:00100000:0.0:1746147254.685512:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465754368 00000100:00100000:0.0:1746147254.685538:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15671 00000100:00100000:0.0:1746147254.685544:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465754368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.685552:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.685562:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbdb expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147254.685570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147254.685576:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417b6, atime: 0x681417b5, ctime: 0x681417b6, blocks: 0x163d 00000100:00100000:1.0:1746147254.685583:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465754496 00010000:00010000:0.0:1746147254.685584:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.685585:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147254.685586:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465754496 00010000:00010000:0.0:1746147254.685590:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 30 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.685599:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 30 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147254.685601:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15672 00000100:00100000:1.0:1746147254.685606:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465754496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.685606:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f444600, rc 0) 00010000:00010000:1.0:1746147254.685613:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147254.685622:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbe2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.685632:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465754368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (159us total) trans 0 rc 0/0 00002000:00010000:1.0:1746147254.685634:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417b6, atime: 0x681417b5, ctime: 0x681417b6, blocks: 0x1029 00000100:00100000:0.0:1746147254.685637:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15671 00010000:00010000:1.0:1746147254.685641:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.685643:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147254.685647:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.685656:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.685662:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f5200, rc 0) 00000100:00100000:1.0:1746147254.685682:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465754496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 70us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147254.685687:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15672 00000100:00100000:0.0:1746147254.692406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.692447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.692481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.692556:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465754752 00000100:00100000:3.0:1746147254.692567:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465754752 00002000:00100000:3.0:1746147254.692609:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009e585c00 x1830967465754752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.692618:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585c00 with x1830967465754752 ext(0->1048575) 00002000:00010000:3.0:1746147254.692622:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585c00 00000100:00100000:3.0:1746147254.692649:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465755008 00000100:00100000:3.0:1746147254.692652:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465755008 00002000:00100000:3.0:1746147254.692663:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009e584700 x1830967465755008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 504/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.692670:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584700 with x1830967465755008 ext(1048576->2097151) 00000100:00100000:2.0:1746147254.692670:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465755264 00002000:00010000:3.0:1746147254.692673:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584700 00000100:00100000:2.0:1746147254.692677:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465755264 00000100:00100000:3.0:1746147254.692700:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7404 00000100:00100000:3.0:1746147254.692706:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465754752:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147254.692710:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e585880 x1830967465755264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.692718:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585880 with x1830967465755264 ext(1048576->2097151) 00002000:00010000:2.0:1746147254.692723:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e585880 00000100:00100000:1.0:1746147254.692733:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7405 00000100:00100000:1.0:1746147254.692742:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465755008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.692749:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7406 00000100:00100000:2.0:1746147254.692756:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465755264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.694198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.694215:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465755520 00000100:00100000:0.0:1746147254.694218:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465755520 00002000:00100000:0.0:1746147254.694242:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e586a00 x1830967465755520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.694249:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e586a00 with x1830967465755520 ext(1048576->2097151) 00002000:00010000:0.0:1746147254.694253:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e586a00 00000100:00100000:3.0:1746147254.694289:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7407 00000100:00100000:3.0:1746147254.694298:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465755520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.703365:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1956:x1830967465755008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10616us (10908us total) trans 0 rc 921600/921600 00000100:00100000:1.0:1746147254.703375:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7405 00002000:00100000:1.0:1746147254.703385:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009e584700 x1830967465755008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 504/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.703399:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584700 with x1830967465755008 ext(1048576->2097151) 00002000:00010000:1.0:1746147254.703404:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584700 00000100:00100000:2.0:1746147254.709780:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465755264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17016us (17289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.709790:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7406 00002000:00100000:2.0:1746147254.709800:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e585880 x1830967465755264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.709807:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585880 with x1830967465755264 ext(1048576->2097151) 00002000:00010000:2.0:1746147254.709813:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e585880 00000100:00100000:3.0:1746147254.713186:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465755520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18882us (18983us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.713196:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7407 00002000:00100000:3.0:1746147254.713221:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e586a00 x1830967465755520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.713230:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e586a00 with x1830967465755520 ext(1048576->2097151) 00002000:00010000:3.0:1746147254.713235:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e586a00 00000100:00100000:3.0:1746147254.718567:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465754752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25854us (26164us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.718576:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7404 00002000:00100000:3.0:1746147254.718586:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009e585c00 x1830967465754752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.718594:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585c00 with x1830967465754752 ext(0->1048575) 00002000:00010000:3.0:1746147254.718599:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585c00 00000100:00100000:0.0:1746147254.751448:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.751477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.751505:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465755904 00000100:00100000:0.0:1746147254.751507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.751513:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465755904 00002000:00100000:3.0:1746147254.751548:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e585180 x1830967465755904/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147254.751548:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465756032 00000100:00100000:2.0:1746147254.751552:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465756032 00002000:00100000:3.0:1746147254.751556:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585180 with x1830967465755904 ext(2097152->3145727) 00002000:00010000:3.0:1746147254.751560:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585180 00002000:00100000:2.0:1746147254.751570:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012ecef100 x1830967465756032/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147254.751574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147254.751583:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef100 with x1830967465756032 ext(3145728->4194303) 00002000:00010000:2.0:1746147254.751586:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef100 00000100:00100000:3.0:1746147254.751587:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465756416 00000100:00100000:3.0:1746147254.751590:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465756416 00002000:00100000:3.0:1746147254.751601:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012ecec000 x1830967465756416/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147254.751602:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465756288 00000100:00100000:2.0:1746147254.751605:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465756288 00002000:00100000:3.0:1746147254.751607:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec000 with x1830967465756416 ext(3145728->4194303) 00000100:00100000:0.0:1746147254.751609:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7408 00002000:00010000:3.0:1746147254.751610:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecec000 00002000:00100000:2.0:1746147254.751615:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012ecece00 x1830967465756288/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147254.751615:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465755904:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147254.751621:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967465756288 ext(2097152->3145727) 00000100:00100000:3.0:1746147254.751623:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7409 00002000:00010000:2.0:1746147254.751624:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:3.0:1746147254.751628:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465756032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.751632:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7410 00000100:00100000:1.0:1746147254.751641:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465756416:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.751642:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7411 00000100:00100000:2.0:1746147254.751647:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465756288:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.760280:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465755904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8658us (8829us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.760289:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7408 00002000:00100000:2.0:1746147254.760298:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e585180 x1830967465755904/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.760306:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585180 with x1830967465755904 ext(2097152->3145727) 00002000:00010000:2.0:1746147254.760311:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585180 00000100:00100000:3.0:1746147254.761596:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465756032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9963us (10113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147254.761603:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7409 00002000:00100000:3.0:1746147254.761609:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012ecef100 x1830967465756032/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147254.761616:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef100 with x1830967465756032 ext(3145728->4194303) 00002000:00010000:3.0:1746147254.761619:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef100 00000100:00100000:2.0:1746147254.765440:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465756288:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13785us (13857us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.765450:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7411 00002000:00100000:2.0:1746147254.765461:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012ecece00 x1830967465756288/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.765469:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967465756288 ext(2097152->3145727) 00002000:00010000:2.0:1746147254.765475:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:1.0:1746147254.776417:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465756416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24769us (24900us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.776428:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7410 00002000:00100000:1.0:1746147254.776438:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012ecec000 x1830967465756416/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.776446:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec000 with x1830967465756416 ext(3145728->4194303) 00002000:00010000:1.0:1746147254.776451:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecec000 00000100:00100000:0.0:1746147254.790160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.792201:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465756800 00000100:00100000:1.0:1746147254.792211:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465756800 00002000:00100000:1.0:1746147254.792255:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012ecef800 x1830967465756800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.792264:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef800 with x1830967465756800 ext(4194304->4976639) 00002000:00010000:1.0:1746147254.792269:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef800 00000100:00100000:1.0:1746147254.792306:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7412 00000100:00100000:1.0:1746147254.792312:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465756800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.793093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.793980:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465757056 00000100:00100000:3.0:1746147254.793987:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465757056 00000100:00100000:3.0:1746147254.794018:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11466 00000100:00100000:3.0:1746147254.794025:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+308:31883:x1830967465757056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.794037:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.794052:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed400/0xb4b2209fbdad1227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbe9 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.794142:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794153:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794162:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794174:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794179:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794183:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794262:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794269:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794275:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147254.794282:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147254.794344:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794350:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794355:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794359:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8ed600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.794362:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794367:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794376:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147254.794378:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.794381:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794386:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad122e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794409:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794414:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794418:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794422:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8ed800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147254.794424:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794428:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794433:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473900) 00010000:00010000:3.0:1746147254.794435:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147254.794437:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794441:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed800/0xb4b2209fbdad1235 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147254.794468:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8ed400/0xb4b2209fbdad1227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 311 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.794477:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 310 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.794483:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147254.794485:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147254.794487:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8eda00, rc 0) 00000100:00100000:3.0:1746147254.794519:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+310:31883:x1830967465757056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 495us (1433us total) trans 8589945467 rc 0/0 00000100:00100000:3.0:1746147254.794525:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11466 00000100:00100000:0.0:1746147254.798705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.798730:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465757312 00000100:00100000:0.0:1746147254.798737:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465757312 00000100:00100000:0.0:1746147254.798782:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11467 00000100:00100000:0.0:1746147254.798789:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31882:x1830967465757312:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147254.798808:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.798823:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad124a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbf0 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.798905:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.798915:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.798924:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.798934:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.798959:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.798964:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.799045:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad125f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.799052:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad125f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.799058:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad125f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147254.799068:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147254.799142:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801319:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801325:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801330:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dd400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147254.801333:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801338:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801349:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147254.801352:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147254.801354:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801358:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd400/0xb4b2209fbdad1251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801379:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801384:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801388:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801395:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dd000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147254.801397:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801402:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801407:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13300) 00010000:00010000:0.0:1746147254.801409:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147254.801411:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147254.801415:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdad1258 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147254.801615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.801850:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465756800:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9537us (11727us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746147254.801859:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7412 00002000:00100000:0.0:1746147254.801868:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012ecef800 x1830967465756800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.801877:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef800 with x1830967465756800 ext(4194304->4976639) 00002000:00010000:0.0:1746147254.801881:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef800 00010000:00010000:1.0:1746147254.802033:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad124a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf0 expref: 21 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.802050:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad125f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf0 expref: 20 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147254.802056:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147254.802058:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147254.802060:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9ddc00, rc 0) 00000100:00100000:1.0:1746147254.802081:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31882:x1830967465757312:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3293us (3383us total) trans 8589945468 rc 0/0 00000100:00100000:1.0:1746147254.802087:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11467 00000100:00100000:3.0:1746147254.802167:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465757568 00000100:00100000:3.0:1746147254.802173:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465757568 00000100:00100000:3.0:1746147254.802199:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4793 00000100:00100000:3.0:1746147254.802204:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:31883:x1830967465757568:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147254.802327:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+311:31883:x1830967465757568:12345-192.168.203.36@tcp:35:cat.0 Request processed in 123us (716us total) trans 8589945469 rc 0/0 00000100:00100000:3.0:1746147254.802333:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4793 00000100:00100000:0.0:1746147254.807464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.807870:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465757696 00000100:00100000:1.0:1746147254.807877:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465757696 00000100:00100000:2.0:1746147254.809091:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 779 00000100:00100000:2.0:1746147254.809104:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465757696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.809116:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.809148:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad125f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf0 expref: 20 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.809174:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147254.809178:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.809231:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967465757696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.809237:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 779 00000100:00100000:0.0:1746147254.820918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.822199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.822221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.822241:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465757824 00000100:00100000:0.0:1746147254.822249:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465757824 00000100:00100000:0.0:1746147254.822280:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758080 00000100:00100000:0.0:1746147254.822282:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758080 00000100:00100000:0.0:1746147254.822290:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758336 00000100:00100000:0.0:1746147254.822292:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758336 00000100:00100000:0.0:1746147254.822303:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15673 00000100:00100000:0.0:1746147254.822309:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465757824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.822323:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.822336:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbf7 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.822354:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822355:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822362:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 44 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822375:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 44 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822383:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dd600, rc 0) 00000100:00100000:0.0:1746147254.822420:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465757824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 111us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.822425:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15673 00000100:00100000:0.0:1746147254.822437:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15674 00000100:00100000:0.0:1746147254.822442:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465758080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.822448:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.822456:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc05 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.822470:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822471:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822474:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822483:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822488:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9ddc00, rc 0) 00000100:00100000:0.0:1746147254.822502:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465758080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.822506:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15674 00000100:00100000:0.0:1746147254.822515:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15675 00000100:00100000:0.0:1746147254.822518:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465758336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.822523:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.822529:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc13 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.822537:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822538:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822542:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 44 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822549:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 44 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822559:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dd200, rc 0) 00000100:00100000:0.0:1746147254.822571:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465758336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 52us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.822575:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15675 00000100:00100000:0.0:1746147254.822599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.822610:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465757952 00000100:00100000:0.0:1746147254.822612:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465757952 00000100:00100000:0.0:1746147254.822624:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15676 00000100:00100000:0.0:1746147254.822628:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465757952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.822633:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.822640:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e9dc200/0xb4b2209fbdad1282 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecbfe expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147254.822672:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467055616:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147254.822720:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.822767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.822778:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758208 00000100:00100000:0.0:1746147254.822780:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758208 00000100:00100000:0.0:1746147254.822796:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15677 00000100:00100000:0.0:1746147254.822800:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465758208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.822805:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.822811:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc0c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.822819:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822821:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822825:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 45 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822832:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 45 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822839:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dc800, rc 0) 00000100:00100000:0.0:1746147254.822852:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465758208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 52us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.822856:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15677 00000100:00100000:0.0:1746147254.822886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.822895:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758464 00000100:00100000:0.0:1746147254.822897:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758464 00000100:00100000:0.0:1746147254.822910:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15678 00000100:00100000:0.0:1746147254.822914:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465758464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147254.822919:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.822925:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc1a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.822933:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822934:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.822956:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822965:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.822975:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dca00, rc 0) 00000100:00100000:0.0:1746147254.822989:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465758464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 74us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.822993:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15678 00000100:00100000:0.0:1746147254.823063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.823075:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758592 00000100:00100000:0.0:1746147254.823077:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758592 00000100:00100000:0.0:1746147254.823091:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15679 00000100:00100000:0.0:1746147254.823095:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:31874:x1830967465758592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147254.823100:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147254.823105:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc21 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.823117:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 31 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.823135:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.823140:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.823141:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147254.823143:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2752512->3145727] (req 2752512->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.823160:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.823173:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 33 pid: 17530 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.823181:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467055744:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.823217:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 31 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147254.823224:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 31 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.823231:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467055872:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.823247:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.829339:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467055744:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.829352:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467055872:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147254.829378:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2752512->3145727] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147254.829393:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dcc00, rc 0) 00000100:00100000:0.0:1746147254.829430:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31874:x1830967465758592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6333us (6366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.829438:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15679 00000100:00100000:2.0:1746147254.829578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147254.830010:0:4444:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147253 -> 1746147254 00002000:00010000:1.0:1746147254.830014:0:4444:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147253 -> 1746147254 00002000:00010000:1.0:1746147254.830015:0:4444:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime: 1746147253 -> 1746147254 00000100:00100000:1.0:1746147254.830033:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467055616:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147254.830051:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e9dc200/0xb4b2209fbdad1282 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbfe expref: 32 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.830059:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dc200/0xb4b2209fbdad1282 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbfe expref: 32 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147254.830071:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dc200, rc 0) 00000100:00100000:1.0:1746147254.830089:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465757952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7460us (7489us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147254.830094:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15676 00000100:00100000:0.0:1746147254.830639:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758720 00000100:00100000:0.0:1746147254.830645:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758720 00010000:00010000:0.0:1746147254.830665:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 31 pid: 17530 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746147254.830693:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7964 00000100:00100000:0.0:1746147254.830700:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465758720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147254.830709:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147254.830719:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 31 pid: 17530 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.830728:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 31 pid: 17530 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.830742:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dca00/0xb4b2209fbdad1290 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc1a expref: 31 pid: 17530 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746147254.830752:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.830768:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465758720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.830773:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7964 00000100:00100000:0.0:1746147254.830807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.830890:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465758848 00000100:00100000:3.0:1746147254.830893:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465758848 00010000:00010000:3.0:1746147254.830907:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 32 pid: 4445 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746147254.830921:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7965 00000100:00100000:3.0:1746147254.830925:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967465758848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.830931:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.830961:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 32 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.830970:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 32 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.830980:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5200/0xb4b2209fbdad1220 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe2 expref: 32 pid: 4445 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746147254.830991:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.830992:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.830997:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.831004:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.831027:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.831037:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467056000:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147254.831084:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147254.833691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.834050:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465759104 00000100:00100000:2.0:1746147254.834058:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465759104 00002000:00100000:2.0:1746147254.834096:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8801312a5180 x1830967465759104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.834105:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5180 with x1830967465759104 ext(0->1048575) 00002000:00010000:2.0:1746147254.834109:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5180 00000100:00100000:2.0:1746147254.834136:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7413 00000100:00100000:2.0:1746147254.834143:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465759104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.835086:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467056000:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147254.835103:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147254.835147:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465758848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4221us (4338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147254.835155:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7965 00000100:00100000:1.0:1746147254.841548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.841911:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465759360 00000100:00100000:0.0:1746147254.841918:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465759360 00002000:00100000:0.0:1746147254.841969:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2752512->2756607) req@ffff880134ed4a80 x1830967465759360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.841977:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed4a80 with x1830967465759360 ext(2752512->2756607) 00002000:00010000:0.0:1746147254.841980:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ed4a80 00000100:00100000:0.0:1746147254.841997:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7414 00000100:00100000:0.0:1746147254.842002:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465759360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.842112:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465759360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 109us (572us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147254.842118:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7414 00002000:00100000:0.0:1746147254.842122:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2752512->2756607) req@ffff880134ed4a80 x1830967465759360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.842139:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed4a80 with x1830967465759360 ext(2752512->2756607) 00002000:00010000:0.0:1746147254.842142:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ed4a80 00000100:00100000:0.0:1746147254.852147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.852480:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465759104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18336us (18795us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.852489:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7413 00002000:00100000:2.0:1746147254.852499:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8801312a5180 x1830967465759104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.852507:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5180 with x1830967465759104 ext(0->1048575) 00002000:00010000:2.0:1746147254.852511:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5180 00000100:00100000:1.0:1746147254.852762:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465759488 00000100:00100000:1.0:1746147254.852768:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465759488 00000100:00100000:2.0:1746147254.853134:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15680 00000100:00100000:2.0:1746147254.853143:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:31874:x1830967465759488:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147254.853154:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147254.853167:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc28 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.853187:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.853195:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.853201:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.853202:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.853205:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->3723263] (req 3145728->3723263) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 46 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.853226:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.853235:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.853245:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467056128:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.853312:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147254.853320:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 29 pid: 4444 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.853327:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467056256:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.853342:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.856484:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467056128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147254.856495:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467056256:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147254.856519:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->3723263] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 46 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.856534:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e798600, rc 0) 00000100:00100000:2.0:1746147254.856570:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:31874:x1830967465759488:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3429us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.856577:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15680 00000100:00100000:0.0:1746147254.860208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.860296:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465759616 00000100:00100000:2.0:1746147254.860304:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465759616 00010000:00010000:2.0:1746147254.860333:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.860366:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7966 00000100:00100000:2.0:1746147254.860373:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967465759616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.860383:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.860402:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.860413:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.860431:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd200/0xb4b2209fbdad127b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc13 expref: 46 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.860448:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.860483:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465759616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.860488:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7966 00000100:00100000:1.0:1746147254.871362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.871439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.871787:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465759744 00000100:00100000:2.0:1746147254.871796:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465759744 00010000:00010000:2.0:1746147254.871825:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 30 pid: 4444 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746147254.871859:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7967 00000100:00100000:2.0:1746147254.871866:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465759744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.871876:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.871896:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 30 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.871906:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 30 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.871928:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f444600/0xb4b2209fbdad1219 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbdb expref: 30 pid: 4444 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746147254.871960:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.871962:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.871967:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.871975:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.872001:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.872012:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467056384:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147254.872071:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.872355:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465759872 00000100:00100000:3.0:1746147254.872360:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465759872 00000100:00100000:3.0:1746147254.872386:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15681 00000100:00100000:3.0:1746147254.872391:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:31883:x1830967465759872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.872402:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.872413:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc2f expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.872428:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.872434:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147254.872435:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147254.872437:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.872454:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.872462:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 30 pid: 8481 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.872470:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467056512:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.872493:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.874253:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467056512:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.874275:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.874287:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8ed600, rc 0) 00000100:00100000:3.0:1746147254.874319:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:31883:x1830967465759872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1927us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.874326:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15681 00000100:00100000:2.0:1746147254.874399:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467056384:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147254.874409:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.874425:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465759744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2560us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.874432:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7967 00000100:00100000:0.0:1746147254.879190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.879807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.880674:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465760000 00000100:00100000:1.0:1746147254.880681:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465760000 00002000:00100000:1.0:1746147254.880715:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1765376->1892351) req@ffff8801312a6a00 x1830967465760000/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.880723:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967465760000 ext(1765376->1892351) 00010000:00010000:1.0:1746147254.880731:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 31 pid: 8481 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.880742:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 31 pid: 8481 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.880748:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a6a00 00000100:00100000:1.0:1746147254.880761:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465760256 00000100:00100000:1.0:1746147254.880763:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465760256 00002000:00100000:1.0:1746147254.880774:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3719168->3723263) req@ffff88008d5ded80 x1830967465760256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.880781:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ded80 with x1830967465760256 ext(3719168->3723263) 00002000:00010000:1.0:1746147254.880783:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5ded80 00000100:00100000:1.0:1746147254.882480:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2543 00000100:00100000:1.0:1746147254.882493:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465760000:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147254.882504:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7415 00000100:00100000:0.0:1746147254.882521:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967465760256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.882726:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967465760256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 211us (2918us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147254.882733:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7415 00002000:00100000:0.0:1746147254.882743:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3719168->3723263) req@ffff88008d5ded80 x1830967465760256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.882752:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ded80 with x1830967465760256 ext(3719168->3723263) 00002000:00010000:0.0:1746147254.882758:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5ded80 00000100:00100000:1.0:1746147254.887474:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465760000:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4973us (8278us total) trans 21474841394 rc 0/0 00000100:00100000:1.0:1746147254.887487:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2543 00002000:00100000:1.0:1746147254.887499:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1765376->1892351) req@ffff8801312a6a00 x1830967465760000/t21474841394(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.887510:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967465760000 ext(1765376->1892351) 00010000:00010000:1.0:1746147254.887520:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 33 pid: 8481 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.887534:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 33 pid: 8481 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.887541:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a6a00 00000100:00100000:0.0:1746147254.887925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.888183:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465760512 00000100:00100000:3.0:1746147254.888193:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465760512 00000100:00100000:3.0:1746147254.888238:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4794 00000100:00100000:3.0:1746147254.888245:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+311:31874:x1830967465760512:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147254.888418:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+312:31874:x1830967465760512:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 173us (494us total) trans 8589945470 rc 0/0 00000100:00100000:3.0:1746147254.888424:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4794 00000100:00100000:0.0:1746147254.892783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.893929:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465760640 00000100:00100000:2.0:1746147254.893948:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465760640 00010000:00010000:2.0:1746147254.893979:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 33 pid: 8481 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.894018:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7968 00000100:00100000:2.0:1746147254.894025:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967465760640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.894035:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.894055:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 33 pid: 8481 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.894066:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 33 pid: 8481 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.894085:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e798e00/0xb4b2209fbdad11cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbb8 expref: 33 pid: 8481 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.894112:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.894114:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.894119:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.894134:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.894164:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.894175:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467056640:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147254.894245:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.896293:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467056640:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147254.896310:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.896351:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1958:x1830967465760640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2326us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.896359:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7968 00000100:00100000:0.0:1746147254.908152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.908197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.908292:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465760896 00000100:00100000:1.0:1746147254.908301:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465760896 00002000:00100000:1.0:1746147254.908343:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008d5df480 x1830967465760896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.908352:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967465760896 ext(1048576->2097151) 00002000:00010000:1.0:1746147254.908356:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5df480 00000100:00100000:1.0:1746147254.908375:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465761152 00000100:00100000:1.0:1746147254.908377:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465761152 00002000:00100000:1.0:1746147254.908389:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008d5dd180 x1830967465761152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.908423:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dd180 with x1830967465761152 ext(1048576->2097151) 00002000:00010000:1.0:1746147254.908427:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dd180 00000100:00100000:1.0:1746147254.908451:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7416 00000100:00100000:1.0:1746147254.908458:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465760896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.908678:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7417 00000100:00100000:2.0:1746147254.908686:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465761152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.909706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.909729:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465761408 00000100:00100000:0.0:1746147254.909735:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465761408 00002000:00100000:0.0:1746147254.909770:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008d5dc380 x1830967465761408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.909779:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dc380 with x1830967465761408 ext(1048576->2097151) 00002000:00010000:0.0:1746147254.909784:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dc380 00000100:00100000:0.0:1746147254.909808:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7418 00000100:00100000:0.0:1746147254.909815:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465761408:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147254.913018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.913155:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465761536 00000100:00100000:3.0:1746147254.913167:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465761536 00000100:00100000:3.0:1746147254.913211:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15682 00000100:00100000:3.0:1746147254.913218:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31882:x1830967465761536:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147254.913233:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.913248:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc36 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.913273:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.913280:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147254.913282:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147254.913284:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2199552->2932735] (req 2199552->2932735) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.913310:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.916340:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 34 pid: 17530 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.916360:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467056768:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147254.916565:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.921808:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467056768:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.921835:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2199552->2932735] (req 2199552->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.921851:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8ecc00, rc 0) 00000100:00100000:3.0:1746147254.921896:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+33:31882:x1830967465761536:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8678us (8887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.921903:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15682 00000100:00100000:1.0:1746147254.921980:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465760896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13521us (13837us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.921991:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7416 00002000:00100000:1.0:1746147254.921999:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008d5df480 x1830967465760896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.922007:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967465760896 ext(1048576->2097151) 00002000:00010000:1.0:1746147254.922011:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5df480 00000100:00100000:2.0:1746147254.923556:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465761152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14867us (15353us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147254.923565:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7417 00002000:00100000:2.0:1746147254.923572:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008d5dd180 x1830967465761152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.923579:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dd180 with x1830967465761152 ext(1048576->2097151) 00002000:00010000:2.0:1746147254.923583:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dd180 00000100:00100000:0.0:1746147254.925396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147254.925494:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465761664 00000100:00100000:2.0:1746147254.925504:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465761664 00002000:00100000:2.0:1746147254.925545:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2752512->3145727) req@ffff88008d5df800 x1830967465761664/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147254.925554:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df800 with x1830967465761664 ext(2752512->3145727) 00010000:00010000:2.0:1746147254.925563:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 31 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.925576:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 31 pid: 17530 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746147254.925587:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5df800 00000100:00100000:2.0:1746147254.925615:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2544 00000100:00100000:2.0:1746147254.925621:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465761664:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147254.930228:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465761408:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20406us (20519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.930238:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7418 00002000:00100000:1.0:1746147254.930248:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008d5dc380 x1830967465761408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.930256:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dc380 with x1830967465761408 ext(1048576->2097151) 00002000:00010000:1.0:1746147254.930261:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dc380 00000100:00100000:0.0:1746147254.936516:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465761664:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10882us (11116us total) trans 21474841395 rc 0/0 00000100:00100000:0.0:1746147254.936529:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2544 00002000:00100000:0.0:1746147254.936542:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2752512->3145727) req@ffff88008d5df800 x1830967465761664/t21474841395(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.936551:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df800 with x1830967465761664 ext(2752512->3145727) 00010000:00010000:0.0:1746147254.936563:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.936577:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746147254.936583:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5df800 00000100:00100000:2.0:1746147254.936632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.936815:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465761920 00000100:00100000:0.0:1746147254.936823:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465761920 00002000:00100000:0.0:1746147254.936856:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e1f80 x1830967465761920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.936863:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967465761920 ext(2097152->3145727) 00002000:00010000:0.0:1746147254.936866:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1f80 00000100:00100000:0.0:1746147254.936961:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7419 00000100:00100000:0.0:1746147254.936969:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465761920:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.938504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.939569:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465762048 00000100:00100000:3.0:1746147254.939579:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465762048 00010000:00010000:3.0:1746147254.939616:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.939674:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7969 00000100:00100000:3.0:1746147254.939683:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465762048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147254.939696:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147254.939720:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.939738:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.939762:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdad1297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc21 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746147254.939897:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.939900:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147254.939912:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.939919:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.940161:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147254.940174:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467056896:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147254.940262:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147254.944176:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467056896:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147254.944203:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147254.944256:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967465762048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4572us (5755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.944267:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7969 00000100:00100000:0.0:1746147254.944708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.944744:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465761920:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7768us (8105us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147254.944754:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7419 00002000:00100000:1.0:1746147254.944764:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e1f80 x1830967465761920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.944771:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967465761920 ext(2097152->3145727) 00002000:00010000:1.0:1746147254.944777:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1f80 00000100:00100000:1.0:1746147254.944797:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465762304 00000100:00100000:1.0:1746147254.944802:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465762304 00002000:00100000:1.0:1746147254.944825:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2199552->2203647) req@ffff88008d5ddf80 x1830967465762304/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.944836:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddf80 with x1830967465762304 ext(2199552->2203647) 00002000:00010000:1.0:1746147254.944839:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5ddf80 00000100:00100000:1.0:1746147254.944864:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7420 00000100:00100000:1.0:1746147254.944870:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967465762304:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147254.945201:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967465762304:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 329us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147254.945207:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7420 00002000:00100000:0.0:1746147254.945214:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2199552->2203647) req@ffff88008d5ddf80 x1830967465762304/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.945222:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddf80 with x1830967465762304 ext(2199552->2203647) 00002000:00010000:0.0:1746147254.945227:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5ddf80 00000100:00100000:0.0:1746147254.953573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.953717:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465762432 00000100:00100000:3.0:1746147254.953728:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465762432 00000100:00100000:3.0:1746147254.953775:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15683 00000100:00100000:3.0:1746147254.953783:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:31883:x1830967465762432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147254.953802:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147254.953819:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc3d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.953850:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.953857:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147254.953859:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147254.953861:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.953892:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.953903:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 32 pid: 17530 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746147254.953916:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467057024:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147254.954730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.954814:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147254.954866:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465762688 00000100:00100000:1.0:1746147254.954870:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465762688 00002000:00100000:1.0:1746147254.954896:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2928640->2932735) req@ffff88008d5dea00 x1830967465762688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.954905:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967465762688 ext(2928640->2932735) 00010000:00010000:1.0:1746147254.954911:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.954920:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.954926:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dea00 00000100:00100000:1.0:1746147254.955081:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2545 00000100:00100000:1.0:1746147254.955088:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465762688:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147254.956194:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465762688:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1101us (1460us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147254.956201:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2545 00002000:00100000:1.0:1746147254.956209:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2928640->2932735) req@ffff88008d5dea00 x1830967465762688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.956222:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967465762688 ext(2928640->2932735) 00010000:00010000:1.0:1746147254.956228:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.956238:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.956243:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dea00 00000100:00100000:3.0:1746147254.958088:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467057024:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147254.958133:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147254.958158:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8eca00, rc 0) 00000100:00100000:3.0:1746147254.958222:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31883:x1830967465762432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4439us (4658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147254.958231:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15683 00000100:00100000:0.0:1746147254.959537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.959922:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465762944 00000100:00100000:1.0:1746147254.959931:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465762944 00002000:00100000:1.0:1746147254.960003:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2199552->2932735) req@ffff88008d5de300 x1830967465762944/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.960012:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967465762944 ext(2199552->2932735) 00010000:00010000:1.0:1746147254.960020:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746147254.960032:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 33 pid: 17530 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746147254.960038:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5de300 00000100:00100000:1.0:1746147254.960229:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2546 00000100:00100000:1.0:1746147254.960236:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967465762944:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147254.966633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.967976:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465763200 00000100:00100000:1.0:1746147254.967989:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465763200 00000100:00100000:1.0:1746147254.968630:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4795 00000100:00100000:1.0:1746147254.968641:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31882:x1830967465763200:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147254.972153:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1958:x1830967465762944:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 11904us (12607us total) trans 21474841396 rc 0/0 00000100:00100000:0.0:1746147254.972167:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2546 00002000:00100000:0.0:1746147254.972182:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2199552->2932735) req@ffff88008d5de300 x1830967465762944/t21474841396(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:630/0 lens 488/448 e 0 to 0 dl 1746147265 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.972192:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967465762944 ext(2199552->2932735) 00010000:00010000:0.0:1746147254.972203:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 35 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746147254.972218:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 35 pid: 17530 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746147254.972226:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5de300 00000100:00100000:1.0:1746147254.972600:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:31882:x1830967465763200:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 3960us (5976us total) trans 8589945471 rc 0/0 00000100:00100000:1.0:1746147254.972609:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4795 00000100:00100000:0.0:1746147254.977083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147254.978397:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465763328 00000100:00100000:3.0:1746147254.978408:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465763328 00010000:00010000:2.0:1746147254.978515:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 35 pid: 17530 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746147254.978554:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7970 00000100:00100000:2.0:1746147254.978559:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1957:x1830967465763328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147254.978569:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147254.978587:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 35 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.978597:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 35 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.978617:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2932735) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc36 expref: 35 pid: 17530 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746147254.978640:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.978642:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147254.978648:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.978659:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147254.978686:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147254.978695:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467057152:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147254.978780:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147254.980865:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467057152:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147254.980888:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147254.980932:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465763328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2371us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147254.980959:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7970 00000100:00100000:1.0:1746147254.988373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147254.988403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147254.988418:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465763584 00000100:00100000:0.0:1746147254.988428:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465763584 00000100:00100000:1.0:1746147254.988430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:0.0:1746147254.988478:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012ecefb80 x1830967465763584/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.988489:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecefb80 with x1830967465763584 ext(2097152->3145727) 00002000:00010000:0.0:1746147254.988494:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecefb80 00000100:00100000:0.0:1746147254.988511:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465764096 00000100:00100000:0.0:1746147254.988514:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465764096 00000100:00100000:1.0:1746147254.988519:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465763968 00000100:00100000:1.0:1746147254.988521:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465763968 00002000:00100000:0.0:1746147254.988527:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3723264->4194303) req@ffff88012eceea00 x1830967465764096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147254.988534:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f669c00 x1830967465763968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/0 e 0 to 0 dl 1746147265 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147254.988540:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceea00 with x1830967465764096 ext(3723264->4194303) 00002000:00100000:1.0:1746147254.988541:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669c00 with x1830967465763968 ext(3145728->4194303) 00002000:00010000:1.0:1746147254.988543:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669c00 00002000:00010000:0.0:1746147254.988543:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eceea00 00000100:00100000:0.0:1746147254.988734:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7421 00000100:00100000:0.0:1746147254.988742:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465763584:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147254.988801:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7422 00000100:00100000:1.0:1746147254.988807:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465764096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147254.989491:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7423 00000100:00100000:2.0:1746147254.989500:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465763968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.000464:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465764096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11646us (12048us total) trans 0 rc 471040/471040 00000100:00100000:1.0:1746147255.000476:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7422 00002000:00100000:1.0:1746147255.000489:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3723264->4194303) req@ffff88012eceea00 x1830967465764096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 471040/471040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.000497:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceea00 with x1830967465764096 ext(3723264->4194303) 00002000:00010000:1.0:1746147255.000503:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eceea00 00010000:00010000:3.0:1746147255.001928:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147255.003458:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465763584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14706us (15086us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.003470:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7421 00002000:00100000:2.0:1746147255.003484:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012ecefb80 x1830967465763584/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.003493:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecefb80 with x1830967465763584 ext(2097152->3145727) 00002000:00010000:2.0:1746147255.003499:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecefb80 00000100:00100000:2.0:1746147255.009789:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465763968:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20279us (21344us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.009802:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7423 00002000:00100000:2.0:1746147255.009815:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f669c00 x1830967465763968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:630/0 lens 488/440 e 0 to 0 dl 1746147265 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.009825:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669c00 with x1830967465763968 ext(3145728->4194303) 00002000:00010000:2.0:1746147255.009832:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669c00 00000100:00100000:0.0:1746147255.016876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.016981:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465764352 00000100:00100000:2.0:1746147255.016991:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465764352 00002000:00100000:2.0:1746147255.017037:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880099f68380 x1830967465764352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.017046:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68380 with x1830967465764352 ext(4194304->4976639) 00002000:00010000:2.0:1746147255.017051:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68380 00000100:00100000:2.0:1746147255.017072:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7424 00000100:00100000:2.0:1746147255.017079:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967465764352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.025583:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967465764352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8493us (8731us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147255.025594:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7424 00002000:00100000:2.0:1746147255.025605:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880099f68380 x1830967465764352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.025615:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68380 with x1830967465764352 ext(4194304->4976639) 00002000:00010000:2.0:1746147255.025620:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68380 00000100:00100000:0.0:1746147255.034782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.034843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.034914:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465764480 00000100:00100000:1.0:1746147255.034924:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465764480 00000100:00100000:1.0:1746147255.035021:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465764608 00000100:00100000:1.0:1746147255.035024:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465764608 00000100:00100000:1.0:1746147255.035048:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15684 00000100:00100000:1.0:1746147255.035057:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465764480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.035077:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.035096:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc44 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746147255.035113:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746147255.035117:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746147255.035118:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.035120:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147255.035137:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15685 00010000:00010000:1.0:1746147255.035140:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 35 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147255.035148:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465764608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.035157:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.035163:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 35 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.035170:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc4b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.035175:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee64000, rc 0) 00000100:00100000:3.0:1746147255.035211:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467057280:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.035223:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1957:x1830967465764480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 167us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.035266:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.035362:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15684 00000100:00100000:0.0:1746147255.037596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.038865:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465764736 00000100:00100000:1.0:1746147255.038876:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465764736 00000100:00100000:1.0:1746147255.038932:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15686 00000100:00100000:1.0:1746147255.038954:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1957:x1830967465764736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.038971:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.038988:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc52 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.039012:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.039014:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.039022:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 36 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.039035:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 36 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.039044:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee64800, rc 0) 00000100:00100000:1.0:1746147255.039094:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1957:x1830967465764736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.039100:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15686 00002000:00010000:3.0:1746147255.041360:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147253 -> 1746147254 00000100:00100000:3.0:1746147255.041389:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467057280:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147255.041423:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc4b expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.041434:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8ecc00/0xb4b2209fbdad12c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc4b expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.041458:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8ecc00, rc 0) 00000100:00100000:3.0:1746147255.041694:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465764608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6547us (6849us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147255.041702:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15685 00000100:00100000:0.0:1746147255.051674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.053237:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465764992 00000100:00100000:2.0:1746147255.053249:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465764992 00002000:00100000:2.0:1746147255.053301:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880099f69c00 x1830967465764992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.053312:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967465764992 ext(1048576->2097151) 00002000:00010000:2.0:1746147255.053317:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69c00 00000100:00100000:2.0:1746147255.053343:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7425 00000100:00100000:2.0:1746147255.053350:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1959:x1830967465764992:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.064569:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1959:x1830967465764992:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11207us (12894us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.064582:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7425 00002000:00100000:2.0:1746147255.064597:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880099f69c00 x1830967465764992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.064607:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967465764992 ext(1048576->2097151) 00002000:00010000:2.0:1746147255.064614:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69c00 00000100:00100000:0.0:1746147255.074189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.074594:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465765120 00000100:00100000:3.0:1746147255.074605:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465765120 00000100:00100000:3.0:1746147255.074666:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15687 00000100:00100000:3.0:1746147255.074674:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31889:x1830967465765120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.074694:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.074711:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc59 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.074741:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.074748:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.074750:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.074753:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.074781:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.074792:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 44 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.074803:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467057408:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.074927:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147255.076722:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467057408:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.076756:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.076771:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8ec800, rc 0) 00000100:00100000:3.0:1746147255.076826:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31889:x1830967465765120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2151us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.076835:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15687 00000100:00100000:0.0:1746147255.077287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.077419:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465765248 00000100:00100000:2.0:1746147255.077427:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465765248 00002000:00100000:2.0:1746147255.077465:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3723263) req@ffff880099f68700 x1830967465765248/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.077474:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68700 with x1830967465765248 ext(3145728->3723263) 00010000:00010000:2.0:1746147255.077481:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 45 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.077493:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 45 pid: 17530 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.077505:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f68700 00000100:00100000:2.0:1746147255.077520:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2547 00000100:00100000:2.0:1746147255.077526:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465765248:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147255.083768:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465765248:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6227us (6468us total) trans 17179874043 rc 0/0 00000100:00100000:2.0:1746147255.083783:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2547 00002000:00100000:2.0:1746147255.083795:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3723263) req@ffff880099f68700 x1830967465765248/t17179874043(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.083804:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68700 with x1830967465765248 ext(3145728->3723263) 00010000:00010000:2.0:1746147255.083814:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.083828:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.083835:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f68700 00000100:00100000:0.0:1746147255.089548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.089699:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465765376 00000100:00100000:2.0:1746147255.089710:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465765376 00010000:00010000:2.0:1746147255.089749:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.089778:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7971 00000100:00100000:2.0:1746147255.089785:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1959:x1830967465765376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.089801:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.089823:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.089834:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.089858:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e798600/0xb4b2209fbdad129e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc28 expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.089890:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.089892:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.089899:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.089905:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.089966:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.089978:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467057536:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.090566:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.095886:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467057536:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147255.095913:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.095994:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1959:x1830967465765376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6207us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.096007:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7971 00000100:00100000:0.0:1746147255.102909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.104446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.104472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.104498:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.104598:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465765632 00000100:00100000:0.0:1746147255.104607:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465765632 00002000:00100000:0.0:1746147255.104654:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880099f6aa00 x1830967465765632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.104665:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6aa00 with x1830967465765632 ext(2097152->3145727) 00002000:00010000:0.0:1746147255.104670:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6aa00 00000100:00100000:0.0:1746147255.104689:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465765888 00000100:00100000:0.0:1746147255.104691:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465765888 00002000:00100000:0.0:1746147255.104701:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880099f6bb80 x1830967465765888/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.104709:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6bb80 with x1830967465765888 ext(3145728->4194303) 00002000:00010000:0.0:1746147255.104711:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6bb80 00000100:00100000:0.0:1746147255.104717:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465766144 00000100:00100000:0.0:1746147255.104718:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465766144 00002000:00100000:0.0:1746147255.104728:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880099f69180 x1830967465766144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.104734:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69180 with x1830967465766144 ext(2097152->3145727) 00002000:00010000:0.0:1746147255.104737:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69180 00000100:00100000:0.0:1746147255.104744:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465766400 00000100:00100000:0.0:1746147255.104745:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465766400 00002000:00100000:0.0:1746147255.104751:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880099f69880 x1830967465766400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.104757:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967465766400 ext(3145728->4194303) 00002000:00010000:0.0:1746147255.104759:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:0.0:1746147255.104768:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7426 00000100:00100000:0.0:1746147255.104774:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465765632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147255.106041:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7427 00000100:00100000:0.0:1746147255.106048:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465765888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147255.106926:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7428 00000100:00100000:3.0:1746147255.106956:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1956:x1830967465766144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.123266:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7429 00000100:00100000:2.0:1746147255.123278:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+38:1956:x1830967465766400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147255.123313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.123349:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465766656 00000100:00100000:0.0:1746147255.123358:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465766656 00000100:00100000:0.0:1746147255.123399:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11468 00000100:00100000:0.0:1746147255.123405:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+312:31892:x1830967465766656:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147255.123428:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147255.123445:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1e00/0xb4b2209fbdad12d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc60 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.123537:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.123550:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.123556:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 313 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.123561:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.123590:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 313 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.123602:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 313 pid: 16361 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746147255.123613:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467057664:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.124870:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.124880:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 19 pid: 16361 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.124888:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467057792:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.124917:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147255.136893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.137318:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465766784 00000100:00100000:3.0:1746147255.137325:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465766784 00000100:00100000:2.0:1746147255.137348:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467057664:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.137354:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 314 pid: 16361 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.137359:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467057792:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.137377:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7972 00000100:00100000:3.0:1746147255.137384:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1958:x1830967465766784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.137388:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.137393:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.137398:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 314 pid: 16361 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.137407:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 314 pid: 16361 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.137424:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8eda00/0xb4b2209fbdad123c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbe9 expref: 314 pid: 16361 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.137440:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147255.137444:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.137451:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.137455:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.137485:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1958:x1830967465766784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 101us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.137491:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7972 00000100:00100000:2.0:1746147255.138620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.138701:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465766912 00000100:00100000:2.0:1746147255.138705:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465766912 00010000:00010000:2.0:1746147255.138720:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 20 pid: 16361 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.138738:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7973 00000100:00100000:2.0:1746147255.138743:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465766912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.138750:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.138754:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 20 pid: 16361 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.138762:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 20 pid: 16361 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.138774:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799800/0xb4b2209fbdad11fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbbf expref: 20 pid: 16361 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.138789:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147255.138792:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.138799:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.138804:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.138817:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.138837:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967465766912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.138842:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7973 00010000:00010000:2.0:1746147255.138915:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.138921:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147255.138935:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147255.139045:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1e00/0xb4b2209fbdad12d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 314 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.139055:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 313 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.139060:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147255.139062:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147255.139064:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911a1c00, rc 0) 00000100:00100000:2.0:1746147255.139081:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:31892:x1830967465766656:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15677us (15775us total) trans 8589945472 rc 0/0 00000100:00100000:2.0:1746147255.139087:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11468 00000100:00100000:1.0:1746147255.143235:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465765632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 38451us (40325us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147255.143247:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7426 00002000:00100000:1.0:1746147255.143258:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880099f6aa00 x1830967465765632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.143272:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6aa00 with x1830967465765632 ext(2097152->3145727) 00002000:00010000:1.0:1746147255.143278:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6aa00 00000100:00100000:0.0:1746147255.147505:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465765888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 41446us (43053us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147255.147517:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7427 00002000:00100000:0.0:1746147255.147527:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880099f6bb80 x1830967465765888/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.147542:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6bb80 with x1830967465765888 ext(3145728->4194303) 00002000:00010000:0.0:1746147255.147547:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6bb80 00000100:00100000:0.0:1746147255.160964:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+38:1956:x1830967465766400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 37656us (56431us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147255.160977:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7429 00002000:00100000:0.0:1746147255.160989:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880099f69880 x1830967465766400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.160999:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967465766400 ext(3145728->4194303) 00002000:00010000:0.0:1746147255.161006:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:3.0:1746147255.170038:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1956:x1830967465766144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 63093us (65553us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.170051:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7428 00002000:00100000:3.0:1746147255.170064:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880099f69180 x1830967465766144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.170074:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69180 with x1830967465766144 ext(2097152->3145727) 00002000:00010000:3.0:1746147255.170080:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69180 00000100:00100000:0.0:1746147255.195797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.196364:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465767168 00000100:00100000:2.0:1746147255.196376:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465767168 00000100:00100000:2.0:1746147255.196426:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11469 00000100:00100000:2.0:1746147255.196435:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:31895:x1830967465767168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147255.196459:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.196477:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e798000/0xb4b2209fbdad12eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc67 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.196579:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196591:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196601:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196613:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196619:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196624:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196722:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196734:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196740:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147255.196748:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147255.196833:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196839:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196844:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196849:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e799400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147255.196853:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196858:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196868:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147255.196871:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147255.196875:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196880:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799400/0xb4b2209fbdad12f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196889:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196897:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196901:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196905:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e799e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147255.196907:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196912:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196917:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76f00) 00010000:00010000:2.0:1746147255.196920:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147255.196922:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196926:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799e00/0xb4b2209fbdad12f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.196977:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e798000/0xb4b2209fbdad12eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 316 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.196989:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 315 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.196995:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147255.196997:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147255.196999:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b92e000, rc 0) 00000100:00100000:2.0:1746147255.197055:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+315:31895:x1830967465767168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 621us (1264us total) trans 8589945473 rc 0/0 00000100:00100000:2.0:1746147255.197063:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11469 00000100:00100000:2.0:1746147255.198712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.199119:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465767424 00000100:00100000:3.0:1746147255.199141:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465767424 00002000:00100000:3.0:1746147255.199188:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800b52e0380 x1830967465767424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.199199:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0380 with x1830967465767424 ext(4194304->4976639) 00002000:00010000:3.0:1746147255.199204:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0380 00000100:00100000:3.0:1746147255.199232:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7430 00000100:00100000:3.0:1746147255.199244:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465767424:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147255.199587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.199614:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465767680 00000100:00100000:1.0:1746147255.199619:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465767680 00000100:00100000:1.0:1746147255.199645:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4796 00000100:00100000:1.0:1746147255.199650:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+315:31895:x1830967465767680:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147255.199823:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:31895:x1830967465767680:12345-192.168.203.36@tcp:35:cat.0 Request processed in 172us (236us total) trans 8589945474 rc 0/0 00000100:00100000:1.0:1746147255.199829:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4796 00000100:00100000:2.0:1746147255.207690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.207828:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465767808 00000100:00100000:0.0:1746147255.207836:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465767808 00000100:00100000:0.0:1746147255.207867:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15688 00000100:00100000:0.0:1746147255.207874:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967465767808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147255.207886:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147255.207900:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc6e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.207916:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.207918:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.207924:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 47 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.207951:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 47 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.207960:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911a0c00, rc 0) 00000100:00100000:0.0:1746147255.207991:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465767808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.207996:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15688 00000100:00100000:3.0:1746147255.209335:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465767424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10085us (10618us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147255.209347:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7430 00002000:00100000:3.0:1746147255.209361:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800b52e0380 x1830967465767424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.209371:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0380 with x1830967465767424 ext(4194304->4976639) 00002000:00010000:3.0:1746147255.209377:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0380 00000100:00100000:0.0:1746147255.210680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.210732:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465768064 00000100:00100000:1.0:1746147255.210739:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465768064 00000100:00100000:1.0:1746147255.210775:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11470 00000100:00100000:1.0:1746147255.210834:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31898:x1830967465768064:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147255.210849:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.210862:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491a00/0xb4b2209fbdad1315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc75 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.210966:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.210977:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.210985:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.210996:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211002:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211007:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211105:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211113:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211119:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147255.211138:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147255.211206:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211211:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211216:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211220:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d491c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.211223:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211228:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211236:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.211239:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.211242:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211247:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491c00/0xb4b2209fbdad131c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211255:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211259:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211263:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211267:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d491e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.211268:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211272:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211276:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f400) 00010000:00010000:1.0:1746147255.211278:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.211279:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211283:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad1323 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.211307:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491a00/0xb4b2209fbdad1315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.211319:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 21 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.211325:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.211327:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147255.211329:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d491600, rc 0) 00000100:00100000:1.0:1746147255.211376:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31898:x1830967465768064:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 594us (700us total) trans 8589945475 rc 0/0 00000100:00100000:1.0:1746147255.211383:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11470 00000100:00100000:3.0:1746147255.230573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.230716:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465768320 00000100:00100000:2.0:1746147255.230724:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465768320 00002000:00100000:2.0:1746147255.230757:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f3800 x1830967465768320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.230766:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3800 with x1830967465768320 ext(2097152->3145727) 00002000:00010000:2.0:1746147255.230770:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f3800 00000100:00100000:2.0:1746147255.230796:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7431 00000100:00100000:2.0:1746147255.230807:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465768320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147255.231060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.231098:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465768576 00000100:00100000:0.0:1746147255.231107:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465768576 00002000:00100000:0.0:1746147255.231150:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e6f2a00 x1830967465768576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.231159:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2a00 with x1830967465768576 ext(3145728->4194303) 00002000:00010000:0.0:1746147255.231164:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2a00 00000100:00100000:0.0:1746147255.231187:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7432 00000100:00100000:0.0:1746147255.231193:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967465768576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.237353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.237393:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465768704 00000100:00100000:1.0:1746147255.237402:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465768704 00000100:00100000:1.0:1746147255.237455:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15689 00000100:00100000:1.0:1746147255.237463:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+36:31898:x1830967465768704:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147255.237482:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.238798:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc7c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.238832:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.238841:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 32 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.238847:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.238850:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.238853:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1585152->1814527] (req 1585152->1814527) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 37 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.238883:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 32 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.238896:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 32 pid: 4444 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.238907:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467057920:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.239289:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.239298:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.239306:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467058048:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.239330:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147255.241537:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967465768320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10726us (10962us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.243029:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7431 00002000:00100000:3.0:1746147255.243041:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f3800 x1830967465768320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.243051:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3800 with x1830967465768320 ext(2097152->3145727) 00002000:00010000:3.0:1746147255.243057:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f3800 00000100:00100000:2.0:1746147255.245529:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467057920:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147255.245575:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467058048:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.245789:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1585152->1814527] (req 1585152->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 37 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.245808:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d490000, rc 0) 00000100:00100000:2.0:1746147255.245971:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+37:31898:x1830967465768704:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8508us (8624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.245980:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15689 00000100:00100000:2.0:1746147255.246375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.246425:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465768832 00000100:00100000:2.0:1746147255.246430:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465768832 00010000:00010000:2.0:1746147255.246454:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 33 pid: 4444 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.246477:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7974 00000100:00100000:2.0:1746147255.246483:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465768832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.246495:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.246513:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 33 pid: 4444 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.246524:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 33 pid: 4444 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.246546:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e9ddc00/0xb4b2209fbdad1274 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc05 expref: 33 pid: 4444 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.246557:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.246574:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465768832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.246580:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7974 00000100:00100000:0.0:1746147255.247922:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465768576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16723us (16855us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147255.247932:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7432 00002000:00100000:0.0:1746147255.247956:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e6f2a00 x1830967465768576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.247965:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2a00 with x1830967465768576 ext(3145728->4194303) 00002000:00010000:0.0:1746147255.247970:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2a00 00000100:00100000:3.0:1746147255.249194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.249353:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465768960 00000100:00100000:1.0:1746147255.249360:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465768960 00010000:00010000:1.0:1746147255.249382:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.249410:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7975 00000100:00100000:1.0:1746147255.249416:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1957:x1830967465768960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.249426:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.249443:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.249452:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.249468:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f5800/0xb4b2209fbdad120b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbcd expref: 37 pid: 6881 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.249477:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.249479:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.249484:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.249491:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.249512:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.249521:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467058176:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147255.249567:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.250152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.250183:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465769216 00000100:00100000:2.0:1746147255.250193:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465769216 00002000:00100000:2.0:1746147255.250235:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880099f69500 x1830967465769216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.250249:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69500 with x1830967465769216 ext(4194304->4976639) 00002000:00010000:2.0:1746147255.250254:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f69500 00000100:00100000:2.0:1746147255.250586:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7433 00000100:00100000:2.0:1746147255.250594:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967465769216:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147255.256598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.256617:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465769472 00000100:00100000:3.0:1746147255.256622:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465769472 00002000:00100000:3.0:1746147255.256653:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1585152->1589247) req@ffff88009e6f3b80 x1830967465769472/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.256663:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3b80 with x1830967465769472 ext(1585152->1589247) 00002000:00010000:3.0:1746147255.256668:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3b80 00000100:00100000:3.0:1746147255.256685:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7434 00000100:00100000:3.0:1746147255.256691:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1957:x1830967465769472:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147255.256812:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1957:x1830967465769472:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 121us (219us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147255.256819:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7434 00002000:00100000:3.0:1746147255.256824:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1585152->1589247) req@ffff88009e6f3b80 x1830967465769472/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.256830:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3b80 with x1830967465769472 ext(1585152->1589247) 00002000:00010000:3.0:1746147255.256833:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3b80 00000100:00100000:1.0:1746147255.257061:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467058176:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.257077:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.257108:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1957:x1830967465768960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7691us (7917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.257114:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7975 00000100:00100000:1.0:1746147255.258566:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967465769216:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7969us (8411us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147255.258572:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7433 00002000:00100000:1.0:1746147255.258579:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880099f69500 x1830967465769216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.258586:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69500 with x1830967465769216 ext(4194304->4976639) 00002000:00010000:1.0:1746147255.258590:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f69500 00000001:00080000:2.0:1746147255.261094:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841396 is committed 00000001:00080000:2.0:1746147255.261107:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841391 is committed 00000001:00080000:2.0:1746147255.261132:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841332 is committed 00000001:00080000:2.0:1746147255.261156:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841375 is committed 00000001:00080000:2.0:1746147255.261163:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841362 is committed 00000001:00080000:2.0:1746147255.261188:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841395 is committed 00000100:00100000:0.0:1746147255.262652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.262705:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465769600 00000100:00100000:2.0:1746147255.262714:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465769600 00000100:00100000:2.0:1746147255.262762:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15690 00000100:00100000:2.0:1746147255.262769:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967465769600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147255.262782:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.262796:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdad133f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc83 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.262838:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467058304:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147255.262914:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.265117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.265177:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465769856 00000100:00100000:2.0:1746147255.265189:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465769856 00002000:00100000:2.0:1746147255.265221:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1810432->1814527) req@ffff880132e11180 x1830967465769856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.265230:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967465769856 ext(1810432->1814527) 00002000:00010000:2.0:1746147255.265235:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11180 00000100:00100000:2.0:1746147255.265256:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7435 00000100:00100000:2.0:1746147255.265261:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465769856:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147255.265383:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465769856:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 122us (277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147255.265392:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7435 00002000:00100000:2.0:1746147255.265396:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1810432->1814527) req@ffff880132e11180 x1830967465769856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.265402:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967465769856 ext(1810432->1814527) 00002000:00010000:2.0:1746147255.265404:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11180 00002000:00010000:2.0:1746147255.266886:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147254 -> 1746147255 00002000:00010000:2.0:1746147255.266892:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147254 -> 1746147255 00002000:00010000:2.0:1746147255.266895:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147254 -> 1746147255 00000100:00100000:2.0:1746147255.266915:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467058304:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147255.266975:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdad133f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc83 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.266988:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdad133f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc83 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.267080:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae800, rc 0) 00000100:00100000:2.0:1746147255.267410:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967465769600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4639us (4764us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147255.267418:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15690 00000100:00100000:0.0:1746147255.272609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.272716:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770112 00000100:00100000:1.0:1746147255.272725:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770112 00000100:00100000:1.0:1746147255.272775:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4797 00000100:00100000:1.0:1746147255.272781:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:31898:x1830967465770112:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147255.273018:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31898:x1830967465770112:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 236us (418us total) trans 8589945476 rc 0/0 00000100:00100000:1.0:1746147255.273024:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4797 00000100:00100000:0.0:1746147255.275634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.275717:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770240 00000100:00100000:2.0:1746147255.275729:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770240 00000100:00100000:2.0:1746147255.275885:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15691 00000100:00100000:2.0:1746147255.275894:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+47:31892:x1830967465770240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147255.275915:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.275935:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc8a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.276010:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.276019:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.276024:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.276026:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.276029:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1658880->2097151] (req 1658880->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 48 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.276059:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.276071:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.276082:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467058432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.276193:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.276201:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 29 pid: 17548 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.276208:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467058560:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147255.276224:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.277513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.277575:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770368 00000100:00100000:3.0:1746147255.277582:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770368 00000100:00100000:3.0:1746147255.277622:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15692 00000100:00100000:3.0:1746147255.277629:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465770368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.277643:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.277655:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009404e600/0xb4b2209fbdad134d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc91 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.277694:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467058688:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147255.277760:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.281450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.281514:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467058688:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.281539:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770496 00010000:00010000:3.0:1746147255.281545:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009404e600/0xb4b2209fbdad134d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc91 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147255.281548:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770496 00010000:00010000:3.0:1746147255.281557:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009404e600/0xb4b2209fbdad134d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc91 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.281576:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009404e600, rc 0) 00010000:00010000:1.0:1746147255.281582:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 30 pid: 17548 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.281620:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465770368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3991us (4110us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.281626:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7976 00000100:00100000:3.0:1746147255.281627:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15692 00000100:00100000:1.0:1746147255.281633:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465770496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.281648:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.281666:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 30 pid: 17548 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.281681:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 30 pid: 17548 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.281705:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.281732:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465770496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.281743:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7976 00000100:00100000:2.0:1746147255.281834:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467058432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.281846:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e799a00/0xb4b2209fbdad1212 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbd4 expref: 29 pid: 17548 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.281859:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467058560:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.281878:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1658880->2097151] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 48 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.281888:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae000, rc 0) 00000100:00100000:2.0:1746147255.281908:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+48:31892:x1830967465770240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6016us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.281913:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15691 00000100:00100000:0.0:1746147255.282420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.282463:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770624 00000100:00100000:2.0:1746147255.282470:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770624 00010000:00010000:2.0:1746147255.282488:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.282516:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7977 00000100:00100000:2.0:1746147255.282523:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967465770624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.282533:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.282545:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.282554:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.282570:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dc800/0xb4b2209fbdad1289 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc0c expref: 48 pid: 17530 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.282578:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.282580:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.282585:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 47 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.282591:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 47 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.282613:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 47 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.282623:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467058816:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.282696:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.285785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.285838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.285891:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770880 00000100:00100000:3.0:1746147255.285902:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770880 00000100:00100000:2.0:1746147255.285909:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465770752 00000100:00100000:2.0:1746147255.285914:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465770752 00000100:00100000:3.0:1746147255.285978:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15693 00000100:00100000:3.0:1746147255.285986:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1956:x1830967465770880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.286003:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.286021:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009404e000/0xb4b2209fbdad1354 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc9f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.286078:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467058944:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147255.286165:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.286252:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15694 00000100:00100000:1.0:1746147255.286261:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465770752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.286270:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.286279:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad135b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecc98 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.286308:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467059072:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.286330:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.286570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.286644:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467058816:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147255.286660:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.286682:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967465770624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4159us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.286690:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7977 00000100:00100000:1.0:1746147255.287387:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465771136 00000100:00100000:1.0:1746147255.287391:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465771136 00002000:00100000:1.0:1746147255.287421:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1658880->1662975) req@ffff8800b52e0700 x1830967465771136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.287429:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0700 with x1830967465771136 ext(1658880->1662975) 00002000:00010000:1.0:1746147255.287433:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0700 00000100:00100000:1.0:1746147255.287448:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7436 00000100:00100000:1.0:1746147255.287453:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967465771136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.287605:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967465771136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 151us (1034us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147255.287612:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7436 00002000:00100000:1.0:1746147255.287617:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1658880->1662975) req@ffff8800b52e0700 x1830967465771136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.287624:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0700 with x1830967465771136 ext(1658880->1662975) 00002000:00010000:1.0:1746147255.287626:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0700 00002000:00010000:3.0:1746147255.290552:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147254 -> 1746147255 00002000:00010000:3.0:1746147255.290561:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147254 -> 1746147255 00002000:00010000:3.0:1746147255.290563:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147254 -> 1746147255 00000100:00100000:3.0:1746147255.290587:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467058944:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.290926:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467059072:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.290990:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad135b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc98 expref: 15 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.291005:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d491e00/0xb4b2209fbdad135b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc98 expref: 15 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.291029:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d491e00, rc 0) 00010000:00010000:3.0:1746147255.291057:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009404e000/0xb4b2209fbdad1354 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc9f expref: 48 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.291067:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009404e000/0xb4b2209fbdad1354 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc9f expref: 48 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.291078:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009404e000, rc 0) 00000100:00100000:1.0:1746147255.291083:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465770752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4823us (5244us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.291092:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15694 00000100:00100000:3.0:1746147255.291095:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967465770880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5112us (5324us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147255.291100:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15693 00000100:00100000:2.0:1746147255.294578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.294639:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465771264 00000100:00100000:1.0:1746147255.294650:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465771264 00000100:00100000:1.0:1746147255.294694:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15695 00000100:00100000:1.0:1746147255.294701:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+47:31892:x1830967465771264:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147255.294717:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.294734:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecca6 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.294762:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.294772:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 48 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.294783:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.294785:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.294788:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->2260991] (req 2097152->2260991) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 48 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.294818:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 48 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.294828:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 48 pid: 17530 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.294839:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467059200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.294964:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.294971:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 28 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.294978:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467059328:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.295010:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.302640:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467059328:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147255.307509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.307597:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465771392 00000100:00100000:3.0:1746147255.307609:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465771392 00010000:00010000:3.0:1746147255.307652:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.307694:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7978 00000100:00100000:3.0:1746147255.307700:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465771392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147255.307713:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.307748:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.307762:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.307785:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8ec800/0xb4b2209fbdad12cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc59 expref: 29 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.307817:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.307874:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465771392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 173us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.307879:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7978 00000100:00100000:0.0:1746147255.308258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.308302:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465771520 00000100:00100000:3.0:1746147255.308305:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465771520 00010000:00010000:3.0:1746147255.308318:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 49 pid: 17530 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.308334:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7979 00000100:00100000:3.0:1746147255.308339:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1958:x1830967465771520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147255.308350:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.308357:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 49 pid: 17530 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746147255.308365:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 49 pid: 17530 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746147255.308377:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.308379:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.308385:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 49 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.308396:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 49 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.308423:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 49 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.308438:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467059456:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.308552:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911a0c00/0xb4b2209fbdad130e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc6e expref: 49 pid: 17530 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.309109:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.309176:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467059200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.309201:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 48 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.309211:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d491800, rc 0) 00000100:00100000:1.0:1746147255.309232:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+48:31892:x1830967465771264:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 14532us (14663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.309239:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15695 00000100:00100000:0.0:1746147255.312594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.312707:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467059456:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147255.312725:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.312759:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1958:x1830967465771520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4419us (4502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.312898:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465771776 00000100:00100000:2.0:1746147255.312912:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465771776 00000100:00100000:3.0:1746147255.313895:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7979 00002000:00100000:2.0:1746147255.313896:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2256896->2260991) req@ffff880132e12300 x1830967465771776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.313906:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12300 with x1830967465771776 ext(2256896->2260991) 00002000:00010000:2.0:1746147255.313911:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12300 00000100:00100000:2.0:1746147255.313960:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7437 00000100:00100000:2.0:1746147255.313968:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465771776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.314134:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465771776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 167us (1548us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147255.314140:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7437 00002000:00100000:2.0:1746147255.314146:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2256896->2260991) req@ffff880132e12300 x1830967465771776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.314152:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12300 with x1830967465771776 ext(2256896->2260991) 00002000:00010000:2.0:1746147255.314155:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12300 00000100:00100000:0.0:1746147255.352030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.354912:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465772032 00000100:00100000:1.0:1746147255.354926:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465772032 00000100:00100000:1.0:1746147255.357573:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11471 00000100:00100000:1.0:1746147255.357589:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:31905:x1830967465772032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.357614:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.357633:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490c00/0xb4b2209fbdad1369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccad expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.357740:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357754:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357765:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357781:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357787:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357791:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357892:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077400/0xb4b2209fbdad137e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357901:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077400/0xb4b2209fbdad137e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.357907:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077400/0xb4b2209fbdad137e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147255.357916:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147255.358013:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358019:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358025:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358030:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d490e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.358034:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358041:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358052:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.358055:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.358060:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358064:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490e00/0xb4b2209fbdad1370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358079:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358083:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358088:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358092:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b077800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.358094:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358098:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358104:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f200) 00010000:00010000:1.0:1746147255.358106:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.358108:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358112:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077800/0xb4b2209fbdad1377 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.358155:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d490c00/0xb4b2209fbdad1369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccad expref: 25 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.358166:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077400/0xb4b2209fbdad137e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccad expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.358172:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.358174:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147255.358176:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077400, rc 0) 00000100:00100000:1.0:1746147255.358230:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31905:x1830967465772032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 647us (6209us total) trans 8589945477 rc 0/0 00000100:00100000:1.0:1746147255.358236:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11471 00000100:00100000:1.0:1746147255.372763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.372814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.373235:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465772416 00000100:00100000:3.0:1746147255.373245:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465772416 00000100:00100000:3.0:1746147255.373297:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 780 00000100:00100000:3.0:1746147255.373304:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465772416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147255.373317:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.373341:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077400/0xb4b2209fbdad137e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccad expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.373356:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147255.373360:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.373405:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465772416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 101us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.373410:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 780 00000100:00100000:3.0:1746147255.376004:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465772288 00000100:00100000:3.0:1746147255.376017:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465772288 00000100:00100000:3.0:1746147255.376059:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4798 00000100:00100000:3.0:1746147255.376066:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:31905:x1830967465772288:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147255.376280:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31905:x1830967465772288:12345-192.168.203.36@tcp:35:cat.0 Request processed in 214us (3527us total) trans 8589945478 rc 0/0 00000100:00100000:3.0:1746147255.376287:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4798 00000100:00100000:2.0:1746147255.387025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.389396:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465772544 00000100:00100000:0.0:1746147255.389410:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465772544 00000100:00100000:0.0:1746147255.389469:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15696 00000100:00100000:0.0:1746147255.389477:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465772544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147255.389494:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147255.389512:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5349000/0xb4b2209fbdad138c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccb4 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147255.389572:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467059584:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147255.389659:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.390927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.391158:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465772672 00000100:00100000:1.0:1746147255.391165:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465772672 00000100:00100000:1.0:1746147255.391194:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15697 00000100:00100000:1.0:1746147255.391200:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465772672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.391212:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.391225:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b076e00/0xb4b2209fbdad1393 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccbb expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.391259:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467059712:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.391304:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.393382:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467059584:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147255.393416:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5349000/0xb4b2209fbdad138c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccb4 expref: 31 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.393430:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5349000/0xb4b2209fbdad138c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccb4 expref: 31 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.393450:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5349000, rc 0) 00000100:00100000:0.0:1746147255.393484:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465772544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4008us (6468us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147255.393491:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15696 00000100:00100000:0.0:1746147255.395913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.404672:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465772928 00000100:00100000:1.0:1746147255.404688:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465772928 00000100:00100000:1.0:1746147255.404740:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11472 00000100:00100000:1.0:1746147255.404748:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:31907:x1830967465772928:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147255.404775:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.404793:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad139a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccc2 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.404900:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.404912:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.404922:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.404934:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.404954:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.404959:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405063:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad13af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405071:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad13af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405077:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad13af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147255.405087:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147255.405183:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405193:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405199:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405204:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b077c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.405207:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405214:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405225:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.405227:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.405231:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405236:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077c00/0xb4b2209fbdad13a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405258:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405263:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405268:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405272:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309ed800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.405274:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405281:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405287:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f500) 00010000:00010000:1.0:1746147255.405288:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.405290:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405294:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad13a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.405327:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b077000/0xb4b2209fbdad139a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc2 expref: 27 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.405337:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad13af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc2 expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.405343:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.405345:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147255.405347:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ec600, rc 0) 00000100:00100000:1.0:1746147255.405404:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31907:x1830967465772928:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 656us (9499us total) trans 8589945479 rc 0/0 00000100:00100000:1.0:1746147255.405410:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11472 00002000:00010000:1.0:1746147255.405563:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147254 -> 1746147255 00002000:00010000:1.0:1746147255.405566:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147254 -> 1746147255 00002000:00010000:1.0:1746147255.405568:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147254 -> 1746147255 00000100:00100000:1.0:1746147255.405582:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467059712:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.405604:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b076e00/0xb4b2209fbdad1393 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccbb expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.405613:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b076e00/0xb4b2209fbdad1393 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccbb expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.405620:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b076e00, rc 0) 00000100:00100000:1.0:1746147255.405644:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465772672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 14444us (14721us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.405650:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15697 00000100:00100000:0.0:1746147255.432383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.432408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.432439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.432465:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465773184 00000100:00100000:0.0:1746147255.432474:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465773184 00000100:00100000:0.0:1746147255.432524:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 781 00000100:00100000:0.0:1746147255.432532:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465773184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147255.432545:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147255.432573:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad13af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc2 expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.432589:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147255.432594:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147255.432639:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465773184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.432645:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 781 00000100:00100000:0.0:1746147255.432666:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465773440 00000100:00100000:0.0:1746147255.432669:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465773440 00000100:00100000:1.0:1746147255.433797:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465773056 00000100:00100000:1.0:1746147255.433806:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465773056 00000100:00100000:1.0:1746147255.433838:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11473 00000100:00100000:1.0:1746147255.433844:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:31908:x1830967465773056:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147255.433863:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.433879:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad13bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccc9 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.433933:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.433965:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.433974:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.434398:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.434406:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.434413:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.434510:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.434521:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 315 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.434527:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.434560:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 315 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.434571:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 315 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.434584:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467059840:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.434658:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00002000:00100000:0.0:1746147255.437193:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880132e12d80 x1830967465773440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 504/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.437216:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967465773440 ext(1048576->2097151) 00002000:00010000:0.0:1746147255.437224:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:0.0:1746147255.437285:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7438 00000100:00100000:0.0:1746147255.437297:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967465773440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147255.448985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.449006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.449585:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967465773440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12292us (17144us total) trans 0 rc 819200/819200 00000100:00100000:0.0:1746147255.449597:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7438 00002000:00100000:0.0:1746147255.449608:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880132e12d80 x1830967465773440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 504/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.449618:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967465773440 ext(1048576->2097151) 00002000:00010000:0.0:1746147255.449623:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:1.0:1746147255.451803:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465773952 00000100:00100000:1.0:1746147255.451815:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465773952 00000100:00100000:1.0:1746147255.451855:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11474 00000100:00100000:1.0:1746147255.451861:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+316:31910:x1830967465773952:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147255.451880:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.451899:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed600/0xb4b2209fbdad13d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccd0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.452063:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465773696 00000100:00100000:3.0:1746147255.452068:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465773696 00000100:00100000:3.0:1746147255.452105:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4799 00000100:00100000:3.0:1746147255.452111:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+318:19601:x1830967465773696:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147255.452283:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:19601:x1830967465773696:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 172us (3274us total) trans 8589945480 rc 0/0 00000100:00100000:3.0:1746147255.452290:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4799 00000100:00100000:1.0:1746147255.455858:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467059840:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.455883:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.455903:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.455916:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.455926:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.455955:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.455961:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.455966:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456098:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764000/0xb4b2209fbdad13ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456106:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764000/0xb4b2209fbdad13ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456112:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764000/0xb4b2209fbdad13ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147255.456131:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147255.456215:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456221:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456226:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456231:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309ece00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.456235:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456240:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456250:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.456252:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.456256:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456260:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad13e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456284:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456289:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456293:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456297:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309ed400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.456299:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456303:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456313:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f200) 00010000:00010000:1.0:1746147255.456315:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.456317:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456321:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad13e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147255.456360:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed600/0xb4b2209fbdad13d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd0 expref: 320 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.456371:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764000/0xb4b2209fbdad13ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd0 expref: 319 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.456376:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.456378:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147255.456381:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.456386:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.456390:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764000, rc 0) 00000100:00100000:1.0:1746147255.456451:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+319:31910:x1830967465773952:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4589us (7473us total) trans 8589945481 rc 0/0 00000100:00100000:1.0:1746147255.456460:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11474 00000100:00100000:0.0:1746147255.456709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.457256:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774080 00000100:00100000:1.0:1746147255.457263:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774080 00000100:00100000:1.0:1746147255.457294:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15698 00000100:00100000:1.0:1746147255.457301:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31905:x1830967465774080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.457315:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.457326:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccd7 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.457496:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 46 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.457504:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.457505:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.457508:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.457536:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 46 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.457547:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 46 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.457558:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467059968:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.457622:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.461017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.461046:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774208 00000100:00100000:1.0:1746147255.461054:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774208 00010000:00010000:1.0:1746147255.461084:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 319 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.461109:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7980 00000100:00100000:1.0:1746147255.461116:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1957:x1830967465774208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.461141:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.461146:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 319 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.461156:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 319 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.461176:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911a1c00/0xb4b2209fbdad12dd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc60 expref: 319 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.461188:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.461192:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461201:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461207:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461226:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.461266:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1957:x1830967465774208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 150us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.461273:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7980 00010000:00010000:1.0:1746147255.461385:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461393:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147255.461435:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:1.0:1746147255.461439:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147255.461455:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461464:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461472:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461476:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461482:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461486:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309ecc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.461489:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461495:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461501:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.461503:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.461505:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461509:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad13c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461516:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461520:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461525:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461528:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309eda00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.461530:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461534:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461540:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f200) 00010000:00010000:1.0:1746147255.461541:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.461543:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461547:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad13cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.461578:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad13bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.461587:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 13 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.461593:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.461594:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147255.461596:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309edc00, rc 0) 00000100:00100000:1.0:1746147255.461620:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31908:x1830967465773056:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 27776us (29247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.461626:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11473 00000100:00100000:1.0:1746147255.462368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.462392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.462405:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774464 00000100:00100000:0.0:1746147255.462406:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774336 00000100:00100000:1.0:1746147255.462409:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774464 00000100:00100000:0.0:1746147255.462409:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774336 00000100:00100000:1.0:1746147255.462433:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 782 00002000:00100000:0.0:1746147255.462436:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1658880->2097151) req@ffff88009f668380 x1830967465774336/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147255.462439:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1957:x1830967465774464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.462446:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746147255.462446:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668380 with x1830967465774336 ext(1658880->2097151) 00010000:00010000:0.0:1746147255.462453:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.462457:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764000/0xb4b2209fbdad13ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd0 expref: 318 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.462463:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 47 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.462465:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.462468:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1746147255.462474:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f668380 00000100:00100000:1.0:1746147255.462485:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967465774464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.462486:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2548 00000100:00100000:1.0:1746147255.462490:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 782 00000100:00100000:0.0:1746147255.462490:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967465774336:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147255.462728:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467059968:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.462747:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.462758:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764400, rc 0) 00000100:00100000:2.0:1746147255.462794:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31905:x1830967465774080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5493us (6085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.462799:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15698 00000100:00100000:1.0:1746147255.469875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.469903:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.469917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.469929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.469955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.469979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.470666:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774592 00000100:00100000:1.0:1746147255.470682:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774592 00000100:00100000:1.0:1746147255.470727:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774848 00000100:00100000:1.0:1746147255.470730:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774848 00000100:00100000:1.0:1746147255.470741:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465775104 00000100:00100000:1.0:1746147255.470743:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465775104 00000100:00100000:1.0:1746147255.470751:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774720 00000100:00100000:1.0:1746147255.470752:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774720 00000100:00100000:1.0:1746147255.470761:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465774976 00000100:00100000:1.0:1746147255.470762:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465774976 00000100:00100000:1.0:1746147255.470767:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465775232 00000100:00100000:1.0:1746147255.470768:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465775232 00000100:00100000:1.0:1746147255.470778:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15699 00000100:00100000:1.0:1746147255.470786:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465774592:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147255.470809:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.470828:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccde expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.470855:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.470857:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.470868:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.470885:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.470896:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b765000, rc 0) 00000100:00100000:1.0:1746147255.471334:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465774592:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 547us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.471341:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15699 00000100:00100000:1.0:1746147255.471366:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15700 00000100:00100000:1.0:1746147255.471371:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465774848:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147255.471378:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.471388:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b765600/0xb4b2209fbdad140a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccec expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.471431:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467060096:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.471480:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.471501:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15701 00000100:00100000:1.0:1746147255.471505:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465775104:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147255.471512:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.471519:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xb4b2209fbdad1411 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccfa expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.471541:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467060224:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.471561:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.471924:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15702 00000100:00100000:1.0:1746147255.471929:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465774720:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147255.471999:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15703 00000100:00100000:2.0:1746147255.472006:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465774976:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147255.472013:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.472022:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4afc00/0xb4b2209fbdad1418 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eccf3 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.472049:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467060352:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147255.472091:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.472108:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15704 00000100:00100000:2.0:1746147255.472114:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465775232:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147255.472130:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.472137:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd01 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.472147:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.472149:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.472154:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.472165:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.472171:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af600, rc 0) 00000100:00100000:2.0:1746147255.472188:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465775232:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 75us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.472192:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15704 00010000:00010000:1.0:1746147255.472270:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.472278:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecce5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.472289:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.472290:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.472295:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.472303:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.472309:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed400, rc 0) 00000100:00100000:1.0:1746147255.472325:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465774720:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 395us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.472330:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15702 00000100:00100000:2.0:1746147255.474094:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467060352:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147255.474137:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4afc00/0xb4b2209fbdad1418 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccf3 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.474155:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4afc00/0xb4b2209fbdad1418 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccf3 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.474163:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4afc00, rc 0) 00000100:00100000:2.0:1746147255.474448:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465774976:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2442us (4490us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147255.474455:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15703 00002000:00010000:1.0:1746147255.475004:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5693 -> 5697 00000100:00100000:1.0:1746147255.475011:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467060224:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.475027:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xb4b2209fbdad1411 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccfa expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.475036:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xb4b2209fbdad1411 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccfa expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.475044:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764600, rc 0) 00000100:00100000:1.0:1746147255.475065:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465775104:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3560us (5147us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.475071:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15701 00000100:00100000:1.0:1746147255.475130:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467060096:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.475146:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b765600/0xb4b2209fbdad140a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccec expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.475153:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b765600/0xb4b2209fbdad140a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccec expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.475160:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b765600, rc 0) 00000100:00100000:1.0:1746147255.475176:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465774848:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3805us (5272us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.475183:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15700 00000100:00100000:1.0:1746147255.479214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.479241:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465775488 00000100:00100000:1.0:1746147255.479248:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465775488 00000100:00100000:1.0:1746147255.479280:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11475 00000100:00100000:1.0:1746147255.479286:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31908:x1830967465775488:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147255.479301:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.479315:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad142d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd08 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.479391:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.479404:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.479411:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.479436:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.479445:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 14 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.479455:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467060480:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.480309:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.482986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.483041:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465775616 00000100:00100000:3.0:1746147255.483052:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465775616 00010000:00010000:3.0:1746147255.483268:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 15 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.483365:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7981 00000100:00100000:3.0:1746147255.483374:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465775616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147255.483388:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.483395:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 15 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.483406:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 15 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.483429:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147255.483435:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.483445:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.483452:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.483470:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.483521:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465775616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 148us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.483527:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7981 00010000:00010000:1.0:1746147255.483636:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdad13d2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccc9 expref: 15 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.483652:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467060480:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.483667:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.483675:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147255.483679:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147255.483695:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:0.0:1746147255.484019:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967465774336:12345-192.168.203.36@tcp:4:cat.0 Request processed in 21526us (21624us total) trans 17179874044 rc 0/0 00000100:00100000:0.0:1746147255.484027:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2548 00002000:00100000:0.0:1746147255.484035:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1658880->2097151) req@ffff88009f668380 x1830967465774336/t17179874044(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.484043:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668380 with x1830967465774336 ext(1658880->2097151) 00010000:00010000:0.0:1746147255.484050:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 49 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746147255.484061:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 49 pid: 17530 timeout: 742 lvb_type: 0 00002000:00010000:0.0:1746147255.484067:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f668380 00010000:00010000:1.0:1746147255.484262:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad142d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd08 expref: 15 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.484275:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd08 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.484282:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.484285:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147255.484288:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ec200, rc 0) 00000100:00100000:1.0:1746147255.484311:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:31908:x1830967465775488:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 5026us (5105us total) trans 8589945482 rc 0/0 00000100:00100000:1.0:1746147255.484318:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11475 00000100:00100000:3.0:1746147255.489770:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.489799:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465776000 00000100:00100000:3.0:1746147255.489806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.489807:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465776000 00000100:00100000:3.0:1746147255.489831:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465775744 00000100:00100000:3.0:1746147255.489836:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465775744 00000100:00100000:0.0:1746147255.489844:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11476 00000100:00100000:0.0:1746147255.489850:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:31908:x1830967465776000:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147255.489865:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 49 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746147255.489868:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147255.489871:0:23726:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147255.489892:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad1434 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd08 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.490004:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7982 00000100:00100000:3.0:1746147255.490012:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967465775744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147255.490025:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.490046:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 49 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.490059:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 49 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.490078:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdad1346 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc8a expref: 49 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.490093:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.490096:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.490104:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.490113:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.490177:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.490191:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467060608:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147255.490261:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934556c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147255.490367:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147255.490372:0:23726:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147255.490383:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad1442 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd0f expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.490449:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490459:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490467:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490476:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490481:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490486:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490704:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147255.490707:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490713:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490720:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147255.490722:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147255.490725:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490730:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad1449 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147255.490749:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad1442 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd0f expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.490756:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad1442 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd0f expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.490762:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423800, rc 0) 00000100:00100000:0.0:1746147255.490796:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31908:x1830967465776000:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 946us (1035us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147255.490802:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11476 00000100:00100000:0.0:1746147255.496011:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467060608:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147255.496032:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147255.496466:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967465775744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6453us (6657us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.496476:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7982 00000100:00100000:3.0:1746147255.496674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.496971:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465776256 00000100:00100000:2.0:1746147255.496977:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465776256 00000100:00100000:2.0:1746147255.497003:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4800 00000100:00100000:2.0:1746147255.497009:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:31908:x1830967465776256:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147255.497267:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:31908:x1830967465776256:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 158us (494us total) trans 8589945483 rc 0/0 00000100:00100000:2.0:1746147255.497274:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4800 00000100:00100000:3.0:1746147255.499904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.499976:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465776512 00000100:00100000:0.0:1746147255.499983:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465776512 00002000:00100000:0.0:1746147255.500162:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e6f3480 x1830967465776512/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.500173:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3480 with x1830967465776512 ext(1048576->2097151) 00002000:00010000:0.0:1746147255.500178:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f3480 00000100:00100000:0.0:1746147255.500657:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7439 00000100:00100000:0.0:1746147255.500665:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465776512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.512153:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967465776512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11482us (12246us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147255.512164:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7439 00002000:00100000:1.0:1746147255.512173:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e6f3480 x1830967465776512/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.512182:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3480 with x1830967465776512 ext(1048576->2097151) 00002000:00010000:1.0:1746147255.512186:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f3480 00000001:00080000:3.0:1746147255.514376:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874036 is committed 00000001:00080000:3.0:1746147255.514399:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874018 is committed 00000001:00080000:3.0:1746147255.514402:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874007 is committed 00000001:00080000:3.0:1746147255.514410:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874005 is committed 00000001:00080000:3.0:1746147255.514420:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874040 is committed 00000001:00080000:3.0:1746147255.514433:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874043 is committed 00000001:00080000:3.0:1746147255.514441:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874037 is committed 00000001:00080000:3.0:1746147255.514502:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874041 is committed 00000001:00080000:3.0:1746147255.514525:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874019 is committed 00000100:00100000:0.0:1746147255.523693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.524106:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465776640 00000100:00100000:1.0:1746147255.524113:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465776640 00000100:00100000:1.0:1746147255.524167:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15705 00000100:00100000:1.0:1746147255.524174:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+7:31905:x1830967465776640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.524187:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.524202:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd16 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.524225:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.524231:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.524232:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.524235:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 8 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.524257:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.524266:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 21 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.524275:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467060736:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.524352:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.531633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.531699:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465776768 00000100:00100000:2.0:1746147255.531709:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465776768 00002000:00100000:2.0:1746147255.531746:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2260991) req@ffff880132e13800 x1830967465776768/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.531755:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13800 with x1830967465776768 ext(2097152->2260991) 00010000:00010000:2.0:1746147255.531763:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 22 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.531776:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 22 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.531782:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132e13800 00000100:00100000:2.0:1746147255.531810:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2549 00000100:00100000:2.0:1746147255.531817:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465776768:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147255.532265:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467060736:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.532287:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 8 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.532299:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205c00, rc 0) 00000100:00100000:1.0:1746147255.532893:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31905:x1830967465776640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8717us (9204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.532900:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15705 00000100:00100000:2.0:1746147255.538203:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465776768:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6379us (6572us total) trans 17179874045 rc 0/0 00000100:00100000:2.0:1746147255.538213:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2549 00002000:00100000:2.0:1746147255.538222:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2260991) req@ffff880132e13800 x1830967465776768/t17179874045(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.538235:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13800 with x1830967465776768 ext(2097152->2260991) 00010000:00010000:2.0:1746147255.538243:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 24 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.538256:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 24 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.538262:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132e13800 00000100:00100000:0.0:1746147255.543596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.543674:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777024 00000100:00100000:2.0:1746147255.543681:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777024 00000100:00100000:2.0:1746147255.543727:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11477 00000100:00100000:2.0:1746147255.543737:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+317:31914:x1830967465777024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147255.543757:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.543770:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c800/0xb4b2209fbdad1457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd1d expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.544899:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.544911:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.544920:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.544929:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.544934:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.544963:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545046:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545053:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545058:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147255.545064:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147255.545133:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545138:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545147:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545151:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50c600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147255.545154:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545159:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545166:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147255.545168:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147255.545171:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545175:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdad145e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545190:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545194:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545199:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545202:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50de00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147255.545204:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545208:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545216:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3a0a00) 00010000:00010000:2.0:1746147255.545217:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147255.545219:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545223:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50de00/0xb4b2209fbdad1465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.545338:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c800/0xb4b2209fbdad1457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 320 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.545348:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 319 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.545353:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147255.545355:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147255.545357:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50d000, rc 0) 00000100:00100000:2.0:1746147255.546572:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+319:31914:x1830967465777024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2835us (2980us total) trans 8589945484 rc 0/0 00000100:00100000:2.0:1746147255.546580:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11477 00000100:00100000:0.0:1746147255.547754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.547964:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777408 00000100:00100000:3.0:1746147255.547971:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777408 00000100:00100000:0.0:1746147255.547972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.547986:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777664 00000100:00100000:0.0:1746147255.547989:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777664 00000100:00100000:3.0:1746147255.548000:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465778176 00000100:00100000:3.0:1746147255.548002:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465778176 00000100:00100000:0.0:1746147255.548004:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777792 00000100:00100000:0.0:1746147255.548006:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777792 00000100:00100000:3.0:1746147255.548012:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465778048 00000100:00100000:3.0:1746147255.548014:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465778048 00000100:00100000:0.0:1746147255.548018:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 236 00000100:00100000:0.0:1746147255.548024:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967465777408:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1746147255.548029:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:3.0:1746147255.548034:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465777664:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1746147255.548064:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465777664:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.548064:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967465777408:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.548069:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 236 00000100:00100000:3.0:1746147255.548080:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:3.0:1746147255.548091:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 238 00000100:00100000:3.0:1746147255.548096:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465778176:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1746147255.548117:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465778176:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 21us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.548135:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 238 00000100:00100000:3.0:1746147255.548144:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:3.0:1746147255.548149:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465777792:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1746147255.548166:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465777792:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 18us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.548171:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:3.0:1746147255.548178:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 240 00000100:00100000:3.0:1746147255.548182:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465778048:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1746147255.548198:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465778048:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 16us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.548202:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 240 00000100:00100000:1.0:1746147255.548235:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777920 00000100:00100000:1.0:1746147255.548239:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777920 00000100:00100000:1.0:1746147255.548261:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777536 00000100:00100000:1.0:1746147255.548262:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777536 00000100:00100000:1.0:1746147255.548275:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:1.0:1746147255.548279:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967465777920:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147255.548305:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967465777920:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.548310:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:1.0:1746147255.548322:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:1.0:1746147255.548326:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465777536:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147255.548345:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465777536:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 18us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.548349:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:1.0:1746147255.548367:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777152 00000100:00100000:1.0:1746147255.548370:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777152 00010000:00010000:1.0:1746147255.548384:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 24 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.548406:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7983 00000100:00100000:1.0:1746147255.548410:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465777152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.548417:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.548434:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 24 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.548443:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 24 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.548459:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d491800/0xb4b2209fbdad1362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecca6 expref: 24 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.548476:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.548478:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.548483:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 7 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.548490:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 7 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.548677:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465777280 00000100:00100000:2.0:1746147255.548681:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465777280 00000100:00100000:2.0:1746147255.548699:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:2.0:1746147255.548703:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1957:x1830967465777280:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1746147255.548720:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1957:x1830967465777280:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 18us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.548725:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 214 00010000:00010000:1.0:1746147255.549019:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 7 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.549030:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467060864:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147255.549488:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.550372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.550430:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465778432 00000100:00100000:2.0:1746147255.550433:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465778432 00000100:00100000:2.0:1746147255.550458:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4801 00000100:00100000:2.0:1746147255.550463:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+319:31914:x1830967465778432:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147255.550727:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:31914:x1830967465778432:12345-192.168.203.36@tcp:35:cat.0 Request processed in 263us (356us total) trans 8589945485 rc 0/0 00000100:00100000:2.0:1746147255.550733:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4801 00000100:00100000:2.0:1746147255.558103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.558160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.558184:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465778688 00000100:00100000:2.0:1746147255.558184:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465778944 00000100:00100000:3.0:1746147255.558189:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465778688 00000100:00100000:2.0:1746147255.558189:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465778944 00002000:00100000:3.0:1746147255.558220:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e2a00 x1830967465778688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.558220:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134ed4e00 x1830967465778944/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.558229:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2a00 with x1830967465778688 ext(2097152->3145727) 00002000:00100000:2.0:1746147255.558229:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed4e00 with x1830967465778944 ext(3145728->4194303) 00002000:00010000:3.0:1746147255.558233:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2a00 00002000:00010000:2.0:1746147255.558233:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed4e00 00000100:00100000:3.0:1746147255.558248:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7440 00000100:00100000:2.0:1746147255.558253:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7441 00000100:00100000:3.0:1746147255.558254:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465778688:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.558258:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465778944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.558756:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467060864:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.558776:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.558822:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465777152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10410us (11069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.558831:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7983 00000100:00100000:1.0:1746147255.559427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.559984:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779072 00000100:00100000:0.0:1746147255.559991:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779072 00000100:00100000:0.0:1746147255.560027:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15706 00000100:00100000:0.0:1746147255.560033:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1958:x1830967465779072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147255.560048:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147255.560063:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009049d200/0xb4b2209fbdad147a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd24 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147255.560107:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467060992:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147255.560166:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.563927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.563994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.564312:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779200 00000100:00100000:2.0:1746147255.564321:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779200 00000100:00100000:2.0:1746147255.564357:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779328 00000100:00100000:2.0:1746147255.564359:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779328 00000100:00100000:2.0:1746147255.564380:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15707 00000100:00100000:2.0:1746147255.564387:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465779200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147255.564405:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.564421:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd2b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.564452:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.564454:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.564462:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.564478:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.564489:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65400, rc 0) 00000100:00100000:2.0:1746147255.564531:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465779200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.564538:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15707 00000100:00100000:2.0:1746147255.564555:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15708 00000100:00100000:2.0:1746147255.564560:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465779328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147255.564566:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.564572:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd32 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.564583:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.564952:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.564958:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.564969:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.564981:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65a00, rc 0) 00000100:00100000:2.0:1746147255.565012:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465779328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 452us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.565017:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15708 00000100:00100000:0.0:1746147255.567309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.567379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.567649:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779456 00000100:00100000:2.0:1746147255.567657:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779456 00000100:00100000:2.0:1746147255.567687:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779584 00000100:00100000:2.0:1746147255.567690:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779584 00000100:00100000:2.0:1746147255.567706:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15709 00000100:00100000:2.0:1746147255.567713:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31907:x1830967465779456:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147255.567730:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.567746:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd39 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.567777:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.567786:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 7 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.567792:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.567798:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.567800:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.567803:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [4014080->4194303] (req 4014080->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 9 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.567835:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.567847:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.567860:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467061120:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.567962:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 7 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.567971:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 7 pid: 8481 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.567980:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467061248:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.568019:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.568027:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 16 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.568035:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467061376:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147255.568054:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147255.568171:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15710 00000100:00100000:3.0:1746147255.568179:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:31910:x1830967465779584:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147255.568187:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.568194:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd40 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.568209:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.568214:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.568216:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.568218:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.568234:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.568241:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 9 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.568255:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467061504:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.568281:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.568293:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467060992:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.568316:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009049d200/0xb4b2209fbdad147a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd24 expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.568327:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009049d200/0xb4b2209fbdad147a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd24 expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.568340:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009049d200, rc 0) 00000100:00100000:1.0:1746147255.568360:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967465779072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8327us (8934us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.568365:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15706 00000100:00100000:3.0:1746147255.568815:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465778944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10556us (10654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.568824:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7441 00002000:00100000:3.0:1746147255.568833:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134ed4e00 x1830967465778944/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.568842:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed4e00 with x1830967465778944 ext(3145728->4194303) 00002000:00010000:3.0:1746147255.568846:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed4e00 00000100:00100000:0.0:1746147255.572337:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467061120:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147255.572350:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467061376:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147255.574112:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967465778688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15848us (16008us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.574137:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7440 00002000:00100000:2.0:1746147255.574148:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e2a00 x1830967465778688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.574157:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2a00 with x1830967465778688 ext(2097152->3145727) 00002000:00010000:2.0:1746147255.574162:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2a00 00000100:00100000:3.0:1746147255.574323:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467061504:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.574351:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.574367:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077000, rc 0) 00000100:00100000:3.0:1746147255.574388:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:31910:x1830967465779584:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6211us (7009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.574394:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15710 00000100:00100000:1.0:1746147255.574575:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467061248:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147255.574598:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [4014080->4194303] (req 4014080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 9 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.574609:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65c00, rc 0) 00000100:00100000:1.0:1746147255.574627:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31907:x1830967465779456:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6915us (7328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.574633:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15709 00000100:00100000:0.0:1746147255.576260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.576298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.576322:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779968 00000100:00100000:1.0:1746147255.576330:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779968 00000100:00100000:0.0:1746147255.576330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.576347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147255.576357:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 8 pid: 8481 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.576391:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779840 00000100:00100000:1.0:1746147255.576394:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779840 00010000:00010000:1.0:1746147255.576404:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.576418:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7984 00000100:00100000:0.0:1746147255.576423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.576424:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465779968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.576435:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.576456:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 8 pid: 8481 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.576465:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 8 pid: 8481 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.576484:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdad141f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd01 expref: 8 pid: 8481 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746147255.576495:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465780224 00010000:00010000:1.0:1746147255.576498:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.576500:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465780224 00010000:00010000:2.0:1746147255.576517:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 15 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.576526:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465779968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.576531:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7984 00000100:00100000:2.0:1746147255.576535:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7985 00000100:00100000:2.0:1746147255.576540:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465779840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.576547:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.576556:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746147255.576564:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.576568:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7986 00000100:00100000:1.0:1746147255.576573:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465780224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.576576:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee64800/0xb4b2209fbdad12c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc52 expref: 9 pid: 4444 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.576579:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.576587:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 15 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.576588:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147255.576594:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 15 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.576603:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465779840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (273us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147255.576604:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8eca00/0xb4b2209fbdad12b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc3d expref: 15 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.576612:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7985 00010000:00010000:1.0:1746147255.576612:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.576614:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.576620:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 7 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.576627:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 7 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.576652:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 7 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.576662:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467061632:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.576677:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465779712 00000100:00100000:2.0:1746147255.576680:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465779712 00002000:00100000:2.0:1746147255.576703:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1585152->1814527) req@ffff88009ee5e300 x1830967465779712/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.576711:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e300 with x1830967465779712 ext(1585152->1814527) 00010000:00010000:2.0:1746147255.576717:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 8 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.576727:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 8 pid: 17530 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.576732:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5e300 00000100:00100000:2.0:1746147255.576744:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2550 00000100:00100000:2.0:1746147255.576749:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1958:x1830967465779712:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147255.577633:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.577652:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465780096 00000100:00100000:1.0:1746147255.577655:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465780096 00000100:00100000:1.0:1746147255.577674:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15711 00000100:00100000:1.0:1746147255.577678:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+15:31914:x1830967465780096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.577687:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.577697:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd47 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.577709:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.577713:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.577718:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147255.577721:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.577737:0:21080:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.577746:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.577753:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1000, rc 0) 00000100:00100000:1.0:1746147255.577767:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:31914:x1830967465780096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 89us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.577772:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15711 00000100:00100000:0.0:1746147255.578404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.578445:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465780352 00000100:00100000:3.0:1746147255.578449:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465780352 00000100:00100000:3.0:1746147255.578480:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15712 00000100:00100000:3.0:1746147255.578485:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31905:x1830967465780352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.578492:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.578499:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd4e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.578513:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.578519:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.578520:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.578523:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.578539:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.578548:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 11 pid: 21080 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.578556:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467061888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.579048:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.580923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.581085:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465780608 00000100:00100000:3.0:1746147255.581093:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465780608 00002000:00100000:3.0:1746147255.581142:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (4014080->4018175) req@ffff88009ee5fb80 x1830967465780608/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.581151:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5fb80 with x1830967465780608 ext(4014080->4018175) 00010000:00010000:3.0:1746147255.581160:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.581170:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.581177:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5fb80 00000100:00100000:3.0:1746147255.581196:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2551 00000100:00100000:3.0:1746147255.581203:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465780608:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147255.581428:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467061632:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.581445:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.581717:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465780608:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 512us (799us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147255.581723:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2551 00002000:00100000:3.0:1746147255.581728:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (4014080->4018175) req@ffff88009ee5fb80 x1830967465780608/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.581736:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5fb80 with x1830967465780608 ext(4014080->4018175) 00010000:00010000:3.0:1746147255.581741:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.581748:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.581753:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5fb80 00000100:00100000:3.0:1746147255.582633:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467061888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.582650:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.582662:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b077400, rc 0) 00000100:00100000:1.0:1746147255.582734:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465780224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6159us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.582743:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7986 00000100:00100000:3.0:1746147255.582977:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31905:x1830967465780352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4491us (4574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.582987:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15712 00000100:00100000:3.0:1746147255.584430:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465779712:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7678us (8128us total) trans 21474841397 rc 0/0 00000100:00100000:3.0:1746147255.584439:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2550 00002000:00100000:3.0:1746147255.584447:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1585152->1814527) req@ffff88009ee5e300 x1830967465779712/t21474841397(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.584457:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e300 with x1830967465779712 ext(1585152->1814527) 00010000:00010000:3.0:1746147255.584465:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 11 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.584476:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 11 pid: 17530 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.584483:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5e300 00000100:00100000:0.0:1746147255.586565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.586615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.586684:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465780992 00000100:00100000:2.0:1746147255.586693:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465780992 00002000:00100000:2.0:1746147255.586736:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (4014080->4194303) req@ffff88009ee5f480 x1830967465780992/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.586744:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f480 with x1830967465780992 ext(4014080->4194303) 00010000:00010000:2.0:1746147255.586754:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 11 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.586766:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 11 pid: 21080 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.586778:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5f480 00000100:00100000:2.0:1746147255.586798:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2552 00000100:00100000:2.0:1746147255.586805:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465780992:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147255.587230:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465780864 00000100:00100000:3.0:1746147255.587234:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465780864 00000100:00100000:3.0:1746147255.588467:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15713 00000100:00100000:3.0:1746147255.588474:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:31907:x1830967465780864:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147255.588487:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.588502:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd55 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.588527:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.588540:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.588545:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.588547:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.588549:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.588574:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.588583:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 24 pid: 21080 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.588592:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.588650:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.588657:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.588663:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.588674:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.590148:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465780992:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 3308us (3497us total) trans 21474841398 rc 0/0 00000100:00100000:2.0:1746147255.590159:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2552 00002000:00100000:2.0:1746147255.590168:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (4014080->4194303) req@ffff88009ee5f480 x1830967465780992/t21474841398(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.590177:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f480 with x1830967465780992 ext(4014080->4194303) 00010000:00010000:2.0:1746147255.590185:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 13 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.590195:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 13 pid: 21080 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.590200:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee5f480 00000100:00100000:0.0:1746147255.590622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.590694:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465781120 00000100:00100000:1.0:1746147255.590701:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465781120 00010000:00010000:1.0:1746147255.590725:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 13 pid: 17530 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.590746:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7987 00000100:00100000:1.0:1746147255.590751:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465781120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.590762:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.590779:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 13 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.590788:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 13 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.590808:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d490000/0xb4b2209fbdad1338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->1814527) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc7c expref: 13 pid: 17530 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.590836:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.590838:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.590845:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.590853:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.590881:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.590897:0:11078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 14 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.590908:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467062272:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147255.590977:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.591381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.591536:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465781248 00000100:00100000:3.0:1746147255.591541:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465781248 00010000:00010000:3.0:1746147255.591561:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 25 pid: 21080 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.592154:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7988 00000100:00100000:3.0:1746147255.592161:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465781248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147255.592171:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147255.592187:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 25 pid: 21080 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746147255.592196:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 25 pid: 21080 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746147255.592210:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.592249:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465781248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 89us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.592255:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7988 00010000:00010000:3.0:1746147255.592302:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f65a00/0xb4b2209fbdad1488 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd32 expref: 24 pid: 21080 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.592318:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.592333:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.592354:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.592364:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd85400, rc 0) 00000100:00100000:3.0:1746147255.592383:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31907:x1830967465780864:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3910us (5827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.592390:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15713 00000100:00100000:0.0:1746147255.593134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.593194:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467062272:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.593205:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.593225:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465781120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2474us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.593231:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7987 00000100:00100000:2.0:1746147255.593470:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465781504 00000100:00100000:2.0:1746147255.593474:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465781504 00002000:00100000:2.0:1746147255.593505:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (2072576->2076671) req@ffff88009b409c00 x1830967465781504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.593513:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409c00 with x1830967465781504 ext(2072576->2076671) 00010000:00010000:2.0:1746147255.593520:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.593536:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.593542:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b409c00 00000100:00100000:2.0:1746147255.593556:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2553 00000100:00100000:2.0:1746147255.593561:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465781504:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.593705:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465781504:12345-192.168.203.36@tcp:3:cat.0 Request processed in 143us (570us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147255.593711:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2553 00002000:00100000:2.0:1746147255.593716:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (2072576->2076671) req@ffff88009b409c00 x1830967465781504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.593723:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409c00 with x1830967465781504 ext(2072576->2076671) 00010000:00010000:2.0:1746147255.593727:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.593735:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.593741:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b409c00 00000100:00100000:0.0:1746147255.595441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.595515:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465781632 00000100:00100000:1.0:1746147255.595522:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465781632 00010000:00010000:1.0:1746147255.595543:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.595576:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7989 00000100:00100000:1.0:1746147255.595582:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465781632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.595594:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147255.595608:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147254 -> 1746147255 00002000:00010000:1.0:1746147255.595611:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147254 -> 1746147255 00010000:00010000:1.0:1746147255.595616:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.595625:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.595646:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f65c00/0xb4b2209fbdad148f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd39 expref: 12 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.595659:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.595661:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.595666:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.595674:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.595701:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.595713:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467062400:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147255.595791:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.597638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.598299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.598320:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465782016 00000100:00100000:0.0:1746147255.598327:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465782016 00010000:00010000:0.0:1746147255.598357:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746147255.598395:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7990 00000100:00100000:0.0:1746147255.598402:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465782016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147255.598415:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147255.598435:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746147255.598445:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746147255.598464:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b205c00/0xb4b2209fbdad1450 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd16 expref: 9 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746147255.598484:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.598486:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.598492:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.598499:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.598527:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147255.598542:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467062528:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147255.598616:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.598663:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465781888 00000100:00100000:2.0:1746147255.598667:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465781888 00002000:00100000:2.0:1746147255.598696:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (2072576->2097151) req@ffff88009b408e00 x1830967465781888/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.598705:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408e00 with x1830967465781888 ext(2072576->2097151) 00000100:00100000:0.0:1746147255.598706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147255.598713:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.598726:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 15 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.598733:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b408e00 00000100:00100000:2.0:1746147255.598747:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2554 00000100:00100000:2.0:1746147255.598752:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465781888:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147255.598832:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467062400:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.598846:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.598865:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465781632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3283us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.598872:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7989 00000100:00100000:3.0:1746147255.599174:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465782144 00000100:00100000:3.0:1746147255.599178:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465782144 00000100:00100000:3.0:1746147255.599214:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15714 00000100:00100000:3.0:1746147255.599220:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31910:x1830967465782144:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147255.599230:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.599241:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd5c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.599259:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.599265:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.599270:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.599271:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.599273:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->1728511] (req 1048576->1728511) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.599289:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.599297:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 25 pid: 21080 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.599304:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062656:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.599357:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.599365:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.599372:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062784:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.599390:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.601080:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967465781888:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2324us (3444us total) trans 21474841399 rc 0/0 00000100:00100000:2.0:1746147255.601089:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2554 00002000:00100000:2.0:1746147255.601097:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (2072576->2097151) req@ffff88009b408e00 x1830967465781888/t21474841399(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.601104:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408e00 with x1830967465781888 ext(2072576->2097151) 00010000:00010000:2.0:1746147255.601111:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.601134:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.601140:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b408e00 00000100:00100000:0.0:1746147255.602766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.602904:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465782272 00000100:00100000:1.0:1746147255.602910:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465782272 00010000:00010000:1.0:1746147255.602959:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 26 pid: 21080 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746147255.602987:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7991 00000100:00100000:1.0:1746147255.602994:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465782272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.603005:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.603023:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 26 pid: 21080 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.603033:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 26 pid: 21080 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746147255.603054:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.603079:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465782272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.603084:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7991 00000100:00100000:2.0:1746147255.603162:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467062528:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147255.603177:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.603194:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465782016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4792us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.603200:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7990 00010000:00010000:3.0:1746147255.603306:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f65400/0xb4b2209fbdad1481 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd2b expref: 25 pid: 21080 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.603322:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062656:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.604712:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467062784:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.604732:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1728511] (req 1048576->1728511) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.604743:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2000, rc 0) 00000100:00100000:3.0:1746147255.604777:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31910:x1830967465782144:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5557us (6071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.604784:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15714 00000100:00100000:0.0:1746147255.606696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.606793:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465782400 00000100:00100000:3.0:1746147255.606800:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465782400 00010000:00010000:3.0:1746147255.606829:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.607176:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7992 00000100:00100000:2.0:1746147255.607184:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465782400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.607197:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.607217:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.607227:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.607247:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764400/0xb4b2209fbdad13fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccd7 expref: 8 pid: 17548 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.607263:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.607265:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.607272:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.607279:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.607309:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.607326:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467062912:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.607390:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.608280:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467062912:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147255.608292:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.608660:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1957:x1830967465782400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1475us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.608666:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7992 00000100:00100000:0.0:1746147255.608967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.609091:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465782912 00000100:00100000:3.0:1746147255.609097:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465782912 00002000:00100000:3.0:1746147255.609138:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009b40aa00 x1830967465782912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.609147:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40aa00 with x1830967465782912 ext(2097152->3145727) 00002000:00010000:3.0:1746147255.609151:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b40aa00 00000100:00100000:3.0:1746147255.609165:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7442 00000100:00100000:3.0:1746147255.609171:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465782912:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147255.611590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.611627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.611640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.611705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.611749:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465783040 00000100:00100000:1.0:1746147255.611756:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465783040 00000100:00100000:2.0:1746147255.611768:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465782784 00000100:00100000:2.0:1746147255.611772:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465782784 00002000:00100000:1.0:1746147255.611789:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b40b480 x1830967465783040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147255.611792:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 742 lvb_type: 0 00002000:00100000:1.0:1746147255.611799:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40b480 with x1830967465783040 ext(3145728->4194303) 00002000:00010000:1.0:1746147255.611803:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b40b480 00000100:00100000:1.0:1746147255.611814:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465783296 00000100:00100000:2.0:1746147255.611816:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7993 00000100:00100000:1.0:1746147255.611816:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465783296 00000100:00100000:2.0:1746147255.611823:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465782784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746147255.611828:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b409500 x1830967465783296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147255.611834:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746147255.611835:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409500 with x1830967465783296 ext(3145728->4194303) 00002000:00010000:1.0:1746147255.611838:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409500 00000100:00100000:1.0:1746147255.611846:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465783552 00000100:00100000:1.0:1746147255.611847:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465783552 00010000:00010000:2.0:1746147255.611852:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 742 lvb_type: 0 00002000:00100000:1.0:1746147255.611855:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4894720->4898815) req@ffff88009b409880 x1830967465783552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.611861:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409880 with x1830967465783552 ext(4894720->4898815) 00002000:00010000:1.0:1746147255.611863:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409880 00010000:00010000:2.0:1746147255.611864:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.611871:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7443 00000100:00100000:1.0:1746147255.611876:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465783040:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:2.0:1746147255.611896:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b077000/0xb4b2209fbdad1496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd40 expref: 17 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.611908:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.611910:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.611915:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.611927:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.611971:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.611983:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467063040:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.612043:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.612060:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7444 00000100:00100000:2.0:1746147255.612065:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465783296:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147255.612376:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7445 00000100:00100000:0.0:1746147255.612383:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465783552:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147255.612497:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465783552:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 115us (792us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147255.612504:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7445 00002000:00100000:0.0:1746147255.612509:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4894720->4898815) req@ffff88009b409880 x1830967465783552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.612516:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409880 with x1830967465783552 ext(4894720->4898815) 00002000:00010000:0.0:1746147255.612519:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409880 00000100:00100000:0.0:1746147255.613000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.613072:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465783808 00000100:00100000:1.0:1746147255.613076:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465783808 00002000:00100000:1.0:1746147255.613095:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1724416->1728511) req@ffff88009b408700 x1830967465783808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.613102:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408700 with x1830967465783808 ext(1724416->1728511) 00002000:00010000:1.0:1746147255.613105:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b408700 00000100:00100000:1.0:1746147255.613115:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7446 00000100:00100000:1.0:1746147255.613130:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465783808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.613209:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465783808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 89us (209us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147255.613215:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7446 00002000:00100000:1.0:1746147255.613220:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1724416->1728511) req@ffff88009b408700 x1830967465783808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.613227:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408700 with x1830967465783808 ext(1724416->1728511) 00002000:00010000:1.0:1746147255.613230:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b408700 00000100:00100000:2.0:1746147255.615406:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467063040:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147255.615428:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.615464:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465782784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3640us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.615475:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7993 00000100:00100000:0.0:1746147255.618280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.618700:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465784064 00000100:00100000:2.0:1746147255.618712:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465784064 00000100:00100000:2.0:1746147255.618768:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4802 00000100:00100000:2.0:1746147255.618777:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:31907:x1830967465784064:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147255.619018:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31907:x1830967465784064:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 242us (748us total) trans 8589945486 rc 0/0 00000100:00100000:2.0:1746147255.619025:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4802 00000100:00100000:0.0:1746147255.619054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.619337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.619348:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465784320 00000100:00100000:2.0:1746147255.619353:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465784320 00000100:00100000:2.0:1746147255.619379:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4803 00000100:00100000:2.0:1746147255.619384:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:31910:x1830967465784320:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147255.619604:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+321:31910:x1830967465784320:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 218us (549us total) trans 8589945487 rc 0/0 00000100:00100000:1.0:1746147255.619604:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465784576 00000100:00100000:1.0:1746147255.619608:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465784576 00000100:00100000:2.0:1746147255.619610:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4803 00002000:00100000:1.0:1746147255.619634:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b408a80 x1830967465784576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.619643:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408a80 with x1830967465784576 ext(1048576->2097151) 00002000:00010000:1.0:1746147255.619648:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b408a80 00000100:00100000:1.0:1746147255.619707:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7447 00000100:00100000:1.0:1746147255.619714:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967465784576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147255.619739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.619752:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465784832 00000100:00100000:0.0:1746147255.619755:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465784832 00002000:00100000:0.0:1746147255.619771:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1728512->2097151) req@ffff88008f9fdc00 x1830967465784832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.619777:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdc00 with x1830967465784832 ext(1728512->2097151) 00002000:00010000:0.0:1746147255.619781:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fdc00 00000100:00100000:0.0:1746147255.619804:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7448 00000100:00100000:0.0:1746147255.619809:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465784832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.624014:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1957:x1830967465783296:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11932us (12356us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.624027:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7444 00002000:00100000:2.0:1746147255.624040:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b409500 x1830967465783296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.624049:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409500 with x1830967465783296 ext(3145728->4194303) 00002000:00010000:2.0:1746147255.624054:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409500 00000100:00100000:3.0:1746147255.630207:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465783040:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18319us (18568us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.630220:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7443 00002000:00100000:3.0:1746147255.630232:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b40b480 x1830967465783040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.630241:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40b480 with x1830967465783040 ext(3145728->4194303) 00002000:00010000:3.0:1746147255.630247:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b40b480 00000100:00100000:3.0:1746147255.637131:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465782912:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 27939us (28143us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.637144:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7442 00002000:00100000:3.0:1746147255.637156:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009b40aa00 x1830967465782912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.637165:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40aa00 with x1830967465782912 ext(2097152->3145727) 00002000:00010000:3.0:1746147255.637172:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b40aa00 00000100:00100000:2.0:1746147255.638958:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967465784832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19141us (19211us total) trans 0 rc 368640/368640 00000100:00100000:2.0:1746147255.638967:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7448 00002000:00100000:2.0:1746147255.638975:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1728512->2097151) req@ffff88008f9fdc00 x1830967465784832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.638984:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdc00 with x1830967465784832 ext(1728512->2097151) 00002000:00010000:2.0:1746147255.638988:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fdc00 00000100:00100000:1.0:1746147255.642709:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967465784576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22981us (23357us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147255.642722:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7447 00002000:00100000:1.0:1746147255.642735:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b408a80 x1830967465784576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.642744:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408a80 with x1830967465784576 ext(1048576->2097151) 00002000:00010000:1.0:1746147255.642750:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b408a80 00000100:00100000:0.0:1746147255.644002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.644049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.644098:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785088 00000100:00100000:1.0:1746147255.644106:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785088 00000100:00100000:1.0:1746147255.644150:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465784960 00000100:00100000:1.0:1746147255.644153:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465784960 00000100:00100000:1.0:1746147255.644169:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15715 00000100:00100000:1.0:1746147255.644175:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1956:x1830967465785088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.644192:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.644209:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1a00/0xb4b2209fbdad14b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd6a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.644261:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467063168:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147255.644403:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15716 00000100:00100000:0.0:1746147255.644410:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465784960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147255.644419:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147255.644428:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd63 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.644440:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.644442:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.644450:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.644463:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.644471:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dcc200, rc 0) 00000100:00100000:0.0:1746147255.644491:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465784960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 83us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.644496:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15716 00000100:00100000:1.0:1746147255.645660:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.645909:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467063168:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.645961:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1a00/0xb4b2209fbdad14b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd6a expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.645973:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1a00/0xb4b2209fbdad14b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd6a expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.646592:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1a00, rc 0) 00000100:00100000:1.0:1746147255.646637:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1956:x1830967465785088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2460us (2637us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.646645:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15715 00000100:00100000:0.0:1746147255.651029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.651115:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785344 00000100:00100000:1.0:1746147255.651132:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785344 00002000:00100000:1.0:1746147255.651181:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4898816->4976639) req@ffff88008f9ff480 x1830967465785344/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.651190:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff480 with x1830967465785344 ext(4898816->4976639) 00002000:00010000:1.0:1746147255.651195:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff480 00000100:00100000:1.0:1746147255.651230:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7449 00000100:00100000:1.0:1746147255.651237:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1957:x1830967465785344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.654018:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1957:x1830967465785344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 2768us (2985us total) trans 0 rc 77824/77824 00000100:00100000:1.0:1746147255.654030:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7449 00002000:00100000:1.0:1746147255.654040:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4898816->4976639) req@ffff88008f9ff480 x1830967465785344/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 77824/77824 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.654056:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff480 with x1830967465785344 ext(4898816->4976639) 00002000:00010000:1.0:1746147255.654061:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff480 00000100:00100000:0.0:1746147255.654341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.654429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.654643:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785472 00000100:00100000:1.0:1746147255.654651:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785472 00000100:00100000:1.0:1746147255.654690:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785600 00000100:00100000:1.0:1746147255.654692:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785600 00000100:00100000:3.0:1746147255.654700:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15717 00000100:00100000:3.0:1746147255.654709:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465785472:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147255.654718:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15718 00000100:00100000:1.0:1746147255.654723:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465785600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.654737:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.654857:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.654859:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd78 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.654866:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdad14ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd71 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.654880:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.654881:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.654889:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 17 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.654902:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 17 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147255.654907:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467063296:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.654912:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0800, rc 0) 00000100:00100000:1.0:1746147255.654952:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465785600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 212us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.654958:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15718 00000100:00100000:3.0:1746147255.654968:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.656435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.656482:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467063296:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147255.656507:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdad14ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd71 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.656517:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdad14ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd71 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147255.656529:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785728 00000100:00100000:1.0:1746147255.656533:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785728 00010000:00010000:3.0:1746147255.656570:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3000, rc 0) 00000100:00100000:1.0:1746147255.656578:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15719 00000100:00100000:1.0:1746147255.656583:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1958:x1830967465785728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.656592:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147255.656600:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465785472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1894us (2260us total) trans 0 rc 301/301 00010000:00010000:1.0:1746147255.656601:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad14d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd7f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.656605:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15717 00000100:00100000:1.0:1746147255.656632:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467063424:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.657097:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.658275:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467063424:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.658299:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad14d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd7f expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.658309:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1800/0xb4b2209fbdad14d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd7f expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147255.658332:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1800, rc 0) 00000100:00100000:0.0:1746147255.658359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.658366:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1958:x1830967465785728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1783us (1935us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147255.658372:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15719 00000100:00100000:1.0:1746147255.658387:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785856 00000100:00100000:1.0:1746147255.658392:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785856 00000100:00100000:1.0:1746147255.658411:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15720 00000100:00100000:1.0:1746147255.658523:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31914:x1830967465785856:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.658538:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.658547:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd86 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.658571:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.658578:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.658579:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.658582:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.658601:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.658613:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 6 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.658623:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467063552:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147255.658756:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.660552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.660595:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465786112 00000100:00100000:3.0:1746147255.660602:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465786112 00000100:00100000:0.0:1746147255.660622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.660666:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15721 00000100:00100000:3.0:1746147255.660673:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1959:x1830967465786112:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147255.660683:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465785984 00010000:00010000:3.0:1746147255.660685:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147255.660686:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465785984 00010000:00010000:3.0:1746147255.660695:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930f3c00/0xb4b2209fbdad14e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd8d expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147255.660711:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4898815) req@ffff88008f9fc380 x1830967465785984/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.660718:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc380 with x1830967465785984 ext(4194304->4898815) 00010000:00010000:1.0:1746147255.660724:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.660730:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467063680:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147255.660733:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746147255.660739:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fc380 00000100:00100000:3.0:1746147255.660775:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.660984:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467063552:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147255.661002:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.661013:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1600, rc 0) 00000100:00100000:0.0:1746147255.661041:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31914:x1830967465785856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2624us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.661047:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15720 00000100:00100000:1.0:1746147255.661139:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2555 00000100:00100000:1.0:1746147255.661146:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465785984:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147255.663956:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467063680:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147255.663987:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930f3c00/0xb4b2209fbdad14e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd8d expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.664000:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f3c00/0xb4b2209fbdad14e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd8d expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.664024:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3c00, rc 0) 00000100:00100000:3.0:1746147255.664060:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465786112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3387us (3512us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147255.664067:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15721 00000100:00100000:1.0:1746147255.669736:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465785984:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8579us (9102us total) trans 17179874046 rc 0/0 00000100:00100000:1.0:1746147255.669750:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2555 00002000:00100000:1.0:1746147255.669762:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4898815) req@ffff88008f9fc380 x1830967465785984/t17179874046(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.669776:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc380 with x1830967465785984 ext(4194304->4898815) 00010000:00010000:1.0:1746147255.669786:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.669801:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746147255.669808:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fc380 00000100:00100000:0.0:1746147255.672794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.672866:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465786240 00000100:00100000:2.0:1746147255.672874:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465786240 00010000:00010000:2.0:1746147255.672905:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.672959:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7994 00000100:00100000:2.0:1746147255.672964:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465786240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.672978:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.672994:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.673003:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.673021:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd85400/0xb4b2209fbdad14ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd55 expref: 9 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.673035:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.673036:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.673043:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.673048:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.673074:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.673082:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467063808:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.673168:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.674737:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467063808:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147255.674753:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.674782:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967465786240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1815us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.674790:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7994 00000100:00100000:0.0:1746147255.681443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.681482:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.681510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.681641:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465786496 00000100:00100000:2.0:1746147255.681651:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465786496 00000100:00100000:3.0:1746147255.681658:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465786624 00000100:00100000:3.0:1746147255.681662:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465786624 00000100:00100000:1.0:1746147255.681688:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465787136 00000100:00100000:1.0:1746147255.681691:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465787136 00002000:00100000:2.0:1746147255.681699:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008f9ff100 x1830967465786496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.681709:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff100 with x1830967465786496 ext(2097152->3145727) 00002000:00010000:2.0:1746147255.681714:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff100 00000100:00100000:0.0:1746147255.681717:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.681736:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465787008 00000100:00100000:2.0:1746147255.681739:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465787008 00002000:00100000:3.0:1746147255.681768:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9fc000 x1830967465786624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.681775:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc000 with x1830967465786624 ext(3145728->4194303) 00002000:00100000:2.0:1746147255.681792:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008f9fd880 x1830967465787008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.681793:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fc700 x1830967465787136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.681799:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fd880 with x1830967465787008 ext(2097152->3145727) 00002000:00100000:1.0:1746147255.681800:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc700 with x1830967465787136 ext(3145728->4194303) 00002000:00010000:2.0:1746147255.681802:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fd880 00002000:00010000:1.0:1746147255.681802:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fc700 00000100:00100000:2.0:1746147255.681818:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7450 00000100:00100000:2.0:1746147255.681824:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465786496:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:3.0:1746147255.681827:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fc000 00000100:00100000:1.0:1746147255.681845:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7451 00000100:00100000:1.0:1746147255.681850:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967465787136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.682112:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7452 00000100:00100000:2.0:1746147255.682141:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967465787008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147255.683981:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7453 00000100:00100000:3.0:1746147255.683993:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465786624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.697241:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967465787136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15380us (15720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147255.697252:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7451 00002000:00100000:1.0:1746147255.697265:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fc700 x1830967465787136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.697274:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc700 with x1830967465787136 ext(3145728->4194303) 00002000:00010000:1.0:1746147255.697280:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fc700 00000100:00100000:2.0:1746147255.709377:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465786496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27542us (27934us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.709389:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7450 00002000:00100000:2.0:1746147255.709402:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008f9ff100 x1830967465786496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.709412:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff100 with x1830967465786496 ext(2097152->3145727) 00002000:00010000:2.0:1746147255.709419:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff100 00000100:00100000:3.0:1746147255.709720:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465786624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25731us (28235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.709728:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7453 00002000:00100000:3.0:1746147255.709733:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9fc000 x1830967465786624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.709746:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc000 with x1830967465786624 ext(3145728->4194303) 00002000:00010000:3.0:1746147255.709750:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fc000 00000100:00100000:2.0:1746147255.715028:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465787008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 32898us (33298us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.715042:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7452 00002000:00100000:2.0:1746147255.715053:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008f9fd880 x1830967465787008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.715063:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fd880 with x1830967465787008 ext(2097152->3145727) 00002000:00010000:2.0:1746147255.715070:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fd880 00000100:00100000:0.0:1746147255.726781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.726849:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465787520 00000100:00100000:2.0:1746147255.726859:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465787520 00002000:00100000:2.0:1746147255.727845:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a4672680 x1830967465787520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.727856:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672680 with x1830967465787520 ext(4194304->4976639) 00002000:00010000:2.0:1746147255.727862:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4672680 00000100:00100000:2.0:1746147255.727894:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7454 00000100:00100000:2.0:1746147255.727901:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465787520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.735267:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465787520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7353us (8483us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147255.735280:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7454 00002000:00100000:2.0:1746147255.735293:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a4672680 x1830967465787520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.735302:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672680 with x1830967465787520 ext(4194304->4976639) 00002000:00010000:2.0:1746147255.735311:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4672680 00000100:00100000:0.0:1746147255.748414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.748522:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465787776 00000100:00100000:2.0:1746147255.748532:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465787776 00000100:00100000:2.0:1746147255.748829:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11478 00000100:00100000:2.0:1746147255.748838:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+321:31920:x1830967465787776:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147255.748862:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.748880:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f64600/0xb4b2209fbdad14ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd94 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.749096:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.749111:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 322 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.749125:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.749156:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 322 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.749168:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 322 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.749180:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467063936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147255.750194:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.754161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.754161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.754196:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465787904 00000100:00100000:2.0:1746147255.754204:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465787904 00010000:00010000:2.0:1746147255.754241:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 323 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.754269:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7995 00000100:00100000:2.0:1746147255.754276:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+323:1956:x1830967465787904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.754287:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.754292:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 323 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.754302:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 323 pid: 23726 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.754323:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147255.754327:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.754335:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.754341:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147255.754356:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147255.754400:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdad146c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd1d expref: 323 pid: 23726 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.754428:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467063936:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.754446:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.754452:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147255.754456:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147255.754473:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:0.0:1746147255.754568:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465788160 00000100:00100000:0.0:1746147255.754573:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465788160 00010000:00010000:3.0:1746147255.754585:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f64600/0xb4b2209fbdad14ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 324 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.754597:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 323 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.754604:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147255.754606:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1746147255.754608:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11479 00010000:00010000:3.0:1746147255.754609:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65400, rc 0) 00000100:00100000:0.0:1746147255.754614:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:31921:x1830967465788160:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147255.754646:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.754658:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad14ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecd9b expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.754747:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754755:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754762:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754773:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754778:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754783:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754886:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad1514 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754894:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad1514 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754899:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad1514 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147255.754905:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147255.754982:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754988:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754993:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.754998:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093855c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.755002:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755008:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755015:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.755017:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.755020:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755023:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855c00/0xb4b2209fbdad1506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755039:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755044:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755048:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755052:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093854200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.755054:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755058:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.755064:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98fb00) 00010000:00010000:1.0:1746147255.755066:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.755068:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147255.755228:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+323:1956:x1830967465787904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 951us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.755235:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7995 00000100:00100000:3.0:1746147255.755250:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+322:31920:x1830967465787776:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6411us (6846us total) trans 8589945488 rc 0/0 00010000:00010000:1.0:1746147255.755257:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093854200/0xb4b2209fbdad150d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147255.755258:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11478 00010000:00010000:1.0:1746147255.755291:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c1c00/0xb4b2209fbdad14ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd9b expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.755301:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad1514 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd9b expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.755307:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.755309:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147255.755316:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855800, rc 0) 00000100:00100000:1.0:1746147255.755334:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+28:31921:x1830967465788160:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 720us (1177us total) trans 8589945489 rc 0/0 00000100:00100000:1.0:1746147255.755339:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11479 00000100:00100000:0.0:1746147255.759543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.759673:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465788288 00000100:00100000:2.0:1746147255.759684:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465788288 00000100:00100000:2.0:1746147255.759827:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 783 00000100:00100000:2.0:1746147255.759837:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465788288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.759858:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.759888:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855800/0xb4b2209fbdad1514 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd9b expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.760467:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147255.760474:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147255.760555:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465788288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 717us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.760563:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 783 00000100:00100000:0.0:1746147255.852679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.852915:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465788416 00000100:00100000:3.0:1746147255.852925:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465788416 00000100:00100000:3.0:1746147255.853003:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15722 00000100:00100000:3.0:1746147255.853010:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+17:31920:x1830967465788416:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147255.853029:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.853046:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecda2 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.853075:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.853084:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.853090:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.853092:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.853095:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1073152->1892351] (req 1073152->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.853138:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.853151:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 11 pid: 8480 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.853163:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467064064:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.853276:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.853285:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 18 pid: 21080 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.853292:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467064192:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.853312:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.858379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.858443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.858445:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465788544 00000100:00100000:2.0:1746147255.858451:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465788544 00010000:00010000:2.0:1746147255.858486:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 12 pid: 8480 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746147255.858500:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465788672 00000100:00100000:0.0:1746147255.858505:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465788672 00010000:00010000:0.0:1746147255.858526:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 19 pid: 21080 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.858527:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7996 00000100:00100000:2.0:1746147255.858534:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465788544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.858548:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147255.858549:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7997 00000100:00100000:0.0:1746147255.858556:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465788672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147255.858565:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.858569:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 12 pid: 8480 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746147255.858578:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 19 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.858579:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 12 pid: 8480 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746147255.858590:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 19 pid: 21080 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.858711:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147255.858725:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.858729:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147255.858738:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147255.858748:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.858752:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465788544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 218us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147255.858801:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147255.858816:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467064320:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.858848:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7996 00000100:00100000:0.0:1746147255.858871:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00010000:00010000:3.0:1746147255.859317:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129dcc200/0xb4b2209fbdad14c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd63 expref: 11 pid: 8480 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746147255.861391:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467064064:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.861423:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c1000/0xb4b2209fbdad149d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd47 expref: 19 pid: 21080 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.861435:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467064192:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.861459:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.861469:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2600, rc 0) 00000100:00100000:0.0:1746147255.861950:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467064320:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147255.861963:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147255.861988:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967465788672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3432us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147255.861996:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7997 00000100:00100000:3.0:1746147255.862831:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+17:31920:x1830967465788416:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9820us (10159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.862838:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15722 00000100:00100000:0.0:1746147255.880542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.880647:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465788928 00000100:00100000:2.0:1746147255.880658:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465788928 00002000:00100000:2.0:1746147255.880712:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1073152->1077247) req@ffff8800a4671500 x1830967465788928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.880723:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967465788928 ext(1073152->1077247) 00002000:00010000:2.0:1746147255.880728:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671500 00000100:00100000:2.0:1746147255.880767:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7455 00000100:00100000:2.0:1746147255.880779:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465788928:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147255.881007:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465788928:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 230us (474us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147255.881014:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7455 00002000:00100000:2.0:1746147255.881019:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1073152->1077247) req@ffff8800a4671500 x1830967465788928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.881026:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967465788928 ext(1073152->1077247) 00002000:00010000:2.0:1746147255.881029:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671500 00000100:00100000:0.0:1746147255.881983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.882258:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465789056 00000100:00100000:3.0:1746147255.882264:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465789056 00000100:00100000:3.0:1746147255.882298:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15723 00000100:00100000:3.0:1746147255.882303:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+11:31921:x1830967465789056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147255.882316:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.882331:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecda9 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.882356:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 16 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.882364:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.882365:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147255.882369:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [2039808->2097151] (req 2039808->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.882399:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 16 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.882411:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 16 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746147255.882422:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467064448:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147255.886248:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147255.886293:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467064448:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147255.886321:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [2039808->2097151] (req 2039808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.886338:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3000, rc 0) 00000100:00100000:3.0:1746147255.886389:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31921:x1830967465789056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4085us (4409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.886400:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15723 00000100:00100000:0.0:1746147255.891570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.891691:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465789312 00000100:00100000:1.0:1746147255.891700:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465789312 00000100:00100000:1.0:1746147255.891875:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11480 00000100:00100000:1.0:1746147255.891883:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:31925:x1830967465789312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.891907:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.892050:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093855200/0xb4b2209fbdad1530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdb0 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.892171:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892184:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892193:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892206:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892211:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892215:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892318:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad1545 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892328:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad1545 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892333:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad1545 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147255.892341:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147255.892427:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892434:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892439:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892445:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093855400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.892449:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892455:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892464:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147255.892466:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.892469:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.892473:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855400/0xb4b2209fbdad1537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893523:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893536:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893541:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893545:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093855e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147255.893548:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893553:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893561:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f700) 00010000:00010000:1.0:1746147255.893563:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147255.893565:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893570:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855e00/0xb4b2209fbdad153e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147255.893607:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093855200/0xb4b2209fbdad1530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdb0 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.893617:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad1545 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdb0 expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.893624:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.893626:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147255.893628:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854a00, rc 0) 00000100:00100000:1.0:1746147255.894323:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31925:x1830967465789312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2438us (2760us total) trans 8589945490 rc 0/0 00000100:00100000:1.0:1746147255.894333:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11480 00000100:00100000:0.0:1746147255.896299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.896375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.896487:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465789696 00000100:00100000:1.0:1746147255.896495:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465789696 00000100:00100000:2.0:1746147255.896508:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465789568 00000100:00100000:2.0:1746147255.896512:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465789568 00000100:00100000:2.0:1746147255.896544:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4804 00000100:00100000:1.0:1746147255.896545:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 784 00000100:00100000:2.0:1746147255.896550:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31925:x1830967465789568:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147255.896551:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465789696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.896565:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.896585:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093854a00/0xb4b2209fbdad1545 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdb0 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.896598:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147255.896601:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.896633:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465789696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.896638:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 784 00000100:00100000:2.0:1746147255.896804:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31925:x1830967465789568:12345-192.168.203.36@tcp:35:cat.0 Request processed in 249us (505us total) trans 8589945491 rc 0/0 00000100:00100000:2.0:1746147255.896810:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4804 00000100:00100000:0.0:1746147255.897175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.897321:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465789952 00000100:00100000:3.0:1746147255.897325:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465789952 00002000:00100000:3.0:1746147255.897354:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1888256->1892351) req@ffff8800a4671c00 x1830967465789952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.897364:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671c00 with x1830967465789952 ext(1888256->1892351) 00010000:00010000:3.0:1746147255.897371:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 17 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.897382:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 17 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.897389:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4671c00 00000100:00100000:3.0:1746147255.897402:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2556 00000100:00100000:3.0:1746147255.897407:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465789952:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147255.897545:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465789952:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 137us (369us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147255.897551:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2556 00002000:00100000:3.0:1746147255.897557:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1888256->1892351) req@ffff8800a4671c00 x1830967465789952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.897563:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671c00 with x1830967465789952 ext(1888256->1892351) 00010000:00010000:3.0:1746147255.897567:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 17 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.897581:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 17 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.897586:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4671c00 00000100:00100000:2.0:1746147255.900021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.900055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.900064:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465790336 00000100:00100000:3.0:1746147255.900072:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465790336 00000100:00100000:2.0:1746147255.900072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.900085:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465790464 00000100:00100000:2.0:1746147255.900088:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465790464 00000100:00100000:2.0:1746147255.900109:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465790592 00000100:00100000:2.0:1746147255.900112:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465790592 00000100:00100000:3.0:1746147255.900114:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15724 00000100:00100000:3.0:1746147255.900131:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465790336:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147255.900136:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15725 00000100:00100000:2.0:1746147255.900142:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465790464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.900147:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.900150:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.900163:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad155a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdbe expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.900164:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f3800/0xb4b2209fbdad1553 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdb7 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.900211:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467064576:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147255.900281:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467064704:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147255.900315:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15726 00000100:00100000:2.0:1746147255.900371:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465790592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147255.900378:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.900385:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdc5 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.900395:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.900397:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.900405:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.900419:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.900433:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98dc00, rc 0) 00000100:00100000:2.0:1746147255.900454:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465790592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.900459:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15726 00000100:00100000:2.0:1746147255.900504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.900528:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465790208 00000100:00100000:0.0:1746147255.900533:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465790208 00002000:00100000:0.0:1746147255.900557:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1073152->1892351) req@ffff88008d5df100 x1830967465790208/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147255.900565:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df100 with x1830967465790208 ext(1073152->1892351) 00010000:00010000:0.0:1746147255.900570:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 17 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746147255.900587:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 17 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:0.0:1746147255.900597:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5df100 00000100:00100000:0.0:1746147255.900610:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2557 00000100:00100000:0.0:1746147255.900616:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465790208:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147255.901362:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.901405:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.902240:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467064704:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147255.902593:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad155a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdbe expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.902604:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98d600/0xb4b2209fbdad155a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdbe expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147255.902625:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d98d600, rc 0) 00000100:00100000:2.0:1746147255.903330:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465790464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2516us (2602us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147255.903340:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15725 00000100:00100000:0.0:1746147255.904627:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467064576:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147255.904664:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3800/0xb4b2209fbdad1553 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdb7 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.904678:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3800/0xb4b2209fbdad1553 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdb7 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.905291:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3800, rc 0) 00000100:00100000:0.0:1746147255.905338:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465790336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5206us (5324us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147255.905347:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15724 00000100:00100000:0.0:1746147255.912913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.913715:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967465790208:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 13097us (13208us total) trans 21474841400 rc 0/0 00000100:00100000:2.0:1746147255.913727:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2557 00002000:00100000:2.0:1746147255.913740:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1073152->1892351) req@ffff88008d5df100 x1830967465790208/t21474841400(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.913750:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df100 with x1830967465790208 ext(1073152->1892351) 00010000:00010000:2.0:1746147255.913760:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.913774:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.913782:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5df100 00000100:00100000:1.0:1746147255.913875:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465790720 00000100:00100000:1.0:1746147255.913884:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465790720 00000100:00100000:1.0:1746147255.913929:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15727 00000100:00100000:1.0:1746147255.913951:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31925:x1830967465790720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.913967:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.913987:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdcc expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.914012:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147255.914018:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2039808->2097151] (req 2039808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.914028:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147255.914031:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 13 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.914068:0:8480:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2039808->2097151] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.914080:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 13 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.914090:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855a00, rc 0) 00000100:00100000:1.0:1746147255.914128:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31925:x1830967465790720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 193us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.914133:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15727 00000100:00100000:0.0:1746147255.916051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.916385:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465790848 00000100:00100000:1.0:1746147255.916391:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465790848 00010000:00010000:1.0:1746147255.916415:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.916448:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7998 00000100:00100000:1.0:1746147255.916454:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967465790848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.916464:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.916483:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.916499:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.916519:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2600/0xb4b2209fbdad1522 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda2 expref: 19 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.916551:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.916553:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.916560:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.916567:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.916592:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.916602:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 12 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.916613:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467064960:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147255.916697:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.917980:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467064960:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.917997:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.918033:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967465790848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1578us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.918042:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7998 00000100:00100000:0.0:1746147255.918727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.918833:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465791232 00000100:00100000:2.0:1746147255.918840:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465791232 00002000:00100000:2.0:1746147255.918875:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (2039808->2043903) req@ffff88008f9ff800 x1830967465791232/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.918885:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff800 with x1830967465791232 ext(2039808->2043903) 00010000:00010000:2.0:1746147255.918893:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.918909:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.918916:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9ff800 00000100:00100000:2.0:1746147255.918962:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2558 00000100:00100000:2.0:1746147255.918969:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465791232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.919134:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465791232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 165us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147255.919139:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2558 00002000:00100000:2.0:1746147255.919145:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (2039808->2043903) req@ffff88008f9ff800 x1830967465791232/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.919158:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff800 with x1830967465791232 ext(2039808->2043903) 00010000:00010000:2.0:1746147255.919163:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.919172:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.919178:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9ff800 00000100:00100000:0.0:1746147255.921618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.921773:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465791488 00000100:00100000:2.0:1746147255.921782:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465791488 00002000:00100000:2.0:1746147255.921823:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (2039808->2097151) req@ffff88009e680000 x1830967465791488/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.921832:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680000 with x1830967465791488 ext(2039808->2097151) 00010000:00010000:2.0:1746147255.921840:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.921853:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 13 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.921860:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e680000 00000100:00100000:2.0:1746147255.921895:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2559 00000100:00100000:2.0:1746147255.921903:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465791488:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147255.922184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.923128:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465791616 00000100:00100000:2.0:1746147255.923134:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465791616 00000100:00100000:2.0:1746147255.923179:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15728 00000100:00100000:2.0:1746147255.923187:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:31921:x1830967465791616:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147255.923200:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147255.923216:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdd3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.923243:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.923249:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147255.923251:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147255.923254:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 10 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.923285:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.923295:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 24 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.923307:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467065088:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147255.923386:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.924976:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465791488:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3035us (3327us total) trans 21474841401 rc 0/0 00000100:00100000:2.0:1746147255.924987:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2559 00002000:00100000:2.0:1746147255.924998:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (2039808->2097151) req@ffff88009e680000 x1830967465791488/t21474841401(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.925013:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680000 with x1830967465791488 ext(2039808->2097151) 00010000:00010000:2.0:1746147255.925021:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 15 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.925033:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 15 pid: 4444 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746147255.925039:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e680000 00000100:00100000:0.0:1746147255.927630:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.927860:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467065088:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147255.927888:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 10 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.927904:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1800, rc 0) 00000100:00100000:2.0:1746147255.927963:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:31921:x1830967465791616:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4777us (5779us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.927971:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15728 00000100:00100000:0.0:1746147255.928264:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.928328:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465791872 00000100:00100000:1.0:1746147255.928335:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465791872 00010000:00010000:1.0:1746147255.928362:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 15 pid: 4444 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746147255.928394:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7999 00000100:00100000:1.0:1746147255.928401:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465791872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147255.928413:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147255.928437:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 15 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.928446:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 15 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.928467:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdad1529 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecda9 expref: 15 pid: 4444 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746147255.928490:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.928492:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147255.928499:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.928507:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147255.928535:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147255.928832:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465791744 00000100:00100000:3.0:1746147255.928837:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465791744 00002000:00100000:3.0:1746147255.928864:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1728511) req@ffff88009e683480 x1830967465791744/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.928872:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967465791744 ext(1048576->1728511) 00010000:00010000:3.0:1746147255.928877:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 25 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.928887:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 25 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.928898:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e683480 00000100:00100000:3.0:1746147255.928922:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2560 00000100:00100000:3.0:1746147255.928928:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465791744:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147255.929187:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467065216:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147255.929243:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147255.933500:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467065216:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147255.933520:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147255.934089:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465791872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5685us (5822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147255.934100:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7999 00000100:00100000:2.0:1746147255.935540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.935672:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465792128 00000100:00100000:3.0:1746147255.935681:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465792128 00002000:00100000:3.0:1746147255.935726:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008d5dfb80 x1830967465792128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.935736:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967465792128 ext(1048576->2097151) 00002000:00010000:3.0:1746147255.935741:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dfb80 00000100:00100000:3.0:1746147255.935773:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7456 00000100:00100000:3.0:1746147255.935785:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465792128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147255.941094:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465791744:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 12155us (13462us total) trans 17179874047 rc 0/0 00000100:00100000:3.0:1746147255.941108:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2560 00002000:00100000:3.0:1746147255.941128:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1728511) req@ffff88009e683480 x1830967465791744/t17179874047(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/448 e 0 to 0 dl 1746147266 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.941139:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967465791744 ext(1048576->1728511) 00010000:00010000:3.0:1746147255.941150:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 27 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746147255.941165:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 27 pid: 8478 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746147255.941178:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e683480 00000100:00100000:2.0:1746147255.945568:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465792128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9773us (10019us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147255.945580:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7456 00002000:00100000:2.0:1746147255.945592:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008d5dfb80 x1830967465792128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.945601:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967465792128 ext(1048576->2097151) 00002000:00010000:2.0:1746147255.945607:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dfb80 00000100:00100000:3.0:1746147255.948070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.948467:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465792256 00000100:00100000:0.0:1746147255.948478:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465792256 00010000:00010000:0.0:1746147255.948517:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 27 pid: 8478 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746147255.948990:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8000 00000100:00100000:2.0:1746147255.949001:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465792256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147255.949017:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147255.949041:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 27 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.949054:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 27 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.949076:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2000/0xb4b2209fbdad14b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1728511) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd5c expref: 27 pid: 8478 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746147255.949129:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.949131:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147255.949140:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 9 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.949148:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 9 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147255.949188:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 9 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147255.949200:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467065344:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147255.949284:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147255.951027:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467065344:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147255.951051:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147255.953399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.953543:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465792256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4541us (5478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147255.953556:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8000 00000100:00100000:3.0:1746147255.954130:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465792512 00000100:00100000:3.0:1746147255.954139:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465792512 00002000:00100000:3.0:1746147255.954180:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e6f0380 x1830967465792512/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.954190:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0380 with x1830967465792512 ext(1048576->2097151) 00002000:00010000:3.0:1746147255.954197:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0380 00000100:00100000:3.0:1746147255.954229:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7457 00000100:00100000:3.0:1746147255.954236:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465792512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147255.965418:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465792512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11172us (12017us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147255.965432:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7457 00002000:00100000:3.0:1746147255.965446:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e6f0380 x1830967465792512/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.965455:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0380 with x1830967465792512 ext(1048576->2097151) 00002000:00010000:3.0:1746147255.965462:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0380 00000100:00100000:0.0:1746147255.973486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.975394:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465792768 00000100:00100000:2.0:1746147255.975406:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465792768 00000100:00100000:2.0:1746147255.975465:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4805 00000100:00100000:2.0:1746147255.975472:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:31921:x1830967465792768:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147255.975704:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31921:x1830967465792768:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 232us (2228us total) trans 8589945492 rc 0/0 00000100:00100000:2.0:1746147255.975710:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4805 00000100:00100000:0.0:1746147255.978229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.978342:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465792896 00000100:00100000:3.0:1746147255.978352:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465792896 00000100:00100000:3.0:1746147255.978408:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15729 00000100:00100000:3.0:1746147255.978415:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967465792896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147255.978848:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147255.978871:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdda expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147255.978961:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.978963:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147255.978972:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.978986:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147255.978997:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e3800, rc 0) 00000100:00100000:3.0:1746147255.979040:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465792896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 625us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147255.979046:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15729 00000100:00100000:0.0:1746147255.979316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147255.979351:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465793024 00000100:00100000:1.0:1746147255.979356:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465793024 00000100:00100000:1.0:1746147255.979387:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15730 00000100:00100000:1.0:1746147255.979392:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465793024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147255.979400:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147255.979411:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093855200/0xb4b2209fbdad157d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecde1 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147255.979450:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065472:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147255.979518:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147255.979881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147255.979919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147255.980615:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465793280 00000100:00100000:1.0:1746147255.980615:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465793536 00000100:00100000:1.0:1746147255.980619:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465793536 00000100:00100000:2.0:1746147255.980620:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465793280 00002000:00100000:2.0:1746147255.980648:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e681500 x1830967465793280/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.980648:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e683100 x1830967465793536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147255.980657:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967465793280 ext(2097152->3145727) 00002000:00100000:1.0:1746147255.980657:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683100 with x1830967465793536 ext(3145728->4194303) 00002000:00010000:2.0:1746147255.980661:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681500 00002000:00010000:1.0:1746147255.980661:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e683100 00000100:00100000:1.0:1746147255.981741:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7458 00000100:00100000:1.0:1746147255.981750:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465793536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147255.981775:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7459 00000100:00100000:2.0:1746147255.981782:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465793280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147255.982642:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065472:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147255.982671:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093855200/0xb4b2209fbdad157d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde1 expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.982681:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093855200/0xb4b2209fbdad157d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde1 expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147255.982696:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855200, rc 0) 00000100:00100000:0.0:1746147255.982761:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465793024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3368us (3445us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147255.982768:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15730 00000100:00100000:0.0:1746147255.994401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147255.995377:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465793792 00000100:00100000:3.0:1746147255.995388:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465793792 00002000:00100000:3.0:1746147255.995430:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e682d80 x1830967465793792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/0 e 0 to 0 dl 1746147266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147255.995441:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682d80 with x1830967465793792 ext(1048576->2097151) 00002000:00010000:3.0:1746147255.995446:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682d80 00000100:00100000:3.0:1746147255.995476:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7460 00000100:00100000:3.0:1746147255.995482:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967465793792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147255.998310:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465793536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16553us (18382us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147255.998321:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7458 00002000:00100000:1.0:1746147255.998332:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e683100 x1830967465793536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147255.998342:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683100 with x1830967465793536 ext(3145728->4194303) 00002000:00010000:1.0:1746147255.998347:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e683100 00010000:00010000:3.0:1746147256.003530:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147256.004060:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465793280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22271us (24171us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147256.004071:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7459 00002000:00100000:2.0:1746147256.004084:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e681500 x1830967465793280/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.004099:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967465793280 ext(2097152->3145727) 00002000:00010000:2.0:1746147256.004105:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681500 00000100:00100000:3.0:1746147256.008611:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967465793792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13118us (14209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.008623:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7460 00002000:00100000:3.0:1746147256.008636:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e682d80 x1830967465793792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:631/0 lens 488/440 e 0 to 0 dl 1746147266 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.008645:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682d80 with x1830967465793792 ext(1048576->2097151) 00002000:00010000:3.0:1746147256.008651:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682d80 00000100:00100000:0.0:1746147256.013550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.013700:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794048 00000100:00100000:3.0:1746147256.013711:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794048 00002000:00100000:3.0:1746147256.013763:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e680380 x1830967465794048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.013773:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680380 with x1830967465794048 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.013780:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680380 00000100:00100000:3.0:1746147256.013821:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7461 00000100:00100000:3.0:1746147256.013829:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465794048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.018187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.018303:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794176 00000100:00100000:1.0:1746147256.018314:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794176 00000100:00100000:1.0:1746147256.018374:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15731 00000100:00100000:1.0:1746147256.018381:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31929:x1830967465794176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.018398:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.018415:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecde8 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.018443:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.018450:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147256.018452:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147256.018456:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.018493:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.018509:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 11 pid: 8478 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.018521:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065600:192.168.203.36@tcp:104: 00000100:00080000:2.0:1746147256.018969:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147256.019575:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.020041:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465794048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6211us (6499us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147256.020052:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7461 00002000:00100000:3.0:1746147256.020062:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e680380 x1830967465794048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.020071:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680380 with x1830967465794048 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.020075:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680380 00000100:00100000:2.0:1746147256.022088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.022140:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794304 00000100:00100000:3.0:1746147256.022149:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794304 00002000:00100000:3.0:1746147256.022189:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1925119) req@ffff88009ee5f100 x1830967465794304/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.022198:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967465794304 ext(1048576->1925119) 00010000:00010000:3.0:1746147256.022208:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 10 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.022220:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 10 pid: 8478 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.022226:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee5f100 00000100:00100000:3.0:1746147256.022253:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2561 00000100:00100000:3.0:1746147256.022259:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465794304:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147256.023073:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065600:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.023100:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.023126:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854c00, rc 0) 00000100:00100000:1.0:1746147256.023151:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:31929:x1830967465794176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4771us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.023158:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15731 00000100:00100000:2.0:1746147256.026232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.026857:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794432 00000100:00100000:1.0:1746147256.026867:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794432 00000100:00100000:1.0:1746147256.026921:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15732 00000100:00100000:1.0:1746147256.026929:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465794432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.026982:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.027004:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093855800/0xb4b2209fbdad158b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdef expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.027060:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065728:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147256.027141:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.032985:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065728:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147256.033022:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093855800/0xb4b2209fbdad158b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdef expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.033036:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093855800/0xb4b2209fbdad158b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdef expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.033066:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855800, rc 0) 00000100:00100000:1.0:1746147256.033130:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465794432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6200us (6906us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147256.033139:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15732 00000100:00100000:3.0:1746147256.036462:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465794304:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14193us (14372us total) trans 17179874048 rc 0/0 00000100:00100000:3.0:1746147256.036475:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2561 00002000:00100000:3.0:1746147256.036486:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1925119) req@ffff88009ee5f100 x1830967465794304/t17179874048(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.036494:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967465794304 ext(1048576->1925119) 00010000:00010000:3.0:1746147256.036505:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 12 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.036519:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 12 pid: 8478 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.036526:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee5f100 00000100:00100000:0.0:1746147256.037329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.037636:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794560 00000100:00100000:1.0:1746147256.037644:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794560 00000100:00100000:1.0:1746147256.037788:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15733 00000100:00100000:1.0:1746147256.037796:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465794560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.037813:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.037830:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad1592 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdf6 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.037884:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065856:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147256.037982:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.039359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.039477:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794688 00000100:00100000:3.0:1746147256.039483:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794688 00010000:00010000:3.0:1746147256.041074:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.041132:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8001 00000100:00100000:3.0:1746147256.041141:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465794688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.041157:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.041183:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.041195:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.041222:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.041224:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.041232:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.041239:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.041273:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.041284:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467065984:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.041382:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455180 going to sleep for 11 seconds 00010000:00010000:1.0:1746147256.042240:0:8480:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88012df78700 x1830967467065856) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.042258:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1800/0xb4b2209fbdad156f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdd3 expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.042277:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467065856:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147256.042301:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad1592 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdf6 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.042310:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093855c00/0xb4b2209fbdad1592 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdf6 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.042317:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855c00, rc 0) 00000100:00100000:1.0:1746147256.042346:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465794560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4551us (5019us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147256.042353:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15733 00000100:00100000:3.0:1746147256.045231:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467065984:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.045256:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.045313:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465794688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4173us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.045323:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8001 00000100:00100000:0.0:1746147256.047875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.048001:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465794944 00000100:00100000:3.0:1746147256.048013:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465794944 00002000:00100000:3.0:1746147256.048070:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e681f80 x1830967465794944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.048080:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681f80 with x1830967465794944 ext(1048576->2097151) 00002000:00010000:3.0:1746147256.048086:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681f80 00000100:00100000:3.0:1746147256.049201:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7462 00000100:00100000:3.0:1746147256.049211:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465794944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.071741:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465794944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22517us (23860us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.071756:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7462 00002000:00100000:3.0:1746147256.071771:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e681f80 x1830967465794944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.071782:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681f80 with x1830967465794944 ext(1048576->2097151) 00002000:00010000:3.0:1746147256.071789:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681f80 00000100:00100000:0.0:1746147256.126405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.126505:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795072 00000100:00100000:1.0:1746147256.126515:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795072 00000100:00100000:1.0:1746147256.127347:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15734 00000100:00100000:1.0:1746147256.127356:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:31932:x1830967465795072:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147256.127373:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.127390:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecdfd expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.127419:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.127428:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 20 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.127440:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.127442:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.127446:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.127474:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 20 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.127486:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 20 pid: 21080 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.127498:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467066112:192.168.203.36@tcp:104: 00000100:00080000:2.0:1746147256.127601:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746147256.128655:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.128665:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 13 pid: 8478 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.128674:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467066240:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.128698:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.142680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.142754:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795200 00000100:00100000:3.0:1746147256.142762:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795200 00010000:00010000:3.0:1746147256.142796:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.144713:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467066112:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.144727:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467066240:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.144753:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.144769:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855400, rc 0) 00000100:00100000:0.0:1746147256.144789:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.145379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.145386:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795328 00000100:00100000:3.0:1746147256.145392:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795328 00000100:00100000:0.0:1746147256.145408:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795456 00000100:00100000:0.0:1746147256.145414:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795456 00010000:00010000:3.0:1746147256.145415:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 21 pid: 21080 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746147256.145439:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8002 00000100:00100000:3.0:1746147256.145446:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465795200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.145460:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147256.145460:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11481 00000100:00100000:0.0:1746147256.145466:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:31935:x1830967465795456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147256.145481:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746147256.145482:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.145491:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.145512:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b077400/0xb4b2209fbdad14a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd4e expref: 14 pid: 8478 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.145529:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.145555:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465795200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.145561:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8002 00000100:00100000:3.0:1746147256.145576:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8003 00000100:00100000:3.0:1746147256.145580:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967465795328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.145586:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.145593:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 21 pid: 21080 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.145601:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 21 pid: 21080 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.145617:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0800/0xb4b2209fbdad14c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd78 expref: 21 pid: 21080 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.145626:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.145628:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.145634:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.145642:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.145646:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad15a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece04 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.145670:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.145681:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467066368:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147256.145691:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.145700:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.145709:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.145725:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147256.145726:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455180 going to sleep for 11 seconds 00010000:00010000:0.0:1746147256.145729:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.145734:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00080000:3.0:1746147256.145756:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746147256.145815:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.145824:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 321 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.145830:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.145852:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 321 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.145862:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 321 pid: 23726 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746147256.145871:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467066496:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147256.145915:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.145958:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:31932:x1830967465795072:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 18603us (19561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.145964:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15734 00000100:00100000:0.0:1746147256.149454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.149680:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467066368:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147256.149694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147256.149697:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147256.149711:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467066496:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147256.149728:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465795328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4147us (4945us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147256.149733:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147256.149736:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8003 00000100:00100000:2.0:1746147256.149773:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795840 00000100:00100000:3.0:1746147256.149776:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795712 00000100:00100000:2.0:1746147256.149779:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795840 00000100:00100000:3.0:1746147256.149781:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795712 00010000:00010000:3.0:1746147256.149806:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 322 pid: 23726 timeout: 743 lvb_type: 0 00002000:00100000:2.0:1746147256.149815:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3117056->3121151) req@ffff88009edca300 x1830967465795840/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.149825:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830967465795840 ext(3117056->3121151) 00000100:00100000:3.0:1746147256.149829:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8004 00002000:00010000:2.0:1746147256.149829:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edca300 00000100:00100000:3.0:1746147256.149835:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+322:1957:x1830967465795712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.149845:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147256.149847:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7463 00010000:00010000:3.0:1746147256.149850:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 322 pid: 23726 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.149853:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967465795840:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147256.149859:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 322 pid: 23726 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.149876:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f65400/0xb4b2209fbdad14f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd94 expref: 322 pid: 23726 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.149905:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.149910:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.149919:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.149924:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.149972:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147256.149977:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.149984:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147256.149991:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1957:x1830967465795712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 156us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.149996:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8004 00000100:00080000:3.0:1746147256.150013:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1746147256.150023:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147256.150026:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147256.150041:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150051:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150060:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150066:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150071:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150076:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b1c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147256.150080:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150086:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150097:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147256.150101:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147256.150104:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150109:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad15a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150135:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150140:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150145:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150148:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009049c400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147256.150150:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150153:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150159:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880132f77a00) 00010000:00010000:2.0:1746147256.150161:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147256.150163:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150166:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009049c400/0xb4b2209fbdad15ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.150202:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad15a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.150217:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.150222:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147256.150224:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147256.150226:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009049d200, rc 0) 00000100:00100000:2.0:1746147256.150269:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:31935:x1830967465795456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4803us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.150276:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11481 00000100:00100000:2.0:1746147256.150343:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967465795840:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 490us (896us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147256.150348:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7463 00002000:00100000:2.0:1746147256.150353:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3117056->3121151) req@ffff88009edca300 x1830967465795840/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.150359:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830967465795840 ext(3117056->3121151) 00002000:00010000:2.0:1746147256.150362:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edca300 00000100:00100000:1.0:1746147256.156569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.156600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.157572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.157590:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465795968 00000100:00100000:1.0:1746147256.157599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.157602:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465795968 00000100:00100000:2.0:1746147256.157624:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796096 00000100:00100000:2.0:1746147256.157627:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796096 00000100:00100000:2.0:1746147256.157701:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796224 00000100:00100000:2.0:1746147256.157704:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796224 00000100:00100000:2.0:1746147256.157716:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796352 00000100:00100000:2.0:1746147256.157718:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796352 00000100:00100000:3.0:1746147256.157738:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15735 00000100:00100000:3.0:1746147256.157752:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465796096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147256.157770:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.157786:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece12 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.157806:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.157808:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.157815:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 8 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.157829:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 8 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.157838:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2600, rc 0) 00000100:00100000:3.0:1746147256.158238:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465796096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 489us (1635us total) trans 0 rc 0/0 00000100:00080000:0.0:1746147256.158252:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147256.158257:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147256.158313:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15736 00000100:00100000:2.0:1746147256.158322:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465796224:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147256.158337:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.158350:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece19 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.158369:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.158371:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.158378:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.158391:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.158400:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5c800, rc 0) 00000100:00100000:2.0:1746147256.158435:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465796224:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 115us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.158441:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15736 00000100:00100000:1.0:1746147256.158459:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15737 00000100:00100000:1.0:1746147256.158468:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465796352:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147256.158478:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147256.158483:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15738 00010000:00010000:1.0:1746147256.158486:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad15ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece20 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.158488:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465795968:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147256.158494:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.158502:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece0b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.158511:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.158513:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.158517:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147256.158520:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467066624:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.158526:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.158533:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5d600, rc 0) 00000100:00100000:2.0:1746147256.158555:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465795968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 67us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.158560:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15738 00000100:00100000:1.0:1746147256.158565:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.158884:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15735 00000100:00100000:1.0:1746147256.164660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.167387:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796480 00000100:00100000:0.0:1746147256.167397:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796480 00000100:00100000:0.0:1746147256.167452:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15739 00000100:00100000:0.0:1746147256.167459:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:31932:x1830967465796480:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147256.167474:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147256.167489:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece27 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.167790:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.167800:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 7 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.167808:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.167818:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147256.167820:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147256.167823:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->3776511] (req 3145728->3776511) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.167848:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.167859:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 10 pid: 11147 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746147256.167869:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467066752:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147256.167953:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 7 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.167960:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 7 pid: 4445 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746147256.167966:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467066880:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147256.167997:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.168008:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746147256.168014:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467067008:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147256.168027:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00002000:00010000:2.0:1746147256.169544:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147253 -> 1746147255 00000100:00100000:2.0:1746147256.169571:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467066624:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.169593:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad15ca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece20 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.169604:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093854000/0xb4b2209fbdad15ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece20 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.169628:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854000, rc 0) 00000100:00100000:2.0:1746147256.169714:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465796352:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 11246us (12112us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.169721:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15737 00000100:00100000:0.0:1746147256.175456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.175628:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467066752:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.175639:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467066880:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.175646:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467067008:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.175683:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796608 00000100:00100000:1.0:1746147256.175689:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796608 00010000:00010000:1.0:1746147256.175717:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 8 pid: 4445 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.175754:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8005 00000100:00100000:1.0:1746147256.175761:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465796608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.175772:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.175790:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 8 pid: 4445 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.175799:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 8 pid: 4445 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.175816:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5c800/0xb4b2209fbdad15c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece19 expref: 8 pid: 4445 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.175832:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.175865:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465796608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.175871:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8005 00010000:00010000:2.0:1746147256.175984:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->3776511] (req 3145728->3776511) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.175995:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009049ca00, rc 0) 00000100:00100000:2.0:1746147256.176016:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31932:x1830967465796480:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8559us (11364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.176022:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15739 00000100:00100000:3.0:1746147256.179012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.179054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.179072:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796992 00000100:00100000:2.0:1746147256.179076:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465796864 00000100:00100000:3.0:1746147256.179079:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796992 00000100:00100000:2.0:1746147256.179079:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465796864 00010000:00010000:3.0:1746147256.179107:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 11 pid: 11147 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746147256.179125:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11482 00000100:00100000:2.0:1746147256.179131:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:31935:x1830967465796864:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147256.179145:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147256.179154:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8006 00010000:00010000:2.0:1746147256.179158:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d800/0xb4b2209fbdad15df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece2e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.179160:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465796992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.179171:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.179188:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 11 pid: 11147 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.179198:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 11 pid: 11147 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.179212:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d98dc00/0xb4b2209fbdad1561 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdc5 expref: 11 pid: 11147 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746147256.179224:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.179225:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147256.179237:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.179243:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147256.179252:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465796992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.179256:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8006 00010000:00010000:2.0:1746147256.179268:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.179276:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 16 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.179285:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467067136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.179331:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.182756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.182983:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465797120 00000100:00100000:2.0:1746147256.182994:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465797120 00010000:00010000:2.0:1746147256.183033:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.183079:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8007 00000100:00100000:2.0:1746147256.183087:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465797120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147256.183101:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147256.183136:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.183147:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.183173:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1600/0xb4b2209fbdad14dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecd86 expref: 28 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.183202:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.183204:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.183212:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.183220:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.183256:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.183278:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467067264:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147256.184144:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.186669:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467067136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.186696:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147256.186807:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467067264:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.186820:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.186876:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465797120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3788us (4128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.186886:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8007 00000100:00100000:0.0:1746147256.187158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.187251:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465797504 00000100:00100000:3.0:1746147256.187260:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465797504 00010000:00010000:3.0:1746147256.187295:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.187316:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8008 00000100:00100000:3.0:1746147256.187323:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465797504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.187336:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.187341:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.187353:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.187375:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009049d200/0xb4b2209fbdad15b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece04 expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.187407:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.187412:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.187422:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.187429:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.187447:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147256.187605:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.187612:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147256.187632:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147256.187777:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d800/0xb4b2209fbdad15df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.187790:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.187796:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147256.187799:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147256.187801:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5cc00, rc 0) 00000100:00100000:3.0:1746147256.187898:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465797504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 575us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.187904:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8008 00000100:00100000:2.0:1746147256.188916:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31935:x1830967465796864:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9781us (9907us total) trans 8589945493 rc 0/0 00000100:00100000:2.0:1746147256.188924:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11482 00000100:00100000:0.0:1746147256.192672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.193184:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465797376 00000100:00100000:2.0:1746147256.193192:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465797376 00000100:00100000:2.0:1746147256.193254:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11483 00000100:00100000:2.0:1746147256.193260:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:31938:x1830967465797376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.193278:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.193293:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d400/0xb4b2209fbdad15f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece35 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.193377:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193388:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193397:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193407:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193412:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193416:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193495:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdad1609 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193503:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdad1609 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193508:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdad1609 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147256.193514:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00080000:1.0:1746147256.193571:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147256.193608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147256.193632:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193639:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193645:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193787:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c5d000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147256.193790:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193795:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193803:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147256.193806:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147256.193808:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193813:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d000/0xb4b2209fbdad15fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193823:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193826:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193830:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193833:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c5c800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147256.193835:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193839:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193847:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3a0b00) 00010000:00010000:2.0:1746147256.193849:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147256.193851:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193854:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c800/0xb4b2209fbdad1602 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.193885:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5d400/0xb4b2209fbdad15f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece35 expref: 33 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.193894:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdad1609 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece35 expref: 32 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.193899:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147256.193901:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147256.193903:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5c400, rc 0) 00000100:00100000:2.0:1746147256.193957:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31938:x1830967465797376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 698us (1292us total) trans 8589945494 rc 0/0 00000100:00100000:2.0:1746147256.193963:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11483 00000100:00100000:2.0:1746147256.194255:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465797632 00000100:00100000:2.0:1746147256.194259:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465797632 00000100:00100000:2.0:1746147256.194290:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11484 00000100:00100000:2.0:1746147256.194295:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31935:x1830967465797632:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147256.194303:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.194310:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad1617 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece3c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.194355:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.194363:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.194368:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147256.194390:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.194400:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.194410:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467067392:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.194497:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.197624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.197668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.197706:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465797760 00000100:00100000:3.0:1746147256.197714:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465797760 00000100:00100000:2.0:1746147256.197745:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465798016 00000100:00100000:2.0:1746147256.197749:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465798016 00000100:00100000:3.0:1746147256.197752:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 785 00000100:00100000:3.0:1746147256.197758:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465797760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.197770:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147256.197774:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4806 00000100:00100000:2.0:1746147256.197778:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+33:31938:x1830967465798016:12345-192.168.203.36@tcp:35:cat.0 00010000:00010000:3.0:1746147256.197788:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdad1609 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece35 expref: 33 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.197810:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.197814:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.197820:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.197823:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.197828:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.197874:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465797760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.197880:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 785 00000100:00100000:2.0:1746147256.197913:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31938:x1830967465798016:12345-192.168.203.36@tcp:35:cat.0 Request processed in 134us (244us total) trans 8589945495 rc 0/0 00000100:00100000:2.0:1746147256.197919:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4806 00000100:00100000:0.0:1746147256.200497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.200618:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465798272 00000100:00100000:2.0:1746147256.200624:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465798272 00002000:00100000:2.0:1746147256.200657:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3772416->3776511) req@ffff88009edc9180 x1830967465798272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.200665:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830967465798272 ext(3772416->3776511) 00002000:00010000:2.0:1746147256.200670:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:2.0:1746147256.200688:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7464 00000100:00100000:2.0:1746147256.200694:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465798272:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147256.200842:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465798272:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 147us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147256.200847:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7464 00002000:00100000:2.0:1746147256.200853:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3772416->3776511) req@ffff88009edc9180 x1830967465798272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.200859:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830967465798272 ext(3772416->3776511) 00000100:00100000:3.0:1746147256.200980:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467067392:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.201000:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147256.201611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147256.201957:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:0.0:1746147256.204722:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465798400 00000100:00100000:0.0:1746147256.204732:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465798400 00010000:00010000:0.0:1746147256.204760:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 18 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746147256.204796:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8009 00000100:00100000:0.0:1746147256.204802:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465798400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147256.204812:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147256.204817:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 18 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746147256.204827:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 18 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746147256.204849:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdad15e6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece2e expref: 18 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746147256.204869:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147256.204872:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.204880:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.204885:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147256.204901:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147256.204951:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465798400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 135us (3327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147256.204956:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8009 00000100:00100000:1.0:1746147256.205100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.205161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.205175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.205188:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465798528 00000100:00100000:1.0:1746147256.205190:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465798528 00000100:00100000:1.0:1746147256.205209:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465798784 00000100:00100000:1.0:1746147256.205211:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465798784 00000100:00100000:1.0:1746147256.205219:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465798656 00000100:00100000:1.0:1746147256.205220:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465798656 00000100:00100000:1.0:1746147256.205229:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15740 00000100:00100000:1.0:1746147256.205234:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465798528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.205244:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.205255:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece43 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.205269:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.205271:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.205277:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.205287:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.205299:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854200, rc 0) 00000100:00100000:1.0:1746147256.205319:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465798528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.205324:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15740 00000100:00100000:1.0:1746147256.205336:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15741 00000100:00100000:1.0:1746147256.205340:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465798784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.205346:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.205353:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093855600/0xb4b2209fbdad162c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece51 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.205380:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467067520:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147256.205426:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.205462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.205532:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465799040 00000100:00100000:2.0:1746147256.205535:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465799040 00000100:00100000:2.0:1746147256.205553:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4807 00000100:00100000:2.0:1746147256.205557:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+321:31932:x1830967465799040:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147256.205724:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+322:31932:x1830967465799040:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 165us (260us total) trans 8589945496 rc 0/0 00000100:00100000:2.0:1746147256.205729:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4807 00000100:00100000:2.0:1746147256.205749:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15742 00000100:00100000:2.0:1746147256.205754:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465798656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.205760:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.205766:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4840e00/0xb4b2209fbdad1633 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece4a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.205788:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467067648:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.205806:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147256.207007:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207016:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147256.207042:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147256.207046:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147256.207056:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207081:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad1617 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.207095:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.207101:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.207104:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147256.207107:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b0e00, rc 0) 00000100:00100000:3.0:1746147256.207152:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31935:x1830967465797632:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 12855us (13543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.207158:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11484 00000100:00100000:2.0:1746147256.207633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.207692:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465799296 00000100:00100000:3.0:1746147256.207697:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465799296 00000100:00100000:3.0:1746147256.207731:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11485 00000100:00100000:3.0:1746147256.207737:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:31940:x1830967465799296:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147256.207750:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.207759:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2000/0xb4b2209fbdad163a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece58 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.207826:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207836:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207844:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207854:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207863:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207868:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207960:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207968:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.207974:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147256.207982:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147256.208039:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208112:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208126:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208131:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b1c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147256.208134:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208139:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208147:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147256.208150:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147256.208153:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208157:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad1641 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208166:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208170:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208175:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208179:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b0a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147256.208181:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208185:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208190:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473200) 00010000:00010000:3.0:1746147256.208192:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147256.208193:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208197:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdad1648 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.208222:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2000/0xb4b2209fbdad163a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 35 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.208234:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.208240:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.208242:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147256.208243:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e3a00, rc 0) 00000100:00100000:3.0:1746147256.209749:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+34:31940:x1830967465799296:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2008us (2111us total) trans 8589945497 rc 0/0 00000100:00100000:3.0:1746147256.209757:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11485 00000100:00100000:1.0:1746147256.210668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.210709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147256.210778:0:4444:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147255 -> 1746147256 00002000:00010000:2.0:1746147256.210781:0:4444:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147255 -> 1746147256 00000100:00100000:2.0:1746147256.210800:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467067520:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.210823:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093855600/0xb4b2209fbdad162c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece51 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.210835:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093855600/0xb4b2209fbdad162c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece51 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.210844:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093855600, rc 0) 00000100:00100000:2.0:1746147256.210876:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465798784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5535us (5714us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.210883:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15741 00000100:00100000:2.0:1746147256.210898:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465799424 00000100:00100000:2.0:1746147256.210904:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465799424 00000100:00100000:2.0:1746147256.210922:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465799552 00000100:00100000:2.0:1746147256.210923:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465799552 00000100:00100000:2.0:1746147256.210951:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15743 00000100:00100000:2.0:1746147256.210958:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465799424:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147256.210968:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.210979:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4840400/0xb4b2209fbdad165d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece5f expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.211018:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467067776:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.211060:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.211075:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15744 00000100:00100000:2.0:1746147256.211079:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465799552:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147256.211086:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.211092:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece66 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.211125:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467067904:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.211144:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746147256.211257:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147255 -> 1746147256 00002000:00010000:3.0:1746147256.211260:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147255 -> 1746147256 00000100:00100000:3.0:1746147256.211272:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467067648:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147256.211288:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4840e00/0xb4b2209fbdad1633 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece4a expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.211297:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4840e00/0xb4b2209fbdad1633 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece4a expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.211304:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4840e00, rc 0) 00000100:00100000:3.0:1746147256.211323:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465798656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5569us (6147us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147256.211328:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15742 00000100:00100000:3.0:1746147256.214203:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467067904:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147256.214229:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1664 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece66 expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.214241:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1664 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece66 expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.214249:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f0aa00, rc 0) 00000100:00100000:3.0:1746147256.214294:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465799552:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3214us (3584us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147256.214301:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15744 00000100:00100000:2.0:1746147256.214438:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467067776:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.214453:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4840400/0xb4b2209fbdad165d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece5f expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.214461:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4840400/0xb4b2209fbdad165d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece5f expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.214469:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4840400, rc 0) 00000100:00100000:2.0:1746147256.216816:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465799424:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5850us (6142us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.216824:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15743 00000100:00100000:0.0:1746147256.221376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.223354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.224860:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800064 00000100:00100000:3.0:1746147256.224869:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800064 00000100:00100000:3.0:1746147256.224915:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11486 00000100:00100000:3.0:1746147256.224921:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31935:x1830967465800064:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147256.224951:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.224966:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad166b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece6d expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.225032:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225044:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225053:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225062:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225068:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225075:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225080:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4841a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147256.225083:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225088:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225096:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.225099:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147256.225102:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225106:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4841a00/0xb4b2209fbdad1672 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147256.225139:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad166b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece6d expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.225146:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad166b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece6d expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.225152:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e3200, rc 0) 00000100:00100000:3.0:1746147256.225190:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31935:x1830967465800064:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 270us (1848us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147256.225196:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11486 00000100:00100000:3.0:1746147256.225214:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465799808 00000100:00100000:3.0:1746147256.225217:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465799808 00002000:00100000:3.0:1746147256.225236:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009edc9f80 x1830967465799808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.225245:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9f80 with x1830967465799808 ext(1048576->2097151) 00002000:00010000:3.0:1746147256.225248:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9f80 00000100:00100000:3.0:1746147256.225258:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7465 00000100:00100000:3.0:1746147256.225263:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465799808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.239175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.239251:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800320 00000100:00100000:2.0:1746147256.239259:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800320 00000100:00100000:2.0:1746147256.239291:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4808 00000100:00100000:2.0:1746147256.239297:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31935:x1830967465800320:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147256.239639:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31935:x1830967465800320:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 340us (470us total) trans 8589945498 rc 0/0 00000100:00100000:2.0:1746147256.239646:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4808 00000100:00100000:3.0:1746147256.241681:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465799808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16413us (20310us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.241690:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7465 00002000:00100000:3.0:1746147256.241699:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009edc9f80 x1830967465799808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.241707:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9f80 with x1830967465799808 ext(1048576->2097151) 00002000:00010000:3.0:1746147256.241712:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9f80 00000100:00100000:0.0:1746147256.255221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.255263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.255349:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800448 00000100:00100000:3.0:1746147256.255356:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800448 00000100:00100000:3.0:1746147256.255387:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800576 00000100:00100000:3.0:1746147256.255389:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800576 00000100:00100000:3.0:1746147256.255403:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15745 00000100:00100000:3.0:1746147256.255409:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465800448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147256.255423:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.255441:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4840e00/0xb4b2209fbdad1679 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece74 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.255486:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467068032:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.255596:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15746 00000100:00100000:2.0:1746147256.255602:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465800576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.255609:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.255617:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d445400/0xb4b2209fbdad1680 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece7b expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.255636:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467068160:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147256.256257:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.256302:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.256436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.256590:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800704 00000100:00100000:2.0:1746147256.256593:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800704 00000100:00100000:2.0:1746147256.256618:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15747 00000100:00100000:2.0:1746147256.256623:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31940:x1830967465800704:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147256.256630:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.256639:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece82 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.256653:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.256659:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.256661:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.256664:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2195456->2756607] (req 2195456->2756607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.256682:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.256692:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 26 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.256700:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467068288:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.256719:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.257827:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467068032:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147256.257847:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4840e00/0xb4b2209fbdad1679 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece74 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147256.257851:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467068288:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.257856:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4840e00/0xb4b2209fbdad1679 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece74 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.257862:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2195456->2756607] (req 2195456->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.257867:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4840e00, rc 0) 00010000:00010000:0.0:1746147256.257869:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f0aa00, rc 0) 00000100:00100000:2.0:1746147256.257927:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467068160:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.257958:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d445400/0xb4b2209fbdad1680 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece7b expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.257965:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d445400/0xb4b2209fbdad1680 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece7b expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.257984:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d445400, rc 0) 00000100:00100000:0.0:1746147256.258164:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31940:x1830967465800704:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1538us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147256.258171:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15747 00000100:00100000:3.0:1746147256.258258:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465800448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2848us (3041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147256.258263:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15745 00000100:00100000:2.0:1746147256.258294:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465800576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2687us (3026us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.258299:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15746 00000100:00100000:0.0:1746147256.259871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.259958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.260019:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800960 00000100:00100000:2.0:1746147256.260024:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800960 00000100:00100000:2.0:1746147256.260060:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15748 00000100:00100000:2.0:1746147256.260065:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31938:x1830967465800960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.260076:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.260088:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece89 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.260105:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.260108:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2195456->2756607] (req 2195456->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.260125:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147256.260129:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.260153:0:11147:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2195456->2756607] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.260163:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.260170:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f0a200, rc 0) 00000100:00100000:2.0:1746147256.260206:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31938:x1830967465800960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 141us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.260211:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15748 00000100:00100000:3.0:1746147256.260310:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465800832 00000100:00100000:3.0:1746147256.260314:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465800832 00002000:00100000:3.0:1746147256.260337:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3776511) req@ffff88009edc9c00 x1830967465800832/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.260345:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830967465800832 ext(3145728->3776511) 00010000:00010000:3.0:1746147256.260350:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 27 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.260360:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 27 pid: 11147 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.260366:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc9c00 00000100:00100000:3.0:1746147256.260387:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2562 00000100:00100000:3.0:1746147256.260392:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465800832:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147256.268521:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465800832:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8121us (8646us total) trans 17179874049 rc 0/0 00000100:00100000:3.0:1746147256.268531:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2562 00002000:00100000:3.0:1746147256.268540:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3776511) req@ffff88009edc9c00 x1830967465800832/t17179874049(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.268548:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830967465800832 ext(3145728->3776511) 00010000:00010000:3.0:1746147256.268556:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.268568:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.268574:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc9c00 00000100:00100000:0.0:1746147256.271796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.271927:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465801088 00000100:00100000:3.0:1746147256.272466:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465801088 00010000:00010000:3.0:1746147256.272512:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.272554:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8010 00000100:00100000:3.0:1746147256.272562:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465801088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.272578:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.272600:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.272612:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.272639:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009049ca00/0xb4b2209fbdad15d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3776511) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece27 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.272658:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.272661:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.272668:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.272677:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.272710:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.272721:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 12 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.272732:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467068544:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.272814:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.276001:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467068544:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.276018:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.276052:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465801088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3490us (4264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.276060:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8010 00000100:00100000:0.0:1746147256.277402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.277593:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465801344 00000100:00100000:3.0:1746147256.277599:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465801344 00002000:00100000:3.0:1746147256.277629:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2195456->2199551) req@ffff88009edca680 x1830967465801344/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.277638:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca680 with x1830967465801344 ext(2195456->2199551) 00010000:00010000:3.0:1746147256.277644:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.277655:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.277661:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edca680 00000100:00100000:3.0:1746147256.277844:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2563 00000100:00100000:3.0:1746147256.277851:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465801344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.278033:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465801344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 182us (632us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.278039:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2563 00002000:00100000:3.0:1746147256.278044:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2195456->2199551) req@ffff88009edca680 x1830967465801344/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.278050:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca680 with x1830967465801344 ext(2195456->2199551) 00010000:00010000:3.0:1746147256.278055:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.278165:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.278170:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edca680 00000100:00100000:0.0:1746147256.284462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.284664:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465801600 00000100:00100000:3.0:1746147256.284675:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465801600 00002000:00100000:3.0:1746147256.284714:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2752512->2756607) req@ffff88009edc9880 x1830967465801600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.284723:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830967465801600 ext(2752512->2756607) 00010000:00010000:3.0:1746147256.284731:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.284745:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.284752:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc9880 00000100:00100000:3.0:1746147256.284793:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2564 00000100:00100000:3.0:1746147256.284801:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465801600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.284978:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465801600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 177us (527us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.284984:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2564 00002000:00100000:3.0:1746147256.284989:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2752512->2756607) req@ffff88009edc9880 x1830967465801600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.284996:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830967465801600 ext(2752512->2756607) 00010000:00010000:3.0:1746147256.285001:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.285009:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.285019:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc9880 00000100:00100000:0.0:1746147256.290054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.290094:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465801856 00000100:00100000:2.0:1746147256.290100:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465801856 00000100:00100000:0.0:1746147256.290124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.290158:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465802112 00000100:00100000:3.0:1746147256.290161:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465802112 00000100:00100000:3.0:1746147256.290194:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4809 00000100:00100000:3.0:1746147256.290201:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+34:31940:x1830967465802112:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147256.290378:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+35:31940:x1830967465802112:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 176us (261us total) trans 8589945499 rc 0/0 00000100:00100000:3.0:1746147256.290385:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4809 00002000:00100000:2.0:1746147256.290478:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2195456->2756607) req@ffff88008e5ca300 x1830967465801856/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.290486:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5ca300 with x1830967465801856 ext(2195456->2756607) 00010000:00010000:2.0:1746147256.290494:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.290510:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 13 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746147256.290516:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e5ca300 00000100:00100000:2.0:1746147256.291271:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2565 00000100:00100000:2.0:1746147256.291283:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465801856:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147256.300417:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465801856:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9126us (10358us total) trans 17179874050 rc 0/0 00000100:00100000:3.0:1746147256.300431:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2565 00002000:00100000:3.0:1746147256.300444:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2195456->2756607) req@ffff88008e5ca300 x1830967465801856/t17179874050(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.300454:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5ca300 with x1830967465801856 ext(2195456->2756607) 00010000:00010000:3.0:1746147256.300492:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 15 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.300510:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 15 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.300517:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e5ca300 00000100:00100000:1.0:1746147256.303626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.304303:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465802240 00000100:00100000:3.0:1746147256.304311:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465802240 00010000:00010000:3.0:1746147256.304351:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 15 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.304384:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8011 00000100:00100000:3.0:1746147256.304391:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465802240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.304403:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.304420:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 15 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.304430:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 15 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.304448:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f0aa00/0xb4b2209fbdad1687 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2756607) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece82 expref: 15 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.304476:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.304478:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.304484:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.304492:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.304517:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.304527:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467068672:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.304604:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.308023:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467068672:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.308042:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.308079:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465802240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3687us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.308087:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8011 00000100:00100000:0.0:1746147256.308835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.308970:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465802496 00000100:00100000:3.0:1746147256.308974:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465802496 00002000:00100000:3.0:1746147256.309133:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e5cbb80 x1830967465802496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.309141:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cbb80 with x1830967465802496 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.309145:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cbb80 00000100:00100000:3.0:1746147256.309171:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7466 00000100:00100000:3.0:1746147256.309178:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465802496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.314896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.314974:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465802624 00000100:00100000:2.0:1746147256.314981:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465802624 00000100:00100000:2.0:1746147256.315032:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15749 00000100:00100000:2.0:1746147256.315039:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465802624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.315054:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.315069:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece90 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.315087:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.315089:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.315096:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.315109:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.315133:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d63b800, rc 0) 00000100:00100000:2.0:1746147256.315181:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465802624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.315190:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15749 00000100:00100000:3.0:1746147256.318070:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465802496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8885us (9229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.318079:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7466 00002000:00100000:3.0:1746147256.318087:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e5cbb80 x1830967465802496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.318095:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cbb80 with x1830967465802496 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.318542:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cbb80 00000100:00100000:0.0:1746147256.325823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.326864:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465802752 00000100:00100000:2.0:1746147256.326872:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465802752 00000100:00100000:2.0:1746147256.326911:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15750 00000100:00100000:2.0:1746147256.326916:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31938:x1830967465802752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.326928:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.326950:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece97 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.326968:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.326973:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.326974:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.326979:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.326997:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.327004:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 18 pid: 8480 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.327012:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467068800:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.327104:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.332767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.332981:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467068800:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.333007:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.333021:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d63a200, rc 0) 00000100:00100000:2.0:1746147256.333068:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31938:x1830967465802752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6150us (7251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.333075:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15750 00000100:00100000:3.0:1746147256.333487:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465802880 00000100:00100000:3.0:1746147256.333493:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465802880 00002000:00100000:3.0:1746147256.333522:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3117056->3145727) req@ffff88008e5cb100 x1830967465802880/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.333529:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb100 with x1830967465802880 ext(3117056->3145727) 00010000:00010000:3.0:1746147256.333536:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 19 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.333546:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 19 pid: 8480 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.333552:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5cb100 00000100:00100000:3.0:1746147256.333575:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2566 00000100:00100000:3.0:1746147256.333580:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967465802880:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147256.335246:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.335794:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465803136 00000100:00100000:2.0:1746147256.335800:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465803136 00002000:00100000:2.0:1746147256.335822:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e5cad80 x1830967465803136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.335831:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cad80 with x1830967465803136 ext(2097152->3145727) 00002000:00010000:2.0:1746147256.335834:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cad80 00000100:00100000:2.0:1746147256.335925:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7467 00000100:00100000:2.0:1746147256.335931:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465803136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.336486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.336499:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.336511:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465803648 00000100:00100000:0.0:1746147256.336513:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465803648 00002000:00100000:0.0:1746147256.336527:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3174400->4194303) req@ffff88008e5c8380 x1830967465803648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.336535:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8380 with x1830967465803648 ext(3174400->4194303) 00010000:00010000:0.0:1746147256.336541:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 21 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746147256.336553:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 21 pid: 8480 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746147256.336563:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8380 00000100:00100000:0.0:1746147256.336570:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465803520 00000100:00100000:0.0:1746147256.336572:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465803520 00002000:00100000:0.0:1746147256.336579:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3174399) req@ffff88008e5c8e00 x1830967465803520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 504/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.336585:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967465803520 ext(2097152->3174399) 00010000:00010000:0.0:1746147256.336588:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 22 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746147256.336594:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 22 pid: 8480 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746147256.336598:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8e00 00000100:00100000:0.0:1746147256.336611:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2567 00000100:00100000:0.0:1746147256.336615:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967465803648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.336722:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2568 00000100:00100000:3.0:1746147256.336729:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967465803520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.337797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.337854:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465803904 00000100:00100000:1.0:1746147256.337859:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465803904 00002000:00100000:1.0:1746147256.337877:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e5cb480 x1830967465803904/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147256.337889:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb480 with x1830967465803904 ext(3145728->4194303) 00002000:00010000:1.0:1746147256.337893:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cb480 00000100:00100000:1.0:1746147256.337904:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7468 00000100:00100000:1.0:1746147256.337910:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465803904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147256.341793:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465802880:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8206us (9026us total) trans 21474841402 rc 0/0 00000100:00100000:2.0:1746147256.341804:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2566 00002000:00100000:2.0:1746147256.341814:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3117056->3145727) req@ffff88008e5cb100 x1830967465802880/t21474841402(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.341823:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb100 with x1830967465802880 ext(3117056->3145727) 00010000:00010000:2.0:1746147256.341835:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 24 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.341848:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 24 pid: 8480 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746147256.341857:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5cb100 00000100:00100000:1.0:1746147256.354525:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465803648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17893us (18024us total) trans 0 rc 1019904/1019904 00000100:00100000:1.0:1746147256.354539:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2567 00002000:00100000:1.0:1746147256.354556:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3174400->4194303) req@ffff88008e5c8380 x1830967465803648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147256.354567:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8380 with x1830967465803648 ext(3174400->4194303) 00010000:00010000:1.0:1746147256.354578:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 23 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.354595:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 23 pid: 8480 timeout: 743 lvb_type: 0 00002000:00010000:1.0:1746147256.354602:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8380 00000100:00100000:2.0:1746147256.361175:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465803904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23255us (23374us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147256.361187:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7468 00002000:00100000:2.0:1746147256.361198:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e5cb480 x1830967465803904/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.361212:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb480 with x1830967465803904 ext(3145728->4194303) 00002000:00010000:2.0:1746147256.361217:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cb480 00000100:00100000:2.0:1746147256.366545:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465803136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30604us (31293us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147256.366557:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7467 00002000:00100000:2.0:1746147256.366566:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e5cad80 x1830967465803136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.366575:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cad80 with x1830967465803136 ext(2097152->3145727) 00002000:00010000:2.0:1746147256.366580:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cad80 00000100:00100000:3.0:1746147256.372874:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967465803520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 36137us (36365us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.372887:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2568 00002000:00100000:3.0:1746147256.372896:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3174399) req@ffff88008e5c8e00 x1830967465803520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 504/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.372904:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967465803520 ext(2097152->3174399) 00010000:00010000:3.0:1746147256.372913:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 21 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.372925:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 21 pid: 8480 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.372932:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8e00 00000100:00100000:0.0:1746147256.374429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.375293:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465804160 00000100:00100000:3.0:1746147256.375299:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465804160 00002000:00100000:3.0:1746147256.375332:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88008e5c8700 x1830967465804160/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.375340:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8700 with x1830967465804160 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.375345:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8700 00000100:00100000:3.0:1746147256.375497:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7469 00000100:00100000:3.0:1746147256.375505:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465804160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.376321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.378108:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465804288 00000100:00100000:2.0:1746147256.378127:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465804288 00000100:00100000:2.0:1746147256.378164:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15751 00000100:00100000:2.0:1746147256.378171:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:31946:x1830967465804288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.378184:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.378198:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ece9e expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.378224:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.378229:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.378239:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.378247:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d63aa00, rc 0) 00000100:00100000:2.0:1746147256.378291:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:31946:x1830967465804288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 119us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.378296:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15751 00000100:00100000:0.0:1746147256.383880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.384208:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465804416 00000100:00100000:3.0:1746147256.384220:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465804416 00010000:00010000:3.0:1746147256.384265:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 22 pid: 8480 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.384313:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8012 00000100:00100000:3.0:1746147256.384321:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465804416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.384337:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.384360:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 22 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.384398:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 22 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.384511:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093855400/0xb4b2209fbdad1599 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdfd expref: 22 pid: 8480 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.384637:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.384639:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.384651:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.385295:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.385305:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.385306:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.385311:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 21 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.385317:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 21 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.385352:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 21 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.385367:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467068928:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.385476:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.385484:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467069056:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.385503:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934556c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.385912:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465804160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10402us (11481us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147256.385921:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7469 00002000:00100000:2.0:1746147256.385931:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88008e5c8700 x1830967465804160/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.385952:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8700 with x1830967465804160 ext(4194304->4976639) 00002000:00010000:2.0:1746147256.385957:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8700 00000100:00100000:3.0:1746147256.392697:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467068928:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.392706:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467069056:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.392721:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.392755:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465804416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8434us (8881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.392763:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8012 00000100:00100000:0.0:1746147256.393376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.393410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.393458:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465804672 00000100:00100000:3.0:1746147256.393464:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465804672 00002000:00100000:3.0:1746147256.393495:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e5ca680 x1830967465804672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.393502:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5ca680 with x1830967465804672 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.393506:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5ca680 00000100:00100000:3.0:1746147256.393517:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465804928 00000100:00100000:3.0:1746147256.393519:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465804928 00002000:00100000:3.0:1746147256.393527:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e5caa00 x1830967465804928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.393532:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5caa00 with x1830967465804928 ext(3145728->4194303) 00002000:00010000:3.0:1746147256.393534:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5caa00 00000100:00100000:3.0:1746147256.394737:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7470 00000100:00100000:3.0:1746147256.394745:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465804672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.395011:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7471 00000100:00100000:0.0:1746147256.395017:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465804928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.397979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.398804:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465805440 00000100:00100000:1.0:1746147256.398811:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465805440 00002000:00100000:1.0:1746147256.398843:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e5c8a80 x1830967465805440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147256.398853:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8a80 with x1830967465805440 ext(3145728->4194303) 00002000:00010000:1.0:1746147256.398857:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8a80 00000100:00100000:1.0:1746147256.398891:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7472 00000100:00100000:1.0:1746147256.398898:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465805440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.401307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.401342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.401385:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465805312 00000100:00100000:3.0:1746147256.401392:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465805312 00002000:00100000:3.0:1746147256.401421:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009fb70e00 x1830967465805312/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.401428:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70e00 with x1830967465805312 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.401432:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb70e00 00000100:00100000:3.0:1746147256.401444:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465805568 00000100:00100000:3.0:1746147256.401446:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465805568 00002000:00100000:3.0:1746147256.401453:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009fb71f80 x1830967465805568/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.401460:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71f80 with x1830967465805568 ext(3145728->4194303) 00002000:00010000:3.0:1746147256.401462:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb71f80 00000100:00100000:3.0:1746147256.401475:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7473 00000100:00100000:3.0:1746147256.401480:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465805312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.404488:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7474 00000100:00100000:0.0:1746147256.404500:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465805568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.410426:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465804672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15673us (17042us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.410436:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7470 00002000:00100000:3.0:1746147256.410445:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e5ca680 x1830967465804672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.410453:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5ca680 with x1830967465804672 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.410458:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5ca680 00000100:00100000:1.0:1746147256.415463:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465804928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20438us (22044us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147256.415476:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7471 00002000:00100000:1.0:1746147256.415486:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e5caa00 x1830967465804928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147256.415494:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5caa00 with x1830967465804928 ext(3145728->4194303) 00002000:00010000:1.0:1746147256.415499:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5caa00 00000100:00100000:3.0:1746147256.430399:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465805312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28910us (29089us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.430409:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7473 00002000:00100000:3.0:1746147256.430418:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009fb70e00 x1830967465805312/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.430427:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70e00 with x1830967465805312 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.430432:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb70e00 00000100:00100000:0.0:1746147256.435171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.435543:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465805440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 36645us (37569us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147256.435553:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7472 00002000:00100000:0.0:1746147256.435562:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e5c8a80 x1830967465805440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.435570:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8a80 with x1830967465805440 ext(3145728->4194303) 00002000:00010000:0.0:1746147256.435574:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8a80 00000100:00100000:1.0:1746147256.435698:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465805952 00000100:00100000:1.0:1746147256.435707:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465805952 00000100:00100000:1.0:1746147256.435749:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11487 00000100:00100000:1.0:1746147256.435755:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+322:31948:x1830967465805952:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147256.435771:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.435789:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799200/0xb4b2209fbdad16aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecea5 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.435868:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147256.435880:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.435887:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.435894:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147256.435915:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.435929:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 34 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.435955:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467069184:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.436037:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.436045:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 16 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.436052:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467069312:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.436071:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.440173:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467069184:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.440184:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467069312:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.440201:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147256.440333:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465805568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 35834us (38987us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147256.440341:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7474 00002000:00100000:2.0:1746147256.440351:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009fb71f80 x1830967465805568/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.440359:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71f80 with x1830967465805568 ext(3145728->4194303) 00002000:00010000:2.0:1746147256.440363:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb71f80 00000100:00100000:0.0:1746147256.441805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.441846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.441923:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806208 00000100:00100000:3.0:1746147256.441929:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806208 00010000:00010000:3.0:1746147256.441976:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.442012:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806080 00000100:00100000:3.0:1746147256.442015:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806080 00010000:00010000:3.0:1746147256.442024:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 35 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.442037:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8013 00000100:00100000:3.0:1746147256.442042:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465806208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.442052:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.442056:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.442064:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.442080:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdad161e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece3c expref: 17 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.442097:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8014 00010000:00010000:3.0:1746147256.442098:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.442102:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147256.442104:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1957:x1830967465806080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147256.442110:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147256.442120:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147256.442126:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 35 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.442127:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147256.442135:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 35 pid: 14049 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.442147:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad164f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece58 expref: 35 pid: 14049 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.442153:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1957:x1830967465806208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.442158:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8013 00010000:00010000:2.0:1746147256.442160:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147256.442163:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147256.442169:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147256.442175:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147256.442190:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147256.442202:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147256.442207:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147256.442207:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465806080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.442213:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8014 00000004:00200000:3.0:1746147256.442220:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147256.442322:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799200/0xb4b2209fbdad16aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 325 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.442333:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 324 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.442338:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.442340:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147256.442342:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e799c00, rc 0) 00000100:00100000:3.0:1746147256.442363:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+324:31948:x1830967465805952:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6608us (7199us total) trans 8589945500 rc 0/0 00000100:00100000:3.0:1746147256.442368:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11487 00000100:00100000:0.0:1746147256.447408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.447447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.447500:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806464 00000100:00100000:2.0:1746147256.447507:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806464 00002000:00100000:2.0:1746147256.447541:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009fb73480 x1830967465806464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147256.447542:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806592 00000100:00100000:1.0:1746147256.447546:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806592 00002000:00100000:2.0:1746147256.447550:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb73480 with x1830967465806464 ext(4194304->4976639) 00002000:00010000:2.0:1746147256.447554:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb73480 00000100:00100000:2.0:1746147256.447571:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7475 00000100:00100000:2.0:1746147256.447576:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465806464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147256.447581:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15752 00000100:00100000:1.0:1746147256.447586:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31948:x1830967465806592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147256.447595:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.447607:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eceac expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.447723:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.447731:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 6 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.447737:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 30 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.447742:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.447743:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.447746:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [708608->823295] (req 708608->823295) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 30 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.447772:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 30 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.447783:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 30 pid: 4444 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.447793:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069440:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.447870:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 6 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.447878:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 6 pid: 17548 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.447889:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069568:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.447913:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.447920:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 14 pid: 6881 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.447927:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069696:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.447969:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.450808:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069440:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.452961:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069568:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.454536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.454552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.454573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.454598:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806848 00000100:00100000:1.0:1746147256.454604:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806848 00010000:00010000:1.0:1746147256.454632:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 31 pid: 4444 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.454652:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806720 00000100:00100000:1.0:1746147256.454654:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806720 00010000:00010000:1.0:1746147256.454663:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 7 pid: 17548 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.454673:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465806976 00000100:00100000:1.0:1746147256.454674:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465806976 00010000:00010000:1.0:1746147256.454682:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 16 pid: 6881 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.454693:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8015 00000100:00100000:1.0:1746147256.454698:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465806848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.454709:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147256.454723:0:8494:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 1993 -> 2079 00010000:00010000:1.0:1746147256.454727:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 31 pid: 4444 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.454736:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 31 pid: 4444 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.454753:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd600/0xb4b2209fbdad126d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbf7 expref: 31 pid: 4444 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746147256.454760:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465806464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7183us (7357us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147256.454768:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7475 00010000:00010000:1.0:1746147256.454768:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147256.454775:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009fb73480 x1830967465806464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.454783:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb73480 with x1830967465806464 ext(4194304->4976639) 00000100:00100000:1.0:1746147256.454783:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465806848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (251us total) trans 0 rc 0/0 00002000:00010000:3.0:1746147256.454787:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb73480 00000100:00100000:1.0:1746147256.454788:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8015 00000100:00100000:1.0:1746147256.454799:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8016 00000100:00100000:1.0:1746147256.454804:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465806720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147256.454807:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8017 00000100:00100000:3.0:1746147256.454813:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465806976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.454815:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.454820:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.454822:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 7 pid: 17548 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.454828:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 14 pid: 6881 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.454834:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 7 pid: 17548 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.454847:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 14 pid: 6881 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.454859:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.454872:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465806976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.454878:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8017 00010000:00010000:2.0:1746147256.454898:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f5c00/0xb4b2209fbdad1204 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecbc6 expref: 13 pid: 6881 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746147256.454917:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.454954:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [708608->823295] (req 708608->823295) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.454963:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e799e00, rc 0) 00000100:00100000:2.0:1746147256.454980:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31948:x1830967465806592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7394us (7532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.454986:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15752 00010000:00010000:1.0:1746147256.455398:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b765000/0xb4b2209fbdad1403 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eccde expref: 7 pid: 17548 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.455407:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.455409:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.455414:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.455421:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.455443:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.455452:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467069824:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147256.455514:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.457749:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467069824:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147256.457765:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.457804:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967465806720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2998us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.457812:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8016 00000100:00100000:0.0:1746147256.458815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.458857:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465807232 00000100:00100000:3.0:1746147256.458864:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465807232 00002000:00100000:3.0:1746147256.458895:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (708608->712703) req@ffff88009fb70000 x1830967465807232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.458908:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70000 with x1830967465807232 ext(708608->712703) 00002000:00010000:3.0:1746147256.458912:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70000 00000100:00100000:0.0:1746147256.458919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.458953:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7476 00000100:00100000:3.0:1746147256.458959:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465807232:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147256.459145:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465807232:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 184us (330us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.459151:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7476 00002000:00100000:3.0:1746147256.459156:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (708608->712703) req@ffff88009fb70000 x1830967465807232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.459162:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70000 with x1830967465807232 ext(708608->712703) 00002000:00010000:3.0:1746147256.459165:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70000 00000100:00100000:2.0:1746147256.459173:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465807360 00000100:00100000:2.0:1746147256.459177:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465807360 00000100:00100000:2.0:1746147256.459212:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15753 00000100:00100000:2.0:1746147256.459218:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465807360:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.459226:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.459239:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00b400/0xb4b2209fbdad16c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eceb3 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.459272:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069952:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.459339:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00002000:00010000:0.0:1746147256.462931:0:4444:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime: 1746147253 -> 1746147256 00002000:00010000:0.0:1746147256.462950:0:4444:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime: 1746147253 -> 1746147256 00002000:00010000:0.0:1746147256.462952:0:4444:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime: 1746147253 -> 1746147256 00000100:00100000:0.0:1746147256.462974:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467069952:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147256.463000:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00b400/0xb4b2209fbdad16c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceb3 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.463017:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00b400/0xb4b2209fbdad16c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceb3 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147256.463041:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00b400, rc 0) 00000100:00100000:2.0:1746147256.463190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.463560:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465807360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4339us (4637us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147256.463567:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15753 00000100:00100000:3.0:1746147256.463599:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465807616 00000100:00100000:3.0:1746147256.463606:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465807616 00002000:00100000:3.0:1746147256.463635:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (819200->823295) req@ffff88009b409180 x1830967465807616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.463643:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409180 with x1830967465807616 ext(819200->823295) 00002000:00010000:3.0:1746147256.463648:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409180 00000100:00100000:3.0:1746147256.463661:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7477 00000100:00100000:3.0:1746147256.463666:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465807616:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147256.463837:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465807616:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 170us (648us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.463843:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7477 00002000:00100000:3.0:1746147256.463848:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (819200->823295) req@ffff88009b409180 x1830967465807616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.463854:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409180 with x1830967465807616 ext(819200->823295) 00002000:00010000:3.0:1746147256.463856:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409180 00000100:00100000:0.0:1746147256.467375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.467443:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465807744 00000100:00100000:2.0:1746147256.467449:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465807744 00000100:00100000:2.0:1746147256.467901:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15754 00000100:00100000:2.0:1746147256.467908:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465807744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.467922:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.467965:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00a600/0xb4b2209fbdad16cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eceba expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.468005:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070080:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.468069:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.469583:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070080:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.469605:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00a600/0xb4b2209fbdad16cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceba expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.469616:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a600/0xb4b2209fbdad16cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceba expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.469713:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00a600, rc 0) 00000100:00100000:2.0:1746147256.469754:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465807744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1845us (2383us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.469760:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15754 00000100:00100000:0.0:1746147256.514630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.514730:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465808000 00000100:00100000:3.0:1746147256.514740:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465808000 00000100:00100000:3.0:1746147256.514780:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11488 00000100:00100000:3.0:1746147256.514786:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:31954:x1830967465808000:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147256.514805:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.514822:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad16d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecec1 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.514902:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147256.514915:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147256.514923:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147256.514932:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147256.515046:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad16d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 37 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.515157:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 36 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.515164:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147256.515167:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147256.515169:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065000, rc 0) 00000100:00100000:3.0:1746147256.516392:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+36:31954:x1830967465808000:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1603us (1766us total) trans 8589945501 rc 0/0 00000100:00100000:3.0:1746147256.516399:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11488 00000100:00100000:0.0:1746147256.535871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.536240:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465808128 00000100:00100000:2.0:1746147256.536248:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465808128 00000100:00100000:2.0:1746147256.536299:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15755 00000100:00100000:2.0:1746147256.536307:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31954:x1830967465808128:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147256.536323:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.536336:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecec8 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.536361:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.536370:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.536376:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.536377:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.536380:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2609152->2912255] (req 2609152->2912255) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.536407:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.536417:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 28 pid: 4444 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746147256.536427:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.536522:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.536529:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.536538:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070336:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.536555:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.538539:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070208:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.538550:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.538575:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2609152->2912255] (req 2609152->2912255) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.538589:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00ae00, rc 0) 00000100:00100000:2.0:1746147256.538634:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31954:x1830967465808128:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2326us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.538641:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15755 00000100:00100000:0.0:1746147256.544633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.544719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.544907:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465808256 00000100:00100000:1.0:1746147256.544920:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465808256 00010000:00010000:1.0:1746147256.544975:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.544995:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465808384 00000100:00100000:1.0:1746147256.544997:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465808384 00010000:00010000:1.0:1746147256.545007:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 29 pid: 4444 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.545035:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8018 00000100:00100000:1.0:1746147256.545042:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465808256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.545053:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147256.545073:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8019 00010000:00010000:1.0:1746147256.545073:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.545082:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465808384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.545083:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.545090:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.545463:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 29 pid: 4444 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.545473:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f0a200/0xb4b2209fbdad168e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece89 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.545474:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 29 pid: 4444 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746147256.545491:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d63b800/0xb4b2209fbdad1695 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece90 expref: 29 pid: 4444 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.545493:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.545495:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.545501:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.545508:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.545597:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147256.545617:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.545629:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467070464:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.545633:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465808384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 552us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.545640:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8019 00000100:00100000:1.0:1746147256.545826:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.548660:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467070464:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147256.548677:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.548716:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465808256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3674us (4090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.548726:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8018 00000100:00100000:0.0:1746147256.548996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.549130:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465808640 00000100:00100000:3.0:1746147256.549137:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465808640 00002000:00100000:3.0:1746147256.549169:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2609152->2613247) req@ffff88009fb71180 x1830967465808640/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.549178:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71180 with x1830967465808640 ext(2609152->2613247) 00002000:00010000:3.0:1746147256.549182:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb71180 00000100:00100000:3.0:1746147256.549198:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7478 00000100:00100000:3.0:1746147256.549204:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465808640:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147256.549325:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465808640:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 121us (330us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.549331:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7478 00002000:00100000:3.0:1746147256.549336:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2609152->2613247) req@ffff88009fb71180 x1830967465808640/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.549343:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71180 with x1830967465808640 ext(2609152->2613247) 00002000:00010000:3.0:1746147256.549346:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb71180 00000100:00100000:0.0:1746147256.553725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.553811:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465808896 00000100:00100000:2.0:1746147256.553821:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465808896 00002000:00100000:2.0:1746147256.553855:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2908160->2912255) req@ffff88009fb70a80 x1830967465808896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.553861:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70a80 with x1830967465808896 ext(2908160->2912255) 00002000:00010000:2.0:1746147256.553864:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70a80 00000100:00100000:2.0:1746147256.554053:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7479 00000100:00100000:2.0:1746147256.554060:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465808896:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147256.554334:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465808896:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 274us (616us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147256.554340:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7479 00002000:00100000:2.0:1746147256.554346:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2908160->2912255) req@ffff88009fb70a80 x1830967465808896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.554353:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb70a80 with x1830967465808896 ext(2908160->2912255) 00002000:00010000:2.0:1746147256.554355:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb70a80 00000100:00100000:0.0:1746147256.650513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.650613:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809024 00000100:00100000:2.0:1746147256.650621:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809024 00000100:00100000:2.0:1746147256.650738:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15756 00000100:00100000:2.0:1746147256.650745:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465809024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.650761:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.650774:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00ac00/0xb4b2209fbdad16f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ececf expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.650817:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070592:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.650898:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147256.652742:0:4444:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147255 -> 1746147256 00000100:00100000:2.0:1746147256.652766:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070592:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.652787:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00ac00/0xb4b2209fbdad16f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ececf expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.652798:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00ac00/0xb4b2209fbdad16f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ececf expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.652824:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00ac00, rc 0) 00000100:00100000:2.0:1746147256.652863:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465809024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2118us (2356us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.652869:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15756 00000100:00100000:0.0:1746147256.658202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.658262:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809280 00000100:00100000:2.0:1746147256.658270:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809280 00002000:00100000:2.0:1746147256.658305:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009fb72a00 x1830967465809280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 504/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.658314:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb72a00 with x1830967465809280 ext(0->1048575) 00002000:00010000:2.0:1746147256.658319:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb72a00 00000100:00100000:2.0:1746147256.658349:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7480 00000100:00100000:2.0:1746147256.658462:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465809280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.668652:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465809280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10287us (10446us total) trans 0 rc 933888/933888 00000100:00100000:3.0:1746147256.668662:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7480 00002000:00100000:3.0:1746147256.668671:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009fb72a00 x1830967465809280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 504/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.668679:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb72a00 with x1830967465809280 ext(0->1048575) 00002000:00010000:3.0:1746147256.668684:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb72a00 00000100:00100000:0.0:1746147256.691904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.691967:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809408 00000100:00100000:2.0:1746147256.691977:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809408 00000100:00100000:2.0:1746147256.692035:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15757 00000100:00100000:2.0:1746147256.692042:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:31958:x1830967465809408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.692061:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.692078:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eced6 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.692108:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.692483:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.692485:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147256.692490:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.692525:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.692543:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 12 pid: 4444 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.692555:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070720:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.692651:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.697156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.697246:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809536 00000100:00100000:3.0:1746147256.697256:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809536 00000100:00100000:3.0:1746147256.697312:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15758 00000100:00100000:3.0:1746147256.697320:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465809536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147256.697338:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.697355:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064e00/0xb4b2209fbdad16fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecedd expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.697406:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467070848:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147256.697491:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.699353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.700512:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467070720:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.700540:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.700557:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00a400, rc 0) 00000100:00100000:3.0:1746147256.700622:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809664 00000100:00100000:3.0:1746147256.700629:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809664 00002000:00100000:3.0:1746147256.700677:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2609152->2912255) req@ffff88009fb73800 x1830967465809664/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.700686:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb73800 with x1830967465809664 ext(2609152->2912255) 00010000:00010000:3.0:1746147256.700693:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 15 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.700704:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 15 pid: 4444 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.700717:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb73800 00000100:00100000:3.0:1746147256.700746:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2569 00000100:00100000:3.0:1746147256.700753:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465809664:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147256.701182:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:31958:x1830967465809408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9139us (9286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.701189:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15757 00000100:00100000:3.0:1746147256.703029:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467070848:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147256.703057:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064e00/0xb4b2209fbdad16fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecedd expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.703109:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064e00/0xb4b2209fbdad16fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecedd expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.703139:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064e00, rc 0) 00000100:00100000:3.0:1746147256.703179:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465809536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5860us (6032us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147256.703187:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15758 00000100:00100000:3.0:1746147256.705329:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465809664:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4569us (5975us total) trans 17179874051 rc 0/0 00000100:00100000:3.0:1746147256.705341:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2569 00002000:00100000:3.0:1746147256.705351:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2609152->2912255) req@ffff88009fb73800 x1830967465809664/t17179874051(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.705360:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb73800 with x1830967465809664 ext(2609152->2912255) 00010000:00010000:3.0:1746147256.705370:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 15 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.705389:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 15 pid: 4444 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.705395:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb73800 00000100:00100000:0.0:1746147256.710611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.710713:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809792 00000100:00100000:3.0:1746147256.710721:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809792 00000100:00100000:3.0:1746147256.710765:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15759 00000100:00100000:3.0:1746147256.710772:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31963:x1830967465809792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147256.710788:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.710803:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecee4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.710828:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.710834:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147256.710836:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147256.710839:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.710870:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.710880:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 28 pid: 4444 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.710899:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467070976:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147256.711014:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.712218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.712295:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465809920 00000100:00100000:1.0:1746147256.712300:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465809920 00010000:00010000:1.0:1746147256.712320:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 17 pid: 4444 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.712381:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8020 00000100:00100000:1.0:1746147256.712387:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1958:x1830967465809920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.712395:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.712411:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 17 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.712540:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 17 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.712566:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00ae00/0xb4b2209fbdad16e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->2912255) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec8 expref: 17 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.712593:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.712594:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.712599:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.712605:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.712626:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.712634:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467071104:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147256.712694:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.724142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.724243:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467070976:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.724267:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.724282:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b7800, rc 0) 00000100:00100000:3.0:1746147256.724329:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31963:x1830967465809792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 13557us (13727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.724337:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15759 00000100:00100000:2.0:1746147256.724449:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465810048 00000100:00100000:2.0:1746147256.724456:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465810048 00000100:00100000:1.0:1746147256.724480:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467071104:192.168.203.36@tcp:105: 00002000:00100000:2.0:1746147256.724486:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (708608->823295) req@ffff88009fb71500 x1830967465810048/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.724494:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71500 with x1830967465810048 ext(708608->823295) 00010000:00010000:1.0:1746147256.724499:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147256.724501:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 29 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.724511:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 29 pid: 4444 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746147256.724522:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb71500 00000100:00100000:2.0:1746147256.724540:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2570 00000100:00100000:2.0:1746147256.724546:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465810048:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147256.724554:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465809920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12165us (12337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.724564:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8020 00000100:00100000:2.0:1746147256.730076:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465810048:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5522us (5934us total) trans 17179874052 rc 0/0 00000100:00100000:2.0:1746147256.730086:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2570 00002000:00100000:2.0:1746147256.730095:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (708608->823295) req@ffff88009fb71500 x1830967465810048/t17179874052(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.730103:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb71500 with x1830967465810048 ext(708608->823295) 00010000:00010000:2.0:1746147256.730122:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.730134:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746147256.730140:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb71500 00000100:00100000:2.0:1746147256.730873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.730987:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465810304 00000100:00100000:3.0:1746147256.730994:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465810304 00002000:00100000:3.0:1746147256.731019:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b40a680 x1830967465810304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.731026:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40a680 with x1830967465810304 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.731029:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40a680 00000100:00100000:3.0:1746147256.731059:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7481 00000100:00100000:3.0:1746147256.731064:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465810304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.743489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.743541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.743983:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465810560 00000100:00100000:2.0:1746147256.743993:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465810560 00002000:00100000:2.0:1746147256.744033:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012d499c00 x1830967465810560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.744043:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967465810560 ext(3145728->4194303) 00002000:00010000:2.0:1746147256.744048:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:2.0:1746147256.744084:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7482 00000100:00100000:2.0:1746147256.744090:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465810560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147256.744199:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465810688 00000100:00100000:1.0:1746147256.744205:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465810688 00010000:00010000:1.0:1746147256.744235:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 34 pid: 4444 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.744265:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8021 00000100:00100000:1.0:1746147256.744271:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967465810688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.744283:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.744303:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 34 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.744313:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 34 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.744342:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e799e00/0xb4b2209fbdad16bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->823295) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceac expref: 34 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.744371:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.744373:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.744381:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.744389:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.744422:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.744434:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467071232:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147256.744698:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.752405:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467071232:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147256.752423:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.752484:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465810304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21418us (21611us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.752494:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7481 00002000:00100000:3.0:1746147256.752503:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b40a680 x1830967465810304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.752517:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40a680 with x1830967465810304 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.752521:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40a680 00000100:00100000:1.0:1746147256.752571:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967465810688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8298us (9027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.752579:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8021 00000100:00100000:0.0:1746147256.753492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.753635:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465810944 00000100:00100000:3.0:1746147256.753642:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465810944 00002000:00100000:3.0:1746147256.753669:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012d49ad80 x1830967465810944/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.753676:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967465810944 ext(0->1048575) 00002000:00010000:3.0:1746147256.753680:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49ad80 00000100:00100000:3.0:1746147256.753698:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7483 00000100:00100000:3.0:1746147256.753704:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465810944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147256.757077:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465810560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12975us (13589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147256.757088:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7482 00002000:00100000:2.0:1746147256.757099:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012d499c00 x1830967465810560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.757108:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967465810560 ext(3145728->4194303) 00002000:00010000:2.0:1746147256.757126:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:3.0:1746147256.768354:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465810944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14640us (14854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.768365:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7483 00002000:00100000:3.0:1746147256.768376:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012d49ad80 x1830967465810944/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.768385:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967465810944 ext(0->1048575) 00002000:00010000:3.0:1746147256.768390:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49ad80 00000100:00100000:0.0:1746147256.768734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.769152:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465811072 00000100:00100000:3.0:1746147256.769158:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465811072 00000100:00100000:3.0:1746147256.769197:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15760 00000100:00100000:3.0:1746147256.769203:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465811072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147256.769215:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.769229:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eceeb expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.769246:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.769249:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.769255:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.769268:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.769277:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064000, rc 0) 00000100:00100000:3.0:1746147256.769309:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465811072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.769314:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15760 00000100:00100000:0.0:1746147256.777357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.777827:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465811328 00000100:00100000:3.0:1746147256.777834:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465811328 00002000:00100000:3.0:1746147256.777872:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d49b800 x1830967465811328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.777880:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b800 with x1830967465811328 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.777885:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b800 00000100:00100000:3.0:1746147256.777918:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7484 00000100:00100000:3.0:1746147256.777924:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465811328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.779418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.781827:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465811456 00000100:00100000:3.0:1746147256.781837:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465811456 00000100:00100000:3.0:1746147256.781893:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15761 00000100:00100000:3.0:1746147256.781901:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:31965:x1830967465811456:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147256.781915:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.781932:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecef2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.781983:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.781991:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.781997:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.781999:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.782002:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [679936->720895] (req 679936->720895) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.782027:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.782038:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 32 pid: 11147 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746147256.782048:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.782146:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.782154:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 16 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.782161:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071488:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147256.782179:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.782288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.782312:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465811584 00000100:00100000:1.0:1746147256.782317:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465811584 00000100:00100000:1.0:1746147256.782471:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15762 00000100:00100000:1.0:1746147256.782477:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31963:x1830967465811584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.782483:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.782490:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecef9 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.782501:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.782502:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.782507:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.782517:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.782525:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6e00, rc 0) 00000100:00100000:1.0:1746147256.782561:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31963:x1830967465811584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.782569:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15762 00000100:00100000:2.0:1746147256.785985:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071360:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.785996:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071488:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.786028:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [679936->720895] (req 679936->720895) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.786042:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6400, rc 0) 00000100:00100000:3.0:1746147256.786049:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465811328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8122us (8696us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147256.786059:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7484 00000100:00100000:2.0:1746147256.786062:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31965:x1830967465811456:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4162us (6650us total) trans 0 rc 0/0 00002000:00100000:3.0:1746147256.786068:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d49b800 x1830967465811328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147256.786068:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15761 00002000:00100000:3.0:1746147256.786076:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b800 with x1830967465811328 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.786081:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b800 00000100:00100000:0.0:1746147256.786205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.786261:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465811712 00000100:00100000:1.0:1746147256.786270:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465811712 00010000:00010000:1.0:1746147256.786294:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 31 pid: 11147 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746147256.786326:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8022 00000100:00100000:1.0:1746147256.786332:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465811712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.786342:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.786358:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 31 pid: 11147 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.786367:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 31 pid: 11147 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.786384:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064000/0xb4b2209fbdad170c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eceeb expref: 31 pid: 11147 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746147256.786406:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.786422:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465811712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.786427:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8022 00000100:00100000:0.0:1746147256.786977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.786995:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465811840 00000100:00100000:1.0:1746147256.786999:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465811840 00010000:00010000:1.0:1746147256.787010:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 17 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.787034:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8023 00000100:00100000:1.0:1746147256.787038:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465811840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.787046:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.787054:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 17 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.787062:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 17 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.787073:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdad1705 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecee4 expref: 17 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.787081:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.787082:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.787087:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.787095:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.787128:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.787136:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467071616:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147256.787197:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.789713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.790178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.790203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.790252:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467071616:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147256.790267:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.790298:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465811840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3259us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.790307:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8023 00000100:00100000:1.0:1746147256.790379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.790448:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465812736 00000100:00100000:1.0:1746147256.790453:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465812736 00000100:00100000:1.0:1746147256.790477:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15763 00000100:00100000:1.0:1746147256.790483:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465812736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147256.790496:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.790509:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1721 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf00 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147256.790531:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465812096 00000100:00100000:0.0:1746147256.790536:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465812096 00000100:00100000:1.0:1746147256.790545:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071744:192.168.203.36@tcp:106: 00002000:00100000:0.0:1746147256.790558:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (679936->684031) req@ffff88012eced500 x1830967465812096/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.790567:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967465812096 ext(679936->684031) 00002000:00010000:0.0:1746147256.790571:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:0.0:1746147256.790582:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465812352 00000100:00100000:0.0:1746147256.790584:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465812352 00002000:00100000:0.0:1746147256.790591:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012ecedf80 x1830967465812352/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.790598:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedf80 with x1830967465812352 ext(2097152->3145727) 00002000:00010000:0.0:1746147256.790600:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecedf80 00000100:00100000:0.0:1746147256.791964:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465812608 00000100:00100000:0.0:1746147256.791970:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465812608 00000100:00100000:2.0:1746147256.791971:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7485 00000100:00100000:1.0:1746147256.791972:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.791978:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7486 00000100:00100000:2.0:1746147256.791980:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465812096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.791988:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465812352:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147256.791991:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009edcb480 x1830967465812608/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.792000:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830967465812608 ext(3145728->4194303) 00002000:00010000:0.0:1746147256.792003:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb480 00000100:00100000:1.0:1746147256.792026:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7487 00000100:00100000:1.0:1746147256.792032:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465812608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147256.792100:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465812096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 121us (2393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147256.792105:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7485 00002000:00100000:2.0:1746147256.792121:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x423:0x0] (679936->684031) req@ffff88012eced500 x1830967465812096/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.792128:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967465812096 ext(679936->684031) 00002000:00010000:2.0:1746147256.792131:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:1.0:1746147256.796318:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071744:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147256.796344:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1721 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf00 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.796356:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1721 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf00 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147256.796379:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6a00, rc 0) 00000100:00100000:1.0:1746147256.796875:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465812736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6390us (6493us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147256.796886:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15763 00000100:00100000:0.0:1746147256.799881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.800202:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465812992 00000100:00100000:1.0:1746147256.800209:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465812992 00000100:00100000:1.0:1746147256.800250:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15764 00000100:00100000:1.0:1746147256.800257:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:31960:x1830967465812992:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147256.800344:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147256.800359:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf07 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.800383:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.800389:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.800395:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.800396:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.800399:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2547712->3145727] (req 2547712->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.800424:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.800435:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 19 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.800446:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071872:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.800533:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.800541:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.800548:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467072000:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.800565:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.802019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.802458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.802516:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465813120 00000100:00100000:3.0:1746147256.802523:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465813120 00002000:00100000:3.0:1746147256.802551:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (716800->720895) req@ffff88009b40ad80 x1830967465813120/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.802559:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40ad80 with x1830967465813120 ext(716800->720895) 00002000:00010000:3.0:1746147256.802564:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40ad80 00000100:00100000:3.0:1746147256.802579:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7488 00000100:00100000:3.0:1746147256.802585:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465813120:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.802694:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465813120:12345-192.168.203.36@tcp:3:cat.0 Request processed in 109us (678us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.802701:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7488 00002000:00100000:3.0:1746147256.802705:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (716800->720895) req@ffff88009b40ad80 x1830967465813120/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.802717:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40ad80 with x1830967465813120 ext(716800->720895) 00002000:00010000:3.0:1746147256.802720:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40ad80 00000100:00100000:1.0:1746147256.802748:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465812608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10714us (12541us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147256.802755:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7487 00002000:00100000:1.0:1746147256.802760:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009edcb480 x1830967465812608/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147256.802767:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830967465812608 ext(3145728->4194303) 00010000:00010000:1.0:1746147256.802773:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 18 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.802782:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 18 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:1.0:1746147256.802788:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edcb480 00000100:00100000:2.0:1746147256.802827:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465813248 00000100:00100000:2.0:1746147256.802831:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465813248 00000100:00100000:2.0:1746147256.802850:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15765 00000100:00100000:2.0:1746147256.802855:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465813248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147256.802862:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.802873:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f400/0xb4b2209fbdad172f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf0e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.802904:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467072128:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.802964:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.804775:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467071872:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147256.804785:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467072000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147256.804807:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2547712->3145727] (req 2547712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 33 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.804819:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678e00, rc 0) 00000100:00100000:1.0:1746147256.804844:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31960:x1830967465812992:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4588us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.804850:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15764 00000100:00100000:2.0:1746147256.804919:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467072128:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147256.804956:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f400/0xb4b2209fbdad172f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf0e expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.804966:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f400/0xb4b2209fbdad172f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf0e expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.804978:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0f400, rc 0) 00000100:00100000:2.0:1746147256.804997:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465813248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2141us (2539us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147256.805002:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15765 00000100:00100000:3.0:1746147256.806366:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465812352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14372us (16180us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.806376:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7486 00002000:00100000:3.0:1746147256.806386:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012ecedf80 x1830967465812352/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.806394:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedf80 with x1830967465812352 ext(2097152->3145727) 00010000:00010000:3.0:1746147256.806403:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 16 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.806414:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 16 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.806420:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ecedf80 00000100:00100000:0.0:1746147256.810746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.810812:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465813376 00000100:00100000:1.0:1746147256.810820:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465813376 00010000:00010000:1.0:1746147256.810850:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.810889:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8024 00000100:00100000:1.0:1746147256.810896:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465813376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.810908:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.810928:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.810972:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.810992:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdad16f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eced6 expref: 31 pid: 4444 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.811014:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.811056:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465813376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 159us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.811062:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8024 00000100:00100000:0.0:1746147256.816484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.816543:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465813504 00000100:00100000:1.0:1746147256.816551:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465813504 00010000:00010000:1.0:1746147256.816583:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 16 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.816622:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8025 00000100:00100000:1.0:1746147256.816630:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465813504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.816642:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.816662:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 16 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.816673:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 16 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.816691:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad171a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef9 expref: 16 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.816706:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.816707:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.816714:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.816721:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147256.816747:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.816762:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467072256:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147256.816839:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.819456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.819497:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465813632 00000100:00100000:0.0:1746147256.819505:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465813632 00000100:00100000:0.0:1746147256.819551:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15766 00000100:00100000:0.0:1746147256.819558:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31963:x1830967465813632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147256.819572:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147256.819586:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf15 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.819608:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.819614:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147256.819616:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147256.819619:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.819644:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147256.819655:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 29 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746147256.819665:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467072384:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147256.819735:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147256.819978:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467072256:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147256.819991:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147256.820022:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465813504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3393us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147256.820030:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8025 00000100:00100000:2.0:1746147256.821761:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467072384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.821779:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.821791:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00aa00, rc 0) 00000100:00100000:2.0:1746147256.821820:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+16:31963:x1830967465813632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2262us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.821825:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15766 00000100:00100000:0.0:1746147256.825578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.825635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.825721:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465813888 00000100:00100000:3.0:1746147256.825728:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465813888 00002000:00100000:3.0:1746147256.825764:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2547712->3145727) req@ffff880134f33800 x1830967465813888/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.825773:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33800 with x1830967465813888 ext(2547712->3145727) 00010000:00010000:3.0:1746147256.825780:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 30 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.825791:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 30 pid: 11147 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.825798:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f33800 00000100:00100000:3.0:1746147256.825816:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2571 00000100:00100000:3.0:1746147256.825822:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465813888:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147256.826525:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465814016 00000100:00100000:2.0:1746147256.826529:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465814016 00000100:00100000:2.0:1746147256.826551:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15767 00000100:00100000:2.0:1746147256.826555:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+21:31960:x1830967465814016:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147256.826563:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.826575:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf1c expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.826592:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.826600:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.826605:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.826607:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.826610:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->2265087] (req 2097152->2265087) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.826637:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.826646:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.826660:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467072512:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147256.826713:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.826720:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 13 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.826726:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467072640:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147256.826741:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.830483:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467072512:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147256.830495:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467072640:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.830619:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->2265087] (req 2097152->2265087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.830636:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0e800, rc 0) 00000100:00100000:3.0:1746147256.830677:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:31960:x1830967465814016:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4119us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.830684:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15767 00000100:00100000:0.0:1746147256.833383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.833423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147256.834069:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465814144 00000100:00100000:2.0:1746147256.834075:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465814272 00000100:00100000:2.0:1746147256.834078:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465814272 00000100:00100000:1.0:1746147256.834078:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465814144 00010000:00010000:2.0:1746147256.834104:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.834104:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.834141:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8026 00000100:00100000:2.0:1746147256.834151:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465814272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147256.834162:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147256.834180:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8027 00010000:00010000:2.0:1746147256.834181:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.834185:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465814144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147256.834191:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.834191:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147256.834198:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.834208:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad16a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece9e expref: 22 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.834238:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.834248:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147256.834255:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad169c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece97 expref: 14 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746147256.834270:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.834272:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147256.834278:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 21 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.834283:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465814272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 137us (861us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147256.834286:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 21 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.834289:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8026 00010000:00010000:1.0:1746147256.834311:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147256.834321:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467072768:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147256.834441:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.834613:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465813888:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8790us (9042us total) trans 17179874053 rc 0/0 00000100:00100000:3.0:1746147256.834621:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2571 00002000:00100000:3.0:1746147256.834627:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2547712->3145727) req@ffff880134f33800 x1830967465813888/t17179874053(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.834635:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33800 with x1830967465813888 ext(2547712->3145727) 00010000:00010000:3.0:1746147256.834641:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 32 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.834651:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 32 pid: 11147 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.834657:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f33800 00000100:00100000:0.0:1746147256.838542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.839010:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465814400 00000100:00100000:3.0:1746147256.839020:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465814400 00010000:00010000:3.0:1746147256.839047:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 32 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.839062:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467072768:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.839070:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8028 00000100:00100000:3.0:1746147256.839076:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465814400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147256.839076:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147256.839086:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147256.839107:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 32 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.839128:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465814144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4942us (5751us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147256.839130:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 32 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746147256.839135:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8027 00010000:00010000:3.0:1746147256.839149:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678e00/0xb4b2209fbdad1728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf07 expref: 32 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.839167:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.839169:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147256.839174:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.839180:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.839217:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147256.839227:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467072896:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147256.839284:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.839881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.839920:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465814656 00000100:00100000:3.0:1746147256.839923:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465814656 00002000:00100000:3.0:1746147256.839976:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2260992->2265087) req@ffff880134f33100 x1830967465814656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.839984:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33100 with x1830967465814656 ext(2260992->2265087) 00002000:00010000:3.0:1746147256.839988:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f33100 00000100:00100000:3.0:1746147256.840004:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7489 00000100:00100000:3.0:1746147256.840009:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465814656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.840176:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465814656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 167us (302us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147256.840182:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7489 00002000:00100000:3.0:1746147256.840187:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2260992->2265087) req@ffff880134f33100 x1830967465814656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.840193:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33100 with x1830967465814656 ext(2260992->2265087) 00002000:00010000:3.0:1746147256.840195:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f33100 00000100:00100000:3.0:1746147256.840930:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467072896:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147256.840963:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147256.841036:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465814400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1958us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.841044:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8028 00000100:00100000:0.0:1746147256.848330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.848428:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465814912 00000100:00100000:3.0:1746147256.848436:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465814912 00002000:00100000:3.0:1746147256.848474:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f33480 x1830967465814912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.848483:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33480 with x1830967465814912 ext(3145728->4194303) 00002000:00010000:3.0:1746147256.848488:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f33480 00000100:00100000:3.0:1746147256.848505:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7490 00000100:00100000:3.0:1746147256.848512:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465814912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.857895:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465814912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9373us (9563us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.857905:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7490 00002000:00100000:3.0:1746147256.857916:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f33480 x1830967465814912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.857934:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f33480 with x1830967465814912 ext(3145728->4194303) 00002000:00010000:3.0:1746147256.857956:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f33480 00000100:00100000:0.0:1746147256.864673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.864738:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465815040 00000100:00100000:3.0:1746147256.864746:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465815040 00000100:00100000:3.0:1746147256.864801:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15768 00000100:00100000:3.0:1746147256.864808:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31963:x1830967465815040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147256.864824:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.864837:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf23 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.864862:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.864873:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147256.864875:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147256.864878:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.864902:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.864914:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 20 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.864925:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467073024:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147256.865200:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.866740:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467073024:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.866762:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.866775:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136966200, rc 0) 00000100:00100000:3.0:1746147256.866806:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31963:x1830967465815040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1998us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147256.867204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.867283:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15768 00000100:00100000:2.0:1746147256.867354:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465815168 00000100:00100000:2.0:1746147256.867359:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465815168 00002000:00100000:2.0:1746147256.867385:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2265087) req@ffff880134f30000 x1830967465815168/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.867393:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30000 with x1830967465815168 ext(2097152->2265087) 00010000:00010000:2.0:1746147256.867398:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 21 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.867408:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 21 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746147256.867414:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f30000 00000100:00100000:2.0:1746147256.867425:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2572 00000100:00100000:2.0:1746147256.867430:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465815168:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147256.870642:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465815168:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3204us (3431us total) trans 21474841403 rc 0/0 00000100:00100000:2.0:1746147256.870652:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2572 00002000:00100000:2.0:1746147256.870661:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2265087) req@ffff880134f30000 x1830967465815168/t21474841403(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147256.870669:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f30000 with x1830967465815168 ext(2097152->2265087) 00010000:00010000:2.0:1746147256.870677:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 23 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.870689:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 23 pid: 21080 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746147256.870695:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f30000 00000100:00100000:0.0:1746147256.874731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.874996:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465815296 00000100:00100000:2.0:1746147256.875004:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465815296 00010000:00010000:2.0:1746147256.875038:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 23 pid: 21080 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.875068:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8029 00000100:00100000:2.0:1746147256.875074:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465815296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147256.875084:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147256.875218:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 23 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.875234:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 23 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.875251:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e800/0xb4b2209fbdad173d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2265087) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf1c expref: 23 pid: 21080 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.875265:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.875267:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.875272:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.875279:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.875304:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.875312:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467073152:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147256.875384:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147256.881560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.881682:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467073152:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147256.881699:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147256.881735:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465815552 00000100:00100000:2.0:1746147256.881737:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967465815296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6663us (7015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.881741:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465815552 00000100:00100000:2.0:1746147256.881746:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8029 00002000:00100000:3.0:1746147256.881877:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012c85f100 x1830967465815552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.881892:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f100 with x1830967465815552 ext(3145728->4194303) 00002000:00010000:3.0:1746147256.881897:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f100 00000100:00100000:3.0:1746147256.881924:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7491 00000100:00100000:3.0:1746147256.881930:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465815552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.891393:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465815552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9455us (9831us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.891404:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7491 00002000:00100000:3.0:1746147256.891421:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012c85f100 x1830967465815552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.891430:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f100 with x1830967465815552 ext(3145728->4194303) 00002000:00010000:3.0:1746147256.891437:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f100 00000100:00100000:0.0:1746147256.900265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.900322:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465815808 00000100:00100000:3.0:1746147256.900329:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465815808 00002000:00100000:3.0:1746147256.900362:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85df80 x1830967465815808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.900371:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85df80 with x1830967465815808 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.900376:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85df80 00000100:00100000:3.0:1746147256.900399:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7492 00000100:00100000:3.0:1746147256.900405:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465815808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.906084:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465815808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5670us (5816us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147256.906095:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7492 00002000:00100000:3.0:1746147256.906107:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85df80 x1830967465815808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.906124:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85df80 with x1830967465815808 ext(4194304->4976639) 00002000:00010000:3.0:1746147256.906129:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85df80 00000100:00100000:0.0:1746147256.932858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.932897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.932961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.933219:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465815936 00000100:00100000:3.0:1746147256.933227:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465815936 00000100:00100000:3.0:1746147256.933265:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465816064 00000100:00100000:3.0:1746147256.933266:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465816064 00000100:00100000:3.0:1746147256.933276:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465816192 00000100:00100000:3.0:1746147256.933278:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465816192 00000100:00100000:3.0:1746147256.933291:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15769 00000100:00100000:3.0:1746147256.933297:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465815936:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147256.933310:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15770 00000100:00100000:0.0:1746147256.933318:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465816064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147256.933327:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147256.933343:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf31 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.933357:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15771 00010000:00010000:0.0:1746147256.933362:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147256.933364:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147256.933371:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 33 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147256.933374:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967465816192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147256.933384:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 33 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147256.933392:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147256.933393:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194600, rc 0) 00010000:00010000:2.0:1746147256.933407:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf38 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.933427:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147256.933427:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465816064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 111us (530us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147256.933429:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.933436:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147256.933438:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15770 00010000:00010000:3.0:1746147256.933443:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147256.933450:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.933452:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136967400/0xb4b2209fbdad1759 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf2a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.933459:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d54400, rc 0) 00000100:00100000:3.0:1746147256.933485:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073280:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147256.933503:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465816192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 135us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.933509:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15771 00000100:00100000:3.0:1746147256.933535:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.936798:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073280:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147256.936825:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136967400/0xb4b2209fbdad1759 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf2a expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.936837:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136967400/0xb4b2209fbdad1759 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf2a expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147256.936864:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136967400, rc 0) 00000100:00100000:3.0:1746147256.936903:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465815936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3605us (4051us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147256.936911:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15769 00000100:00100000:0.0:1746147256.940648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.940743:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465816320 00000100:00100000:3.0:1746147256.940751:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465816320 00000100:00100000:3.0:1746147256.940790:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15772 00000100:00100000:3.0:1746147256.940795:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:31972:x1830967465816320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147256.940808:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147256.940819:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf3f expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.940837:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.940842:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147256.940843:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147256.940845:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.940862:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.940869:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 15 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746147256.940876:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073408:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147256.940989:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147256.942488:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073408:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147256.942523:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147256.942540:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129efec00, rc 0) 00000100:00100000:3.0:1746147256.942581:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:31972:x1830967465816320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1785us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147256.942588:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15772 00000100:00100000:0.0:1746147256.943821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.943908:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465816448 00000100:00100000:3.0:1746147256.943915:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465816448 00002000:00100000:3.0:1746147256.943987:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (679936->720895) req@ffff88012c85ce00 x1830967465816448/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.943996:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ce00 with x1830967465816448 ext(679936->720895) 00010000:00010000:3.0:1746147256.944004:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 16 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.944017:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 16 pid: 11147 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.944023:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c85ce00 00000100:00100000:3.0:1746147256.944043:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2573 00000100:00100000:3.0:1746147256.944050:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465816448:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147256.947516:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465816448:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3459us (3692us total) trans 17179874054 rc 0/0 00000100:00100000:3.0:1746147256.947526:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2573 00002000:00100000:3.0:1746147256.947535:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (679936->720895) req@ffff88012c85ce00 x1830967465816448/t17179874054(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:632/0 lens 488/448 e 0 to 0 dl 1746147267 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.947544:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ce00 with x1830967465816448 ext(679936->720895) 00010000:00010000:3.0:1746147256.947553:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 18 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746147256.947565:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 18 pid: 11147 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746147256.947571:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c85ce00 00000100:00100000:0.0:1746147256.952367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147256.952494:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465816576 00000100:00100000:2.0:1746147256.952504:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465816576 00010000:00010000:2.0:1746147256.952543:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 18 pid: 11147 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746147256.952576:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8030 00000100:00100000:2.0:1746147256.952585:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465816576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147256.952601:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147256.952623:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 18 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.952689:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 18 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.952717:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdad1713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->720895) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecef2 expref: 18 pid: 11147 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746147256.952747:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.952749:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147256.952756:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.952765:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147256.952802:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147256.952816:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467073536:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147256.952914:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147256.956047:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467073536:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147256.956068:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147256.956240:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465816576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3654us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147256.956250:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8030 00000100:00100000:0.0:1746147256.960080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.960251:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465816832 00000100:00100000:3.0:1746147256.960264:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465816832 00002000:00100000:3.0:1746147256.960316:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012c85ca80 x1830967465816832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.960326:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ca80 with x1830967465816832 ext(0->1048575) 00002000:00010000:3.0:1746147256.960333:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85ca80 00000100:00100000:3.0:1746147256.960370:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7493 00000100:00100000:3.0:1746147256.960379:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465816832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147256.974702:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465816832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14316us (14618us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147256.974712:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7493 00002000:00100000:3.0:1746147256.974722:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012c85ca80 x1830967465816832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.974730:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ca80 with x1830967465816832 ext(0->1048575) 00002000:00010000:3.0:1746147256.974735:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85ca80 00000100:00100000:0.0:1746147256.994558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147256.994596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.994621:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465817088 00000100:00100000:0.0:1746147256.994623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147256.994629:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465817088 00000100:00100000:0.0:1746147256.994660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147256.994665:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c85e680 x1830967465817088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.994674:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e680 with x1830967465817088 ext(2097152->3145727) 00002000:00010000:3.0:1746147256.994679:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85e680 00000100:00100000:0.0:1746147256.994694:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465817344 00000100:00100000:3.0:1746147256.994696:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465817600 00000100:00100000:0.0:1746147256.994697:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465817344 00000100:00100000:3.0:1746147256.994698:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465817600 00002000:00100000:3.0:1746147256.994709:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c85fb80 x1830967465817600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.994709:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c85ea00 x1830967465817344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147256.994716:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85fb80 with x1830967465817600 ext(2097152->3145727) 00002000:00100000:0.0:1746147256.994716:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ea00 with x1830967465817344 ext(3145728->4194303) 00002000:00010000:0.0:1746147256.994718:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85ea00 00002000:00010000:3.0:1746147256.994719:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85fb80 00000100:00100000:0.0:1746147256.994726:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465817728 00000100:00100000:0.0:1746147256.994727:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465817728 00002000:00100000:0.0:1746147256.994735:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012c85f480 x1830967465817728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/0 e 0 to 0 dl 1746147267 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147256.994741:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f480 with x1830967465817728 ext(3145728->4194303) 00002000:00010000:0.0:1746147256.994743:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f480 00000100:00100000:3.0:1746147256.995225:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7494 00000100:00100000:0.0:1746147256.995230:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7495 00000100:00100000:3.0:1746147256.995232:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465817088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147256.995235:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465817344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147256.995250:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7496 00000100:00100000:0.0:1746147256.995258:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7497 00000100:00100000:0.0:1746147256.995262:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465817728:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147256.995276:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465817600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.003204:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465817088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7963us (8643us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147257.003215:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7494 00002000:00100000:3.0:1746147257.003225:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c85e680 x1830967465817088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.003234:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e680 with x1830967465817088 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.003239:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85e680 00010000:00010000:2.0:1746147257.006837:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147257.009088:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465817600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13822us (14457us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147257.009098:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7496 00002000:00100000:3.0:1746147257.009118:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c85fb80 x1830967465817600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.009132:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85fb80 with x1830967465817600 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.009137:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85fb80 00000100:00100000:2.0:1746147257.011218:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465817728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15949us (16552us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.011226:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7497 00002000:00100000:2.0:1746147257.011233:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012c85f480 x1830967465817728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.011241:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f480 with x1830967465817728 ext(3145728->4194303) 00002000:00010000:2.0:1746147257.011245:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f480 00000100:00100000:2.0:1746147257.013412:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465817344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18172us (18810us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.013418:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7495 00002000:00100000:2.0:1746147257.013425:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c85ea00 x1830967465817344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:632/0 lens 488/440 e 0 to 0 dl 1746147267 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.013430:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ea00 with x1830967465817344 ext(3145728->4194303) 00002000:00010000:2.0:1746147257.013434:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85ea00 00000100:00100000:0.0:1746147257.019031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.019208:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465818112 00000100:00100000:2.0:1746147257.019216:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465818112 00002000:00100000:2.0:1746147257.019251:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85f800 x1830967465818112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.019259:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f800 with x1830967465818112 ext(4194304->4976639) 00002000:00010000:2.0:1746147257.019263:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85f800 00000100:00100000:2.0:1746147257.019280:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7498 00000100:00100000:2.0:1746147257.019286:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465818112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.026188:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465818112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6894us (7156us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147257.026196:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7498 00002000:00100000:3.0:1746147257.026204:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85f800 x1830967465818112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.026213:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f800 with x1830967465818112 ext(4194304->4976639) 00002000:00010000:3.0:1746147257.026217:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85f800 00000100:00100000:0.0:1746147257.032885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.032971:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465818240 00000100:00100000:3.0:1746147257.032979:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465818240 00000100:00100000:3.0:1746147257.033130:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15773 00000100:00100000:3.0:1746147257.033139:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:31974:x1830967465818240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147257.033154:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.033169:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf46 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.033197:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.033204:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.033205:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.033208:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [520192->655359] (req 520192->655359) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.033236:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.033247:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 32 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.033257:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073664:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.033326:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00080000:1.0:1746147257.033369:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147257.035191:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073664:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.035215:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [520192->655359] (req 520192->655359) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.035228:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59c400, rc 0) 00000100:00100000:3.0:1746147257.035279:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31974:x1830967465818240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2136us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.035286:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15773 00000100:00100000:0.0:1746147257.037015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.037122:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465818368 00000100:00100000:3.0:1746147257.037129:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465818368 00000100:00100000:3.0:1746147257.037485:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15774 00000100:00100000:3.0:1746147257.037493:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465818368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.037507:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.037521:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad176e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf4d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.037541:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.037550:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad176e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf4d expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.037558:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad176e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf4d expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.037700:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59c600, rc 0) 00000100:00100000:3.0:1746147257.038056:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465818368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 563us (1045us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.038062:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15774 00000100:00100000:0.0:1746147257.038535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.038587:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465818496 00000100:00100000:2.0:1746147257.038591:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465818496 00010000:00010000:2.0:1746147257.038608:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 33 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.038624:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8031 00000100:00100000:2.0:1746147257.038628:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465818496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147257.038635:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147257.038652:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 33 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.038660:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 33 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.038677:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129efec00/0xb4b2209fbdad1760 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf3f expref: 33 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.038697:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.038699:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.038704:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.038711:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.038737:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.038751:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467073792:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147257.038804:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.039924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.039966:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465818624 00000100:00100000:3.0:1746147257.039971:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465818624 00000100:00100000:3.0:1746147257.040008:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15775 00000100:00100000:3.0:1746147257.040013:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:31977:x1830967465818624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.040098:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.040118:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf54 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.040136:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.040141:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.040143:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.040146:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.040167:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.040180:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.040196:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073920:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.040353:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.040655:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467073792:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.040667:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.040700:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465818496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2069us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.040707:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8031 00000100:00100000:2.0:1746147257.040972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.041236:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465818880 00000100:00100000:3.0:1746147257.041239:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465818880 00002000:00100000:3.0:1746147257.041260:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (520192->524287) req@ffff88009b40b100 x1830967465818880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.041268:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40b100 with x1830967465818880 ext(520192->524287) 00010000:00010000:3.0:1746147257.041273:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 20 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.041283:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 20 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.041289:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b40b100 00000100:00100000:3.0:1746147257.041309:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2574 00000100:00100000:3.0:1746147257.041314:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465818880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.041419:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465818880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 105us (447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147257.041425:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2574 00002000:00100000:3.0:1746147257.041429:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (520192->524287) req@ffff88009b40b100 x1830967465818880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.041436:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40b100 with x1830967465818880 ext(520192->524287) 00010000:00010000:3.0:1746147257.041440:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 20 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.041448:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 20 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.041453:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b40b100 00000100:00100000:3.0:1746147257.042321:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467073920:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.042337:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.042348:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59cc00, rc 0) 00000100:00100000:3.0:1746147257.042682:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:31977:x1830967465818624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2667us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.042688:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15775 00000100:00100000:2.0:1746147257.044975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.045022:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465819136 00000100:00100000:3.0:1746147257.045029:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465819136 00002000:00100000:3.0:1746147257.045067:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (651264->655359) req@ffff88009b408380 x1830967465819136/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.045077:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408380 with x1830967465819136 ext(651264->655359) 00010000:00010000:3.0:1746147257.045084:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.045096:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.045103:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b408380 00000100:00100000:3.0:1746147257.045137:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2575 00000100:00100000:3.0:1746147257.045144:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465819136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.045296:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465819136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 151us (324us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147257.045301:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2575 00002000:00100000:3.0:1746147257.045307:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (651264->655359) req@ffff88009b408380 x1830967465819136/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.045314:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408380 with x1830967465819136 ext(651264->655359) 00010000:00010000:3.0:1746147257.045319:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.045327:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.045331:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b408380 00000100:00100000:0.0:1746147257.048532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.048598:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465819392 00000100:00100000:3.0:1746147257.048605:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465819392 00002000:00100000:3.0:1746147257.048641:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (520192->655359) req@ffff8800936dca80 x1830967465819392/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.048650:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967465819392 ext(520192->655359) 00010000:00010000:3.0:1746147257.048657:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.048670:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.048677:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dca80 00000100:00100000:3.0:1746147257.048705:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2576 00000100:00100000:3.0:1746147257.048712:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967465819392:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147257.053903:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967465819392:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5183us (5370us total) trans 17179874055 rc 0/0 00000100:00100000:3.0:1746147257.053914:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2576 00002000:00100000:3.0:1746147257.053922:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (520192->655359) req@ffff8800936dca80 x1830967465819392/t17179874055(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.053930:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967465819392 ext(520192->655359) 00010000:00010000:3.0:1746147257.053961:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 21 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.053973:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 21 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.053984:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dca80 00000100:00100000:2.0:1746147257.058987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.059491:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465819520 00000100:00100000:3.0:1746147257.059498:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465819520 00010000:00010000:3.0:1746147257.059524:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 21 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.059557:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8032 00000100:00100000:3.0:1746147257.059564:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465819520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.059574:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.059593:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 21 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.059603:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 21 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.059621:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c400/0xb4b2209fbdad1767 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->655359) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf46 expref: 21 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.059645:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.059647:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.059653:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 20 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.059660:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 20 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.059688:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 20 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.059698:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467074048:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.059796:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.062341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.062434:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465819648 00000100:00100000:3.0:1746147257.062441:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465819648 00000100:00100000:3.0:1746147257.062481:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11489 00000100:00100000:3.0:1746147257.062487:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:31980:x1830967465819648:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147257.062504:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.062516:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc600/0xb4b2209fbdad177c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf5b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.062558:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.062567:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.062576:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.062585:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.062590:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147257.062593:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467074048:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.062594:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.062608:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147257.062638:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465819520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3074us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147257.062646:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8032 00010000:00010000:3.0:1746147257.062677:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.063036:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 323 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.063042:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 35 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.063048:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.063068:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 35 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.063077:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 35 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.063087:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467074176:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.063361:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 323 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.063369:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 323 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.063376:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467074304:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.063393:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.064280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.064349:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465819904 00000100:00100000:3.0:1746147257.064354:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465819904 00002000:00100000:3.0:1746147257.064376:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800936ded80 x1830967465819904/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.064383:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830967465819904 ext(0->1048575) 00002000:00010000:3.0:1746147257.064386:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ded80 00000100:00100000:3.0:1746147257.064398:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7499 00000100:00100000:3.0:1746147257.064403:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465819904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147257.067564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.067632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.067654:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465820160 00000100:00100000:1.0:1746147257.067663:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465820160 00000100:00100000:2.0:1746147257.067676:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465820416 00000100:00100000:2.0:1746147257.067681:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465820416 00000100:00100000:1.0:1746147257.067698:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4810 00000100:00100000:2.0:1746147257.067703:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4811 00000100:00100000:1.0:1746147257.067704:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+36:19601:x1830967465820160:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147257.067709:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:7641:x1830967465820416:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147257.068058:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467074176:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.068068:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467074304:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.068094:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147257.068137:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+37:19601:x1830967465820160:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 432us (582us total) trans 8589945502 rc 0/0 00000100:00100000:1.0:1746147257.068149:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4810 00000100:00100000:2.0:1746147257.068214:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:7641:x1830967465820416:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 504us (584us total) trans 8589945503 rc 0/0 00000100:00100000:2.0:1746147257.068222:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4811 00000100:00100000:0.0:1746147257.068926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.069176:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465820672 00000100:00100000:1.0:1746147257.069182:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465820672 00000100:00100000:1.0:1746147257.069224:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11490 00000100:00100000:1.0:1746147257.069231:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:31982:x1830967465820672:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147257.069244:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147257.069260:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad1798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf62 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.069326:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147257.069338:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.069343:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147257.069358:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.069365:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147257.071862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.071887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.072013:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465820800 00000100:00100000:0.0:1746147257.072023:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465820800 00010000:00010000:0.0:1746147257.072056:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 327 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746147257.072085:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465820928 00000100:00100000:0.0:1746147257.072087:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465820928 00010000:00010000:0.0:1746147257.072096:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 37 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746147257.072122:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8033 00000100:00100000:1.0:1746147257.072127:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8034 00000100:00100000:0.0:1746147257.072129:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+327:1957:x1830967465820800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147257.072133:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1956:x1830967465820928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.072144:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147257.072144:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.072150:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 37 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.072150:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 327 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.072159:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 327 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.072168:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 37 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.072274:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e799c00/0xb4b2209fbdad16b1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecea5 expref: 327 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.072290:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad16db lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecec1 expref: 37 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.072370:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147257.072375:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.072385:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.072390:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.072397:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147257.072401:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147257.072533:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147257.072537:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147257.072542:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147257.072546:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147257.072584:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1957:x1830967465820800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 456us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147257.072590:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8033 00010000:00010000:1.0:1746147257.072635:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147257.072651:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1956:x1830967465820928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 518us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.072657:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8034 00010000:00010000:3.0:1746147257.072784:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072791:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147257.072829:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147257.072833:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147257.072846:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072853:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072861:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072866:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072872:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072877:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bc000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147257.072880:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072885:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072893:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147257.072895:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147257.072898:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072902:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072915:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072920:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072924:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072928:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bd600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147257.072930:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072934:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072975:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473c00) 00010000:00010000:3.0:1746147257.072977:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147257.072979:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.072984:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad178a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.073014:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc600/0xb4b2209fbdad177c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.073026:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 17 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.073033:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 17 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.073038:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bdc00, rc 0) 00000100:00100000:3.0:1746147257.073328:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31980:x1830967465819648:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 10840us (10990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.073333:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11489 00000100:00100000:2.0:1746147257.074232:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465819904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9825us (9951us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.074241:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7499 00002000:00100000:2.0:1746147257.074251:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800936ded80 x1830967465819904/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.074260:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830967465819904 ext(0->1048575) 00002000:00010000:2.0:1746147257.074264:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ded80 00000100:00100000:0.0:1746147257.075343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.075389:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821056 00000100:00100000:0.0:1746147257.075389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.075397:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821056 00000100:00100000:3.0:1746147257.075439:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11491 00000100:00100000:3.0:1746147257.075444:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31980:x1830967465821056:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147257.075461:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.075476:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf69 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.075539:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147257.075543:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821184 00000100:00100000:1.0:1746147257.075547:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821184 00010000:00010000:3.0:1746147257.075549:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147257.075555:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.075560:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.075569:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147257.075576:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8035 00010000:00010000:3.0:1746147257.075578:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147257.075580:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:1959:x1830967465821184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.075587:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.075592:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.075652:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.075671:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad1791 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf5b expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.075682:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147257.075686:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147257.075692:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147257.075697:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147257.075702:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.075706:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.075710:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.075731:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147257.075758:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1959:x1830967465821184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 177us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.075764:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8035 00010000:00010000:2.0:1746147257.075772:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147257.075779:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147257.075864:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147257.076064:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad1798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 327 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.076077:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 326 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.076084:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 326 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.076089:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a0800, rc 0) 00000100:00100000:3.0:1746147257.076207:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+326:31982:x1830967465820672:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6976us (7282us total) trans 8589945504 rc 0/0 00000100:00100000:3.0:1746147257.076213:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11490 00000100:00100000:0.0:1746147257.081962:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.082299:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821312 00000100:00100000:1.0:1746147257.082310:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821312 00010000:00010000:1.0:1746147257.082455:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 326 pid: 14049 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746147257.082491:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8036 00000100:00100000:1.0:1746147257.082498:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1957:x1830967465821312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.082516:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.082522:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 326 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.082533:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 326 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.082554:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad179f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf62 expref: 326 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.082566:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147257.082572:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.082581:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.082677:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147257.083123:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147257.083177:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1957:x1830967465821312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 678us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.083184:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8036 00010000:00010000:3.0:1746147257.083345:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.083353:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147257.083394:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147257.083398:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147257.083412:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.083421:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.083446:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.083470:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.083477:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.083479:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147257.083481:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bce00, rc 0) 00000100:00100000:3.0:1746147257.083514:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31980:x1830967465821056:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8070us (8176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.083520:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11491 00000100:00100000:0.0:1746147257.088227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.088264:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.088305:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821440 00000100:00100000:0.0:1746147257.088305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.088316:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821440 00000100:00100000:2.0:1746147257.088360:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821568 00000100:00100000:2.0:1746147257.088362:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821568 00000100:00100000:2.0:1746147257.088371:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821696 00000100:00100000:2.0:1746147257.088372:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821696 00000100:00100000:2.0:1746147257.088385:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15776 00000100:00100000:2.0:1746147257.088391:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465821440:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147257.088409:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.088424:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf70 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.088448:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.088450:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.088459:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147257.088472:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15777 00010000:00010000:2.0:1746147257.088473:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147257.088480:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465821568:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147257.088484:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9c00, rc 0) 00010000:00010000:1.0:1746147257.088487:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147257.088495:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf77 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.088508:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.088509:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.088514:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147257.088523:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147257.088526:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465821440:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 135us (315us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147257.088530:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1a00, rc 0) 00000100:00100000:2.0:1746147257.088532:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15776 00000100:00100000:3.0:1746147257.088538:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15778 00000100:00100000:3.0:1746147257.088548:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465821696:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147257.088548:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465821568:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.088553:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15777 00010000:00010000:3.0:1746147257.088556:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.088565:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf7e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.088583:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.088584:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.088589:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.088600:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.088607:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bdc00, rc 0) 00000100:00100000:3.0:1746147257.088624:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465821696:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.088629:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15778 00000100:00100000:0.0:1746147257.089242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.089279:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465821952 00000100:00100000:0.0:1746147257.089281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.089283:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465821952 00002000:00100000:3.0:1746147257.089309:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800936df800 x1830967465821952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.089318:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830967465821952 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.089322:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:3.0:1746147257.089333:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465822208 00000100:00100000:3.0:1746147257.089334:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465822208 00002000:00100000:3.0:1746147257.089362:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800936df100 x1830967465822208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.089368:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df100 with x1830967465822208 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.089371:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df100 00000100:00100000:3.0:1746147257.089404:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7500 00000100:00100000:3.0:1746147257.089409:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465821952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147257.089432:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7501 00000100:00100000:1.0:1746147257.089439:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465822208:12345-192.168.203.36@tcp:3:cat.0 00000100:00080000:0.0:1746147257.089764:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147257.100446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.102630:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465822464 00000100:00100000:3.0:1746147257.102642:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465822464 00000100:00100000:3.0:1746147257.102882:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11492 00000100:00100000:3.0:1746147257.102891:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:31980:x1830967465822464:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147257.102903:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465821952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13492us (13659us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746147257.102911:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147257.102913:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7500 00002000:00100000:1.0:1746147257.102922:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800936df800 x1830967465821952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147257.102929:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc600/0xb4b2209fbdad17d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf85 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147257.102931:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830967465821952 ext(2097152->3145727) 00002000:00010000:1.0:1746147257.102951:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df800 00010000:00010000:3.0:1746147257.103225:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103238:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103249:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103260:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103266:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103271:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103358:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad17e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103365:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad17e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103375:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad17e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147257.103383:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147257.103454:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103459:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103465:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103470:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bd600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147257.103474:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103479:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103489:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147257.103492:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147257.103495:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103499:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad17d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103526:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103530:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103538:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103541:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bc000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147257.103543:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103547:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103553:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473e00) 00010000:00010000:3.0:1746147257.103555:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147257.103556:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103561:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad17de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.103593:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc600/0xb4b2209fbdad17d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf85 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.103602:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad17e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf85 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.103607:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.103609:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147257.103611:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd000, rc 0) 00000100:00100000:3.0:1746147257.103646:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31980:x1830967465822464:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 756us (3209us total) trans 8589945505 rc 0/0 00000100:00100000:3.0:1746147257.103651:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11492 00000100:00100000:0.0:1746147257.106236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.106627:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465822208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17186us (17343us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147257.106640:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7501 00002000:00100000:1.0:1746147257.106651:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800936df100 x1830967465822208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.106660:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df100 with x1830967465822208 ext(2097152->3145727) 00002000:00010000:1.0:1746147257.106666:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df100 00000100:00100000:3.0:1746147257.106739:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465822720 00000100:00100000:3.0:1746147257.106747:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465822720 00000100:00100000:3.0:1746147257.106782:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11493 00000100:00100000:3.0:1746147257.106788:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31980:x1830967465822720:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147257.106810:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.106827:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad17f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf8c expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.106913:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106926:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106960:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106971:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106976:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106982:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106987:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d59ce00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147257.106991:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.106997:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.107011:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.107014:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147257.107018:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.107022:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdad17fa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.107050:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad17f3 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf8c expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.107057:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad17f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf8c expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.107064:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd200, rc 0) 00000100:00100000:3.0:1746147257.107100:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31980:x1830967465822720:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 313us (874us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.107116:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11493 00000100:00100000:2.0:1746147257.113804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.113865:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465822848 00000100:00100000:2.0:1746147257.113874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.113874:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465822848 00000100:00100000:1.0:1746147257.113999:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 786 00000100:00100000:1.0:1746147257.114007:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:1957:x1830967465822848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.114022:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.114047:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad17e5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf85 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.114066:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147257.114071:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.114076:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465823104 00000100:00100000:3.0:1746147257.114080:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465823104 00000100:00100000:3.0:1746147257.114115:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4812 00000100:00100000:3.0:1746147257.114122:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31980:x1830967465823104:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147257.114122:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:1957:x1830967465822848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.114128:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 786 00000100:00100000:3.0:1746147257.114307:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:31980:x1830967465823104:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 185us (432us total) trans 8589945506 rc 0/0 00000100:00100000:3.0:1746147257.114313:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4812 00000100:00100000:0.0:1746147257.125302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.125693:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465823232 00000100:00100000:2.0:1746147257.125702:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465823232 00000100:00100000:2.0:1746147257.125744:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15779 00000100:00100000:2.0:1746147257.125750:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:31982:x1830967465823232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147257.125767:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.125783:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf93 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.125810:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.125818:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 8 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.125824:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.125829:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.125830:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.125833:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3207168->3665919] (req 3207168->3665919) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.125860:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.125869:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746147257.125884:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.127665:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 8 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.127678:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 8 pid: 8478 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746147257.127689:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074560:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.127727:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.127734:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 13 pid: 21080 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.127741:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074688:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.127761:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147257.133382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.133413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.133434:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465823488 00000100:00100000:1.0:1746147257.133442:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465823488 00010000:00010000:1.0:1746147257.133476:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 14 pid: 21080 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746147257.133501:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465823360 00000100:00100000:1.0:1746147257.133503:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465823360 00010000:00010000:1.0:1746147257.133527:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 9 pid: 8478 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746147257.133708:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074432:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.133718:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074560:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.133724:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074688:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.133750:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3207168->3665919] (req 3207168->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.133770:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8a00, rc 0) 00000100:00100000:0.0:1746147257.133798:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8037 00000100:00100000:0.0:1746147257.133808:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465823488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147257.133820:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147257.133842:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8038 00010000:00010000:0.0:1746147257.133842:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 14 pid: 21080 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.133851:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465823360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147257.133852:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 14 pid: 21080 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.133860:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147257.133887:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31982:x1830967465823232:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8137us (8593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.133894:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15779 00010000:00010000:0.0:1746147257.133904:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136966200/0xb4b2209fbdad1744 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf23 expref: 14 pid: 21080 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.133957:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 9 pid: 8478 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.133965:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 9 pid: 8478 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.133975:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bdc00/0xb4b2209fbdad17c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf7e expref: 9 pid: 8478 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.133992:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.134010:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465823360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 161us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.134016:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8038 00010000:00010000:0.0:1746147257.134311:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147257.134376:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465823488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 569us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.134383:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8037 00000100:00100000:1.0:1746147257.138326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.138583:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465823616 00000100:00100000:0.0:1746147257.138592:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465823616 00010000:00010000:0.0:1746147257.138628:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 744 lvb_type: 1 00000100:00100000:0.0:1746147257.138715:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8039 00000100:00100000:0.0:1746147257.138723:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465823616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147257.138737:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147257.138757:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746147257.138773:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746147257.138796:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d54400/0xb4b2209fbdad1752 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf38 expref: 24 pid: 4444 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746147257.138880:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147257.138882:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147257.138891:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.138899:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.139460:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147257.139474:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467074816:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147257.139548:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.141636:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467074816:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147257.141656:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.141705:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465823616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2982us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.141713:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8039 00000100:00100000:0.0:1746147257.142025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.142043:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465823872 00000100:00100000:2.0:1746147257.142049:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465823872 00002000:00100000:2.0:1746147257.142083:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3207168->3211263) req@ffff88009b6b9180 x1830967465823872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.142092:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9180 with x1830967465823872 ext(3207168->3211263) 00002000:00010000:2.0:1746147257.142097:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b9180 00000100:00100000:2.0:1746147257.142131:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7502 00000100:00100000:2.0:1746147257.142138:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465823872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147257.142389:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465823872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 251us (365us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147257.142395:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7502 00002000:00100000:2.0:1746147257.142401:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3207168->3211263) req@ffff88009b6b9180 x1830967465823872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.142407:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9180 with x1830967465823872 ext(3207168->3211263) 00002000:00010000:2.0:1746147257.142411:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b9180 00000100:00100000:0.0:1746147257.146089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.146174:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465824128 00000100:00100000:2.0:1746147257.146185:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465824128 00002000:00100000:2.0:1746147257.146234:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3661824->3665919) req@ffff88009b6bb480 x1830967465824128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.146244:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967465824128 ext(3661824->3665919) 00002000:00010000:2.0:1746147257.146249:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:2.0:1746147257.146281:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7503 00000100:00100000:2.0:1746147257.146289:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465824128:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147257.146486:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465824128:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 197us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147257.146494:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7503 00002000:00100000:2.0:1746147257.146499:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3661824->3665919) req@ffff88009b6bb480 x1830967465824128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.146506:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967465824128 ext(3661824->3665919) 00002000:00010000:2.0:1746147257.146508:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:0.0:1746147257.148178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.148241:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465824384 00000100:00100000:3.0:1746147257.148248:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465824384 00000100:00100000:3.0:1746147257.148297:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4813 00000100:00100000:3.0:1746147257.148304:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:31982:x1830967465824384:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147257.148505:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+326:31982:x1830967465824384:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 201us (332us total) trans 8589945507 rc 0/0 00000100:00100000:3.0:1746147257.148511:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4813 00000100:00100000:0.0:1746147257.237063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.237170:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465824512 00000100:00100000:2.0:1746147257.237180:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465824512 00000100:00100000:2.0:1746147257.237233:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15780 00000100:00100000:2.0:1746147257.237240:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465824512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.237259:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.237274:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9000/0xb4b2209fbdad1808 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecf9a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.237326:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074944:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.237429:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fb40 going to sleep for 11 seconds 00002000:00010000:2.0:1746147257.238496:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147255 -> 1746147256 00000100:00100000:2.0:1746147257.238521:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467074944:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147257.238548:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9000/0xb4b2209fbdad1808 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf9a expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.238560:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b9000/0xb4b2209fbdad1808 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf9a expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.238583:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9000, rc 0) 00000100:00100000:2.0:1746147257.238629:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465824512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1388us (1575us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147257.238635:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15780 00000100:00100000:0.0:1746147257.246131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.246203:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465824640 00000100:00100000:2.0:1746147257.246214:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465824640 00000100:00100000:2.0:1746147257.246264:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15781 00000100:00100000:2.0:1746147257.246273:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31988:x1830967465824640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.246293:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.246311:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfa1 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.246338:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 22 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.246343:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147257.246345:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147257.246348:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.246374:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 22 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.246383:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 22 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.246392:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075072:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.246475:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.252105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.252171:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465824768 00000100:00100000:1.0:1746147257.252180:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465824768 00002000:00100000:1.0:1746147257.252229:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3207168->3665919) req@ffff88009b6b8380 x1830967465824768/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.252239:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8380 with x1830967465824768 ext(3207168->3665919) 00010000:00010000:1.0:1746147257.252248:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 23 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.252262:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 23 pid: 11147 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746147257.252271:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b8380 00000100:00100000:1.0:1746147257.252307:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2577 00000100:00100000:1.0:1746147257.252315:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465824768:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147257.252383:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075072:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.252409:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.252422:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8c00, rc 0) 00000100:00100000:2.0:1746147257.252465:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:31988:x1830967465824640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6194us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.252472:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15781 00000100:00100000:0.0:1746147257.253068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.253100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.253130:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465824896 00000100:00100000:0.0:1746147257.253133:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465824896 00000100:00100000:2.0:1746147257.253462:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465825024 00000100:00100000:2.0:1746147257.253466:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465825024 00000100:00100000:2.0:1746147257.253483:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15782 00000100:00100000:2.0:1746147257.253489:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465824896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.253500:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.253513:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfa8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.253534:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.253535:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.253543:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 33 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.253555:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 33 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.253563:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8800, rc 0) 00000100:00100000:2.0:1746147257.253582:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465824896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 94us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.253587:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15782 00000100:00100000:2.0:1746147257.253599:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15783 00000100:00100000:2.0:1746147257.253603:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465825024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.253609:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.253616:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8200/0xb4b2209fbdad181d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfaf expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.253647:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075200:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.253692:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.256629:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075200:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.256666:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8200/0xb4b2209fbdad181d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfaf expref: 26 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.256685:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8200/0xb4b2209fbdad181d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfaf expref: 26 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.256714:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8200, rc 0) 00000100:00100000:3.0:1746147257.256755:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967465825024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3150us (3653us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.256763:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15783 00000100:00100000:1.0:1746147257.259625:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465824768:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7302us (7521us total) trans 21474841404 rc 0/0 00000100:00100000:1.0:1746147257.259636:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2577 00002000:00100000:1.0:1746147257.259647:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3207168->3665919) req@ffff88009b6b8380 x1830967465824768/t21474841404(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.259657:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8380 with x1830967465824768 ext(3207168->3665919) 00010000:00010000:1.0:1746147257.259666:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.259680:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746147257.259687:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b8380 00000100:00100000:0.0:1746147257.261163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.261226:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465825280 00000100:00100000:1.0:1746147257.261235:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465825280 00002000:00100000:1.0:1746147257.261270:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b6b9500 x1830967465825280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.261278:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9500 with x1830967465825280 ext(0->1048575) 00002000:00010000:1.0:1746147257.261282:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9500 00000100:00100000:1.0:1746147257.261365:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7504 00000100:00100000:1.0:1746147257.261374:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465825280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147257.263552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.263918:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465825408 00000100:00100000:3.0:1746147257.263927:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465825408 00010000:00010000:3.0:1746147257.263990:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.264016:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8040 00000100:00100000:3.0:1746147257.264023:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465825408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.264034:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.264054:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.264067:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.264089:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8a00/0xb4b2209fbdad1801 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3665919) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf93 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.264119:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.264122:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.264129:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.264137:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.264170:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.264182:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467075328:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.264240:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147257.266133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.266173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.266220:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465825664 00000100:00100000:0.0:1746147257.266227:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465825664 00000100:00100000:0.0:1746147257.266258:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465825920 00000100:00100000:0.0:1746147257.266260:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465825920 00000100:00100000:0.0:1746147257.266276:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11494 00000100:00100000:0.0:1746147257.266281:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+326:31995:x1830967465825664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147257.266302:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147257.266317:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdad1824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfb6 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.266406:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147257.266419:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.266426:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147257.266451:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.266462:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 18 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746147257.266472:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467075456:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147257.266528:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.266578:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11495 00000100:00100000:3.0:1746147257.266585:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+36:31994:x1830967465825920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147257.266595:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.266602:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad1832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfbd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.266636:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.266642:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.266649:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147257.268036:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467075328:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.268052:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.268706:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465825408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4681us (5158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.268716:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8040 00000100:00100000:2.0:1746147257.269726:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465825280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8351us (8565us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.269735:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7504 00002000:00100000:2.0:1746147257.269746:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b6b9500 x1830967465825280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.269761:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9500 with x1830967465825280 ext(0->1048575) 00002000:00010000:2.0:1746147257.269767:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9500 00000100:00100000:0.0:1746147257.270549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.270738:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467075456:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.270757:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147257.270841:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465826048 00000100:00100000:3.0:1746147257.270847:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465826048 00010000:00010000:3.0:1746147257.270870:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.270899:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8041 00000100:00100000:3.0:1746147257.270907:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:1956:x1830967465826048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.270918:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.270923:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.270952:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.270973:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bce00/0xb4b2209fbdad17ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf69 expref: 19 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.271431:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.271437:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147257.271446:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147257.271453:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147257.271464:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.271469:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.271474:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147257.271609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147257.272029:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.272036:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147257.272056:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147257.272207:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad1832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 39 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147257.272434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147257.272582:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.272633:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1956:x1830967465826048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1726us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.272641:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8041 00000100:00100000:3.0:1746147257.272669:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465826304 00000100:00100000:3.0:1746147257.272673:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465826304 00002000:00100000:3.0:1746147257.272701:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012db2c700 x1830967465826304/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.272710:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c700 with x1830967465826304 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.272719:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2c700 00000100:00100000:3.0:1746147257.272731:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465826560 00000100:00100000:3.0:1746147257.272733:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465826560 00002000:00100000:3.0:1746147257.272744:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012db2d880 x1830967465826560/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.272750:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d880 with x1830967465826560 ext(3145728->4194303) 00002000:00010000:3.0:1746147257.272752:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d880 00010000:00010000:2.0:1746147257.272795:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 38 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.272803:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147257.272805:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147257.272808:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd200, rc 0) 00010000:00010000:2.0:1746147257.272821:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147257.272827:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147257.272838:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147257.272893:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdad1824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.272905:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 328 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.272910:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7505 00010000:00010000:2.0:1746147257.272911:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147257.272913:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147257.272915:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50ce00, rc 0) 00000100:00100000:3.0:1746147257.272917:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465826304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147257.272953:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:31995:x1830967465825664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6671us (6825us total) trans 8589945509 rc 0/0 00000100:00100000:2.0:1746147257.272960:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11494 00000100:00100000:2.0:1746147257.272986:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+38:31994:x1830967465825920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6403us (6813us total) trans 8589945508 rc 0/0 00000100:00100000:2.0:1746147257.272992:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11495 00000100:00100000:2.0:1746147257.273009:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7506 00000100:00100000:2.0:1746147257.273015:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465826560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147257.278776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.279308:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465826688 00000100:00100000:3.0:1746147257.279319:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465826688 00000100:00100000:3.0:1746147257.279379:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15784 00000100:00100000:3.0:1746147257.279388:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:31991:x1830967465826688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.279408:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.279425:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfc4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.279449:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.279451:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.279458:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.279472:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.279482:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd600, rc 0) 00000100:00100000:3.0:1746147257.280578:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31991:x1830967465826688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1187us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.280586:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15784 00000100:00100000:3.0:1746147257.285447:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465826304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12521us (13828us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147257.285460:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7505 00002000:00100000:3.0:1746147257.285473:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012db2c700 x1830967465826304/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.285483:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c700 with x1830967465826304 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.285490:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2c700 00000100:00100000:2.0:1746147257.288739:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465826560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15714us (16294us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.288752:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7506 00002000:00100000:2.0:1746147257.288763:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012db2d880 x1830967465826560/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.288773:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d880 with x1830967465826560 ext(3145728->4194303) 00002000:00010000:2.0:1746147257.288780:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d880 00000100:00100000:0.0:1746147257.291438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.291489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.291572:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465826944 00000100:00100000:2.0:1746147257.291582:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465826944 00002000:00100000:2.0:1746147257.291626:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012db2f480 x1830967465826944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.291636:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2f480 with x1830967465826944 ext(2097152->3145727) 00002000:00010000:2.0:1746147257.291641:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2f480 00000100:00100000:2.0:1746147257.291658:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827200 00000100:00100000:2.0:1746147257.291660:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827200 00002000:00100000:2.0:1746147257.291670:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012db2c380 x1830967465827200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.291676:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c380 with x1830967465827200 ext(3145728->4194303) 00002000:00010000:2.0:1746147257.291679:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2c380 00000100:00100000:2.0:1746147257.291689:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7507 00000100:00100000:2.0:1746147257.291695:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465826944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147257.293069:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7508 00000100:00100000:2.0:1746147257.293079:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465827200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147257.314597:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465826944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22890us (23156us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.314609:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7507 00002000:00100000:2.0:1746147257.314620:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012db2f480 x1830967465826944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.314629:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2f480 with x1830967465826944 ext(2097152->3145727) 00002000:00010000:2.0:1746147257.314635:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2f480 00000100:00100000:3.0:1746147257.315754:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465827200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22673us (24260us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147257.315762:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7508 00002000:00100000:3.0:1746147257.315768:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012db2c380 x1830967465827200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.315776:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c380 with x1830967465827200 ext(3145728->4194303) 00002000:00010000:3.0:1746147257.315780:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2c380 00000100:00100000:0.0:1746147257.368855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.369223:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827328 00000100:00100000:3.0:1746147257.369234:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827328 00000100:00100000:3.0:1746147257.369299:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15785 00000100:00100000:3.0:1746147257.369306:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31995:x1830967465827328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147257.369326:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.369343:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfcb expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.369374:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.369383:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 7 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.369390:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.369395:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.369397:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.369400:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.369430:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.369440:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 13 pid: 4444 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147257.369453:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075584:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.370526:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 7 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.370537:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 7 pid: 17548 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147257.370546:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075712:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.370582:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.370590:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.370692:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075840:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.370715:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.372303:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075584:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.372314:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075712:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.372322:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467075840:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.372349:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.372365:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bc000, rc 0) 00000100:00100000:3.0:1746147257.372432:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31995:x1830967465827328:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3126us (3586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.372439:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15785 00000100:00100000:0.0:1746147257.375247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.375287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.375330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.376594:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827584 00000100:00100000:1.0:1746147257.376605:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827584 00000100:00100000:3.0:1746147257.376678:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827456 00000100:00100000:3.0:1746147257.376682:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827456 00000100:00100000:2.0:1746147257.376686:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827712 00000100:00100000:2.0:1746147257.376690:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827712 00010000:00010000:3.0:1746147257.376700:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 8 pid: 17548 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746147257.376706:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.376740:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8042 00000100:00100000:3.0:1746147257.376747:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465827456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.376760:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147257.376764:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8043 00000100:00100000:2.0:1746147257.376768:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465827712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147257.376775:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.376781:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 8 pid: 17548 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746147257.376782:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.376791:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.376801:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 14 pid: 4444 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746147257.376827:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8044 00000100:00100000:1.0:1746147257.376832:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465827584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.376838:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.376860:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 8 pid: 17548 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746147257.376890:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8ed600/0xb4b2209fbdad12a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc2f expref: 26 pid: 17530 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.376910:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.376973:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465827712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 203us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.376980:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8043 00010000:00010000:1.0:1746147257.377025:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 14 pid: 4444 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.377033:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 14 pid: 4444 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.377045:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee64000/0xb4b2209fbdad12ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc44 expref: 14 pid: 4444 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.377062:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147257.377079:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465827584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 248us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.377084:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8044 00010000:00010000:3.0:1746147257.377186:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ed400/0xb4b2209fbdad1426 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecce5 expref: 8 pid: 17548 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.377199:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.377200:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.377207:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.377215:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.377246:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.377256:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467075968:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.377489:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.380810:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467075968:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.380833:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.380878:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465827456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4131us (5589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.380890:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8042 00000100:00100000:0.0:1746147257.382620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.382739:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827840 00000100:00100000:3.0:1746147257.382748:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827840 00000100:00100000:3.0:1746147257.382804:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15786 00000100:00100000:3.0:1746147257.382811:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:31995:x1830967465827840:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147257.382829:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.382846:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfd2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.382881:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.382890:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 6 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.382897:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.382904:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.382905:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.382909:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1048576->1331199] (req 1048576->1331199) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.382980:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.382992:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147257.383004:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076096:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.383092:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 6 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.383100:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 6 pid: 4445 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147257.383121:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076224:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.383145:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.383152:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 12 pid: 8480 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.383159:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076352:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.383175:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.386153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.386155:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076096:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.386166:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076224:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.386175:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076352:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.386207:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1048576->1331199] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.386218:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465827968 00000100:00100000:3.0:1746147257.386224:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465827968 00010000:00010000:2.0:1746147257.386228:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd000, rc 0) 00010000:00010000:3.0:1746147257.386257:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 7 pid: 4445 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746147257.386272:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:31995:x1830967465827840:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3461us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.386280:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15786 00000100:00100000:3.0:1746147257.386282:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8045 00000100:00100000:3.0:1746147257.386287:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465827968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.386298:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.386320:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 7 pid: 4445 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.386329:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 7 pid: 4445 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.386349:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5d600/0xb4b2209fbdad15d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece0b expref: 7 pid: 4445 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.386360:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.386376:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465827968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.386382:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8045 00000100:00100000:0.0:1746147257.386855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.386887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.386956:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828096 00000100:00100000:3.0:1746147257.386959:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828096 00010000:00010000:3.0:1746147257.386971:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147257.386998:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828224 00000100:00100000:3.0:1746147257.387000:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828224 00010000:00010000:3.0:1746147257.387016:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 13 pid: 8480 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.387029:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8046 00000100:00100000:3.0:1746147257.387034:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465828096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.387040:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.387050:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.387058:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.387068:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdad1576 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdda expref: 26 pid: 8478 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147257.387082:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.387101:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465828096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.387136:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8046 00000100:00100000:3.0:1746147257.387146:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8047 00000100:00100000:3.0:1746147257.387151:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465828224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.387157:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.387164:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 13 pid: 8480 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.387172:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 13 pid: 8480 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.387184:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093855a00/0xb4b2209fbdad1568 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecdcc expref: 13 pid: 8480 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.387192:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.387194:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.387200:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.387308:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.387339:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.387352:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467076480:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.387689:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.390213:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467076480:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.390240:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.390295:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465828224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3142us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.390307:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8047 00000100:00100000:0.0:1746147257.392169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.392278:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828480 00000100:00100000:3.0:1746147257.392287:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828480 00002000:00100000:3.0:1746147257.392331:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1327104->1331199) req@ffff88012db2e680 x1830967465828480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.392340:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e680 with x1830967465828480 ext(1327104->1331199) 00002000:00010000:3.0:1746147257.392345:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2e680 00000100:00100000:3.0:1746147257.392378:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7509 00000100:00100000:3.0:1746147257.392385:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465828480:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147257.392555:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465828480:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 170us (392us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147257.392562:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7509 00002000:00100000:3.0:1746147257.392567:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1327104->1331199) req@ffff88012db2e680 x1830967465828480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.392575:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e680 with x1830967465828480 ext(1327104->1331199) 00002000:00010000:3.0:1746147257.392577:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2e680 00000100:00100000:0.0:1746147257.421003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.421268:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828608 00000100:00100000:2.0:1746147257.421278:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828608 00000100:00100000:0.0:1746147257.421280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.421328:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828736 00000100:00100000:2.0:1746147257.421330:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828736 00000100:00100000:3.0:1746147257.421338:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15787 00000100:00100000:3.0:1746147257.421350:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465828608:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147257.421354:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15788 00000100:00100000:2.0:1746147257.421360:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465828736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.421368:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.421368:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.421385:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ef9000/0xb4b2209fbdad186a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfd9 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.421385:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad1863 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfe0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.421435:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467076736:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.421435:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076608:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.421527:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.421533:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00002000:00010000:2.0:1746147257.423404:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147255 -> 1746147257 00002000:00010000:2.0:1746147257.423420:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147255 -> 1746147257 00002000:00010000:2.0:1746147257.423422:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147255 -> 1746147257 00000100:00100000:2.0:1746147257.423441:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467076608:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147257.423466:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad1863 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe0 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.423477:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d63a200/0xb4b2209fbdad1863 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe0 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.423492:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d63a200, rc 0) 00000100:00100000:2.0:1746147257.423536:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465828736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2175us (2256us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147257.423543:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15788 00002000:00010000:3.0:1746147257.423682:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147254 -> 1746147257 00002000:00010000:3.0:1746147257.423685:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147254 -> 1746147257 00002000:00010000:3.0:1746147257.423686:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime: 1746147254 -> 1746147257 00000100:00100000:3.0:1746147257.423695:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467076736:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.423831:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ef9000/0xb4b2209fbdad186a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd9 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.423843:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ef9000/0xb4b2209fbdad186a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd9 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.423863:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ef9000, rc 0) 00000100:00100000:3.0:1746147257.423894:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465828608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2548us (2900us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.423900:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15787 00000100:00100000:2.0:1746147257.427005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.427515:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828864 00000100:00100000:3.0:1746147257.427525:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828864 00000100:00100000:3.0:1746147257.427576:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15789 00000100:00100000:3.0:1746147257.427583:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:31994:x1830967465828864:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147257.427601:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.427618:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfe7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.427646:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.427654:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.427660:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.427662:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.427665:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2150400->3121151] (req 2150400->3121151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.427695:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.427706:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 24 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.427719:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467076864:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.427815:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.427824:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 13 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.427838:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467076992:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.427859:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.430492:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467076864:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.430506:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467076992:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.430541:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2150400->3121151] (req 2150400->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.430557:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ef8600, rc 0) 00000100:00100000:3.0:1746147257.430611:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:31994:x1830967465828864:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3028us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.430620:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15789 00000100:00100000:0.0:1746147257.434461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.434498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.434808:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465828992 00000100:00100000:3.0:1746147257.434818:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465828992 00000100:00100000:2.0:1746147257.434894:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465829120 00000100:00100000:2.0:1746147257.434899:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465829120 00010000:00010000:2.0:1746147257.434926:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 14 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.434934:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15790 00000100:00100000:3.0:1746147257.434966:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32001:x1830967465828992:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147257.434978:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8048 00000100:00100000:2.0:1746147257.434982:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465829120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.434983:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.434994:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.434997:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecfee expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.435014:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 15 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.435020:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.435024:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 15 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.435026:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.435028:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.435032:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.435040:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0xb4b2209fbdad180f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa1 expref: 15 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.435056:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.435066:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 24 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.435076:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467077120:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.435153:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.435492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147257.435843:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.435974:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465829120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 989us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.435984:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8048 00000100:00100000:2.0:1746147257.436553:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465829248 00000100:00100000:2.0:1746147257.436557:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465829248 00010000:00010000:2.0:1746147257.436574:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.436588:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8049 00000100:00100000:2.0:1746147257.436593:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465829248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147257.436601:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147257.436611:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.436620:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.436633:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad184e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfc4 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.436642:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.436644:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.436651:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.436658:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.436680:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.436689:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467077248:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147257.436723:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.438137:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467077120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.438165:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.438178:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ea00, rc 0) 00000100:00100000:3.0:1746147257.438214:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32001:x1830967465828992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3248us (3762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.438220:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15790 00000100:00100000:0.0:1746147257.439644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.439723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.439921:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465829504 00000100:00100000:3.0:1746147257.439929:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465829504 00000100:00100000:3.0:1746147257.440017:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15791 00000100:00100000:3.0:1746147257.440023:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465829504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.440040:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.440056:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad187f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecff5 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.440121:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467077376:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.440183:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467077248:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147257.440201:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.440738:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465829248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4143us (5245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.440747:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8049 00000100:00100000:3.0:1746147257.440752:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.440778:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465829376 00000100:00100000:2.0:1746147257.440781:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465829376 00002000:00100000:2.0:1746147257.440803:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1650688->2097151) req@ffff880134f86300 x1830967465829376/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.440813:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86300 with x1830967465829376 ext(1650688->2097151) 00010000:00010000:2.0:1746147257.440819:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 26 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.440829:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 26 pid: 11147 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.440836:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f86300 00000100:00100000:2.0:1746147257.440848:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2578 00000100:00100000:2.0:1746147257.440853:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465829376:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147257.440854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.440884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.440898:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465829888 00000100:00100000:0.0:1746147257.440900:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465829888 00002000:00100000:0.0:1746147257.440915:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2150400->2154495) req@ffff880134f84380 x1830967465829888/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.440923:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84380 with x1830967465829888 ext(2150400->2154495) 00002000:00010000:0.0:1746147257.440926:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84380 00000100:00100000:0.0:1746147257.440951:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7510 00000100:00100000:0.0:1746147257.440956:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465829888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147257.441068:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465829888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 111us (182us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147257.441073:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7510 00002000:00100000:0.0:1746147257.441077:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2150400->2154495) req@ffff880134f84380 x1830967465829888/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.441084:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84380 with x1830967465829888 ext(2150400->2154495) 00002000:00010000:0.0:1746147257.441086:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84380 00000100:00100000:3.0:1746147257.441231:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465829632 00000100:00100000:3.0:1746147257.441234:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465829632 00000100:00100000:3.0:1746147257.441252:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15792 00000100:00100000:3.0:1746147257.441257:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465829632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.441263:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.441272:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdad1886 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ecffc expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.441296:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467077504:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147257.441850:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.442639:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467077376:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.442665:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad187f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecff5 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.442676:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad187f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecff5 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.442699:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f600, rc 0) 00000100:00100000:3.0:1746147257.442996:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465829504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2971us (3271us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.443002:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15791 00002000:00010000:3.0:1746147257.443570:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147256 -> 1746147257 00002000:00010000:3.0:1746147257.443575:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147256 -> 1746147257 00002000:00010000:3.0:1746147257.443576:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147256 -> 1746147257 00000100:00100000:3.0:1746147257.443590:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467077504:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.443608:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdad1886 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecffc expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.443616:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdad1886 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecffc expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.443624:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99ea00, rc 0) 00000100:00100000:3.0:1746147257.444083:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465829632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2823us (3226us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.444090:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15792 00000100:00100000:2.0:1746147257.450247:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967465829376:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9382us (10597us total) trans 21474841405 rc 0/0 00000100:00100000:2.0:1746147257.450265:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2578 00002000:00100000:2.0:1746147257.450278:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1650688->2097151) req@ffff880134f86300 x1830967465829376/t21474841405(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.450288:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86300 with x1830967465829376 ext(1650688->2097151) 00010000:00010000:2.0:1746147257.450299:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 26 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.450316:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 26 pid: 11147 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.450323:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f86300 00000100:00100000:2.0:1746147257.451102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.451825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.452142:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465830272 00000100:00100000:3.0:1746147257.452151:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465830272 00000100:00100000:3.0:1746147257.452188:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15793 00000100:00100000:3.0:1746147257.452194:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:32004:x1830967465830272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.452211:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.452225:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed003 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.452249:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.452254:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.452264:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.452278:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99ec00, rc 0) 00000100:00100000:3.0:1746147257.453146:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32004:x1830967465830272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 948us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.453154:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15793 00000100:00100000:0.0:1746147257.453293:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465830144 00000100:00100000:0.0:1746147257.453298:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465830144 00002000:00100000:0.0:1746147257.453328:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3117056->3121151) req@ffff880134f31180 x1830967465830144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.453338:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31180 with x1830967465830144 ext(3117056->3121151) 00002000:00010000:0.0:1746147257.453342:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f31180 00000100:00100000:0.0:1746147257.453355:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7511 00000100:00100000:0.0:1746147257.453360:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465830144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.454445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.454625:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465830400 00000100:00100000:2.0:1746147257.454631:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465830400 00010000:00010000:2.0:1746147257.454654:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 27 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.454682:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8050 00000100:00100000:2.0:1746147257.454688:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465830400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147257.454697:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147257.454713:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 27 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.454724:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 27 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.454746:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bc000/0xb4b2209fbdad1855 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfcb expref: 27 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.454759:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.454760:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.454766:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.454773:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.454780:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.454781:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.454783:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.454789:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.454821:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.454831:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467077632:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147257.454907:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.454918:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467077760:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147257.454955:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.455175:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465830144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1812us (4071us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147257.455184:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7511 00002000:00100000:0.0:1746147257.455194:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3117056->3121151) req@ffff880134f31180 x1830967465830144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.455201:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31180 with x1830967465830144 ext(3117056->3121151) 00002000:00010000:0.0:1746147257.455206:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f31180 00000100:00100000:0.0:1746147257.461650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.461740:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465830656 00000100:00100000:1.0:1746147257.461751:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465830656 00002000:00100000:1.0:1746147257.461798:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f85500 x1830967465830656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.461809:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85500 with x1830967465830656 ext(1048576->2097151) 00002000:00010000:1.0:1746147257.461815:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85500 00000100:00100000:1.0:1746147257.461838:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7512 00000100:00100000:1.0:1746147257.461845:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465830656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147257.462012:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467077632:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147257.462023:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467077760:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147257.462048:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.462092:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465830400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7402us (7649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.462101:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8050 00000100:00100000:0.0:1746147257.465413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.465466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.465492:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465830912 00000100:00100000:0.0:1746147257.465500:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465830912 00002000:00100000:0.0:1746147257.465542:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f84e00 x1830967465830912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.465552:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84e00 with x1830967465830912 ext(1048576->2097151) 00002000:00010000:0.0:1746147257.465558:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84e00 00000100:00100000:0.0:1746147257.465574:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465831040 00000100:00100000:0.0:1746147257.465576:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465831040 00002000:00100000:0.0:1746147257.465586:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1331200->2097151) req@ffff880134f85180 x1830967465831040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.465592:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85180 with x1830967465831040 ext(1331200->2097151) 00002000:00010000:0.0:1746147257.465596:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85180 00000100:00100000:0.0:1746147257.465617:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7513 00000100:00100000:0.0:1746147257.465624:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465830912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147257.466789:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7514 00000100:00100000:1.0:1746147257.466798:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465831040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147257.482798:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465830912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17163us (17384us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.482812:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7513 00002000:00100000:2.0:1746147257.482825:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f84e00 x1830967465830912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.482834:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84e00 with x1830967465830912 ext(1048576->2097151) 00002000:00010000:2.0:1746147257.482840:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84e00 00000100:00100000:2.0:1746147257.483825:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465831040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17026us (18356us total) trans 0 rc 765952/765952 00000100:00100000:2.0:1746147257.483833:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7514 00002000:00100000:2.0:1746147257.483839:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1331200->2097151) req@ffff880134f85180 x1830967465831040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.483847:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85180 with x1830967465831040 ext(1331200->2097151) 00002000:00010000:2.0:1746147257.483850:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85180 00000100:00100000:2.0:1746147257.485163:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465830656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23311us (23515us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.485172:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7512 00002000:00100000:2.0:1746147257.485181:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f85500 x1830967465830656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.485188:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85500 with x1830967465830656 ext(1048576->2097151) 00002000:00010000:2.0:1746147257.485193:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85500 00000100:00100000:0.0:1746147257.489786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.490954:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465831296 00000100:00100000:3.0:1746147257.490966:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465831296 00000100:00100000:3.0:1746147257.491052:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15794 00000100:00100000:3.0:1746147257.491063:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32001:x1830967465831296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.491081:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.491103:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed00a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.491146:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.491153:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.491155:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.491159:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.491189:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.491200:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 25 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.491217:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467077888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.491606:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.492692:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467077888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.492711:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.492724:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477d400, rc 0) 00000100:00100000:3.0:1746147257.493054:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32001:x1830967465831296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1991us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.493061:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15794 00000100:00100000:0.0:1746147257.493433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.493564:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465831424 00000100:00100000:2.0:1746147257.493571:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465831424 00002000:00100000:2.0:1746147257.493608:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1331199) req@ffff880134f87480 x1830967465831424/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.493617:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87480 with x1830967465831424 ext(1048576->1331199) 00010000:00010000:2.0:1746147257.493623:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 26 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.493634:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 26 pid: 11147 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.493640:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f87480 00000100:00100000:2.0:1746147257.493668:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2579 00000100:00100000:2.0:1746147257.493674:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465831424:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147257.495274:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.495504:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465831552 00000100:00100000:3.0:1746147257.495511:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465831552 00000100:00100000:3.0:1746147257.495559:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15795 00000100:00100000:3.0:1746147257.495566:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32004:x1830967465831552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.495581:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.495601:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed011 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.495627:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.495636:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.495638:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.495642:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.495677:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.495689:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 13 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.495701:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467078016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.495799:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.497794:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465831424:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4112us (4354us total) trans 21474841406 rc 0/0 00000100:00100000:2.0:1746147257.497805:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2579 00002000:00100000:2.0:1746147257.497815:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1331199) req@ffff880134f87480 x1830967465831424/t21474841406(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.497825:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87480 with x1830967465831424 ext(1048576->1331199) 00010000:00010000:2.0:1746147257.497834:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 30 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.497846:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 30 pid: 11147 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.497852:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f87480 00000100:00100000:3.0:1746147257.501344:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467078016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.501370:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.501384:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5426e00, rc 0) 00000100:00100000:3.0:1746147257.501542:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32004:x1830967465831552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5976us (6272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.501550:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15795 00000100:00100000:0.0:1746147257.501667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.501748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.501811:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465831808 00000100:00100000:2.0:1746147257.501816:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465831808 00010000:00010000:2.0:1746147257.501838:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.501863:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8051 00000100:00100000:2.0:1746147257.501869:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465831808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147257.501877:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147257.501893:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.501902:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.501918:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd000/0xb4b2209fbdad185c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfd2 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.502158:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465831680 00000100:00100000:3.0:1746147257.502161:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465831680 00002000:00100000:3.0:1746147257.502181:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2150400->3121151) req@ffff880134f86680 x1830967465831680/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.502188:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86680 with x1830967465831680 ext(2150400->3121151) 00010000:00010000:3.0:1746147257.502194:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 14 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.502206:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 14 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.502211:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f86680 00010000:00010000:2.0:1746147257.502486:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.502488:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.502494:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.502501:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.502525:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.502535:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467078144:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.502770:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2580 00000100:00100000:3.0:1746147257.502778:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465831680:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147257.503546:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.508934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.509293:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467078144:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147257.509311:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.510753:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465831808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8879us (9000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.510762:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8051 00000100:00100000:2.0:1746147257.511339:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465832064 00000100:00100000:2.0:1746147257.511345:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465832064 00002000:00100000:2.0:1746147257.511374:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134f84700 x1830967465832064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.511383:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84700 with x1830967465832064 ext(1048576->2097151) 00002000:00010000:2.0:1746147257.511387:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84700 00000100:00100000:2.0:1746147257.511401:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7515 00000100:00100000:2.0:1746147257.511408:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465832064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.518532:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465831680:12345-192.168.203.36@tcp:4:cat.0 Request processed in 15746us (16857us total) trans 21474841407 rc 0/0 00000100:00100000:3.0:1746147257.518543:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2580 00002000:00100000:3.0:1746147257.518554:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2150400->3121151) req@ffff880134f86680 x1830967465831680/t21474841407(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.518563:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86680 with x1830967465831680 ext(2150400->3121151) 00010000:00010000:3.0:1746147257.518572:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 18 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.518585:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 18 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.518591:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134f86680 00000100:00100000:2.0:1746147257.521774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.521867:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465832064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10456us (12938us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147257.521876:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7515 00002000:00100000:0.0:1746147257.521885:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134f84700 x1830967465832064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.521894:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84700 with x1830967465832064 ext(1048576->2097151) 00002000:00010000:0.0:1746147257.521898:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f84700 00000100:00100000:3.0:1746147257.522042:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465832192 00000100:00100000:3.0:1746147257.522048:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465832192 00010000:00010000:3.0:1746147257.522070:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.522093:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8052 00000100:00100000:3.0:1746147257.522099:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967465832192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.522121:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.522138:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.522146:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.522163:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ef8600/0xb4b2209fbdad1871 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2150400->3121151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfe7 expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.522179:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.522180:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.522185:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.522193:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.522226:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.522236:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467078272:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.522280:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.527757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.527781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.527852:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465832576 00000100:00100000:2.0:1746147257.527859:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465832576 00002000:00100000:2.0:1746147257.527891:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134f87800 x1830967465832576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.527901:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87800 with x1830967465832576 ext(3145728->4194303) 00002000:00010000:2.0:1746147257.527905:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87800 00000100:00100000:2.0:1746147257.527916:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465832448 00000100:00100000:2.0:1746147257.527917:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465832448 00002000:00100000:2.0:1746147257.527924:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134f85c00 x1830967465832448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.527930:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85c00 with x1830967465832448 ext(2097152->3145727) 00002000:00010000:2.0:1746147257.527932:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85c00 00000100:00100000:2.0:1746147257.527955:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7516 00000100:00100000:2.0:1746147257.527961:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465832576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.528652:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467078272:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.528670:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.528707:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465832192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6608us (6938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.528716:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8052 00000100:00100000:0.0:1746147257.528830:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7517 00000100:00100000:0.0:1746147257.528837:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465832448:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147257.535856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.536025:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465832832 00000100:00100000:3.0:1746147257.536034:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465832832 00000100:00100000:3.0:1746147257.536459:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15796 00000100:00100000:3.0:1746147257.536468:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32001:x1830967465832832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.536485:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.536498:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed018 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.536520:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.536522:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.536528:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.536540:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.536549:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc400, rc 0) 00000100:00100000:3.0:1746147257.537977:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32001:x1830967465832832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1505us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.537984:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15796 00000100:00100000:0.0:1746147257.540680:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465832448:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11837us (12890us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147257.540689:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7517 00002000:00100000:0.0:1746147257.540697:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134f85c00 x1830967465832448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.540705:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85c00 with x1830967465832448 ext(2097152->3145727) 00002000:00010000:0.0:1746147257.540709:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f85c00 00000100:00100000:0.0:1746147257.543801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.543833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.543855:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465833088 00000100:00100000:2.0:1746147257.543862:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465833088 00002000:00100000:2.0:1746147257.543893:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012e2bbb80 x1830967465833088/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.543902:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bbb80 with x1830967465833088 ext(2097152->3145727) 00002000:00010000:2.0:1746147257.543906:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bbb80 00000100:00100000:2.0:1746147257.543980:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465833344 00000100:00100000:2.0:1746147257.543983:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465833344 00002000:00100000:2.0:1746147257.543995:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012e2ba680 x1830967465833344/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.544002:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba680 with x1830967465833344 ext(3145728->4194303) 00000100:00100000:3.0:1746147257.544010:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7518 00000100:00100000:3.0:1746147257.544019:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465833088:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:2.0:1746147257.544060:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba680 00000100:00100000:2.0:1746147257.544099:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7519 00000100:00100000:2.0:1746147257.544120:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465833344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.547871:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465832576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19901us (20113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147257.547881:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7516 00002000:00100000:3.0:1746147257.547892:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134f87800 x1830967465832576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.547900:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87800 with x1830967465832576 ext(3145728->4194303) 00002000:00010000:3.0:1746147257.547905:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87800 00000100:00100000:3.0:1746147257.552758:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465833088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8732us (8954us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147257.552769:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7518 00002000:00100000:3.0:1746147257.552778:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012e2bbb80 x1830967465833088/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.552792:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bbb80 with x1830967465833088 ext(2097152->3145727) 00002000:00010000:3.0:1746147257.552796:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bbb80 00000100:00100000:0.0:1746147257.558637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.558700:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465833472 00000100:00100000:3.0:1746147257.558708:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465833472 00000100:00100000:3.0:1746147257.558755:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15797 00000100:00100000:3.0:1746147257.558761:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465833472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.558775:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.558788:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed01f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.558805:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.558806:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.558813:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 29 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.558826:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 29 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.558835:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc600, rc 0) 00000100:00100000:3.0:1746147257.558884:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465833472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 122us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.558890:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15797 00000100:00100000:2.0:1746147257.559664:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465833344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15558us (15829us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.559669:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7519 00002000:00100000:2.0:1746147257.559675:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012e2ba680 x1830967465833344/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.559680:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba680 with x1830967465833344 ext(3145728->4194303) 00002000:00010000:2.0:1746147257.559683:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba680 00000100:00100000:0.0:1746147257.637305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.637398:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465833600 00000100:00100000:2.0:1746147257.637405:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465833600 00000100:00100000:2.0:1746147257.637501:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15798 00000100:00100000:2.0:1746147257.637508:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32009:x1830967465833600:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147257.637522:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.637536:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed026 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.637561:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.637569:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.637580:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.637582:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.637585:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.637608:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.637618:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 28 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.637629:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078400:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.638085:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.638094:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.638102:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078528:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.638474:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.640992:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078400:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.641002:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078528:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147257.641002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147257.641028:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.641047:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e59400, rc 0) 00000100:00100000:2.0:1746147257.641097:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32009:x1830967465833600:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3589us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.641100:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465833728 00000100:00100000:3.0:1746147257.641114:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465833728 00000100:00100000:2.0:1746147257.641117:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15798 00010000:00010000:3.0:1746147257.641137:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.641248:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8053 00000100:00100000:3.0:1746147257.641255:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465833728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.641264:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.641281:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.641291:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.641308:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdad188d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed003 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.641326:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.641347:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465833728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.641353:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8053 00000100:00100000:0.0:1746147257.642694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.642754:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465833856 00000100:00100000:1.0:1746147257.642759:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465833856 00010000:00010000:1.0:1746147257.642776:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746147257.642820:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8054 00000100:00100000:1.0:1746147257.642824:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465833856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.642831:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.642841:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.642848:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.642858:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1878 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfee expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.642876:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.642878:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.642884:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.642891:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.643000:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147257.643011:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467078656:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147257.643073:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.645431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.645468:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467078656:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147257.645484:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.645501:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465834112 00000100:00100000:3.0:1746147257.645507:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465834112 00000100:00100000:1.0:1746147257.645524:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465833856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2698us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.645533:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8054 00002000:00100000:3.0:1746147257.645540:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1863680->1867775) req@ffff88012db2dc00 x1830967465834112/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.645549:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2dc00 with x1830967465834112 ext(1863680->1867775) 00002000:00010000:3.0:1746147257.645552:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2dc00 00000100:00100000:3.0:1746147257.645580:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7520 00000100:00100000:3.0:1746147257.645585:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465834112:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147257.645706:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465834112:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 121us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147257.645712:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7520 00002000:00100000:3.0:1746147257.645717:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1863680->1867775) req@ffff88012db2dc00 x1830967465834112/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.645723:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2dc00 with x1830967465834112 ext(1863680->1867775) 00002000:00010000:3.0:1746147257.645726:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2dc00 00000100:00100000:0.0:1746147257.656256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.656492:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465834240 00000100:00100000:2.0:1746147257.656502:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465834240 00000100:00100000:2.0:1746147257.656563:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15799 00000100:00100000:2.0:1746147257.656570:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32009:x1830967465834240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147257.656587:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.656602:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed02d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.656626:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.656635:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.656640:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.656642:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.656645:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.656669:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.656683:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 27 pid: 11147 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746147257.656694:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.656792:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.656799:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.656806:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078912:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.656822:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.660602:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078784:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.660613:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467078912:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.660638:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.660652:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205e00, rc 0) 00000100:00100000:2.0:1746147257.660697:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32009:x1830967465834240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4126us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.660705:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15799 00000100:00100000:0.0:1746147257.661122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.661156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.661374:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465834368 00000100:00100000:1.0:1746147257.661374:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465834496 00000100:00100000:3.0:1746147257.661379:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465834368 00000100:00100000:1.0:1746147257.661379:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465834496 00010000:00010000:3.0:1746147257.661397:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 28 pid: 11147 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.661398:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.661421:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8055 00000100:00100000:3.0:1746147257.661426:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465834368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147257.661430:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8056 00000100:00100000:1.0:1746147257.661437:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465834496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.661440:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.661443:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.661456:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 28 pid: 11147 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.661456:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.661465:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 28 pid: 11147 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.661476:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.661492:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad18a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed01f expref: 28 pid: 11147 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746147257.661497:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad1894 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed00a expref: 17 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.661504:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.661506:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.661511:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.661517:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.661524:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147257.661538:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147257.661545:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465834496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.661548:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467079040:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147257.661551:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8056 00000100:00100000:3.0:1746147257.661597:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.663601:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467079040:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.663618:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.663657:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465834368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2229us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.663666:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8055 00000100:00100000:0.0:1746147257.668198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.668315:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465834752 00000100:00100000:3.0:1746147257.668325:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465834752 00002000:00100000:3.0:1746147257.668372:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1449984->1454079) req@ffff88008e919f80 x1830967465834752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.668383:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919f80 with x1830967465834752 ext(1449984->1454079) 00002000:00010000:3.0:1746147257.668388:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e919f80 00000100:00100000:3.0:1746147257.668777:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7521 00000100:00100000:3.0:1746147257.668784:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465834752:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147257.669423:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465834752:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 638us (1233us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147257.669429:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7521 00002000:00100000:3.0:1746147257.669436:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1449984->1454079) req@ffff88008e919f80 x1830967465834752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.669443:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919f80 with x1830967465834752 ext(1449984->1454079) 00002000:00010000:3.0:1746147257.669447:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e919f80 00000100:00100000:0.0:1746147257.687247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.687299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.687400:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465834880 00000100:00100000:2.0:1746147257.687411:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465834880 00000100:00100000:0.0:1746147257.688222:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465835008 00000100:00100000:0.0:1746147257.688226:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465835008 00000100:00100000:2.0:1746147257.688229:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15800 00000100:00100000:2.0:1746147257.688239:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465834880:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147257.688253:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15801 00000100:00100000:0.0:1746147257.688259:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465835008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.688261:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147257.688267:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.688278:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b204600/0xb4b2209fbdad18c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed034 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.688279:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad18be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed03b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.688329:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467079296:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147257.688329:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e91a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079168:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147257.688435:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.688439:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.690005:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467079296:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.690038:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b204600/0xb4b2209fbdad18c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed034 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.690052:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b204600/0xb4b2209fbdad18c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed034 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.690084:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b204600, rc 0) 00000100:00100000:3.0:1746147257.690128:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465834880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1890us (2892us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.690135:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15800 00000100:00100000:2.0:1746147257.690670:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e91a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079168:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147257.690687:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad18be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed03b expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.690696:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad18be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed03b expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.690708:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e600, rc 0) 00000100:00100000:2.0:1746147257.690739:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465835008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2480us (3440us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147257.690745:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15801 00000100:00100000:0.0:1746147257.695619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.695685:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465835136 00000100:00100000:2.0:1746147257.695695:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465835136 00000100:00100000:2.0:1746147257.695752:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15802 00000100:00100000:2.0:1746147257.695760:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32016:x1830967465835136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.695780:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.695797:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed042 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.695841:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.695848:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147257.695850:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147257.695853:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.695885:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.695896:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 15 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.695908:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079424:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.696040:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.697599:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079424:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.697624:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.697638:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205c00, rc 0) 00000100:00100000:2.0:1746147257.697670:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32016:x1830967465835136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1910us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.697678:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15802 00000100:00100000:0.0:1746147257.698132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.698328:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465835264 00000100:00100000:0.0:1746147257.698328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.698333:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465835264 00002000:00100000:3.0:1746147257.698366:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1863680->2097151) req@ffff88008e91bb80 x1830967465835264/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.698375:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91bb80 with x1830967465835264 ext(1863680->2097151) 00010000:00010000:3.0:1746147257.698381:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.698392:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.698398:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e91bb80 00000100:00100000:3.0:1746147257.698423:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465835520 00000100:00100000:3.0:1746147257.698426:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465835520 00002000:00100000:3.0:1746147257.698436:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1863679) req@ffff88008e91b480 x1830967465835520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147257.698436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147257.698442:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b480 with x1830967465835520 ext(1048576->1863679) 00010000:00010000:3.0:1746147257.698446:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.698454:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.698460:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e91b480 00000100:00100000:1.0:1746147257.699019:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465835776 00000100:00100000:3.0:1746147257.699023:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2581 00000100:00100000:1.0:1746147257.699023:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465835776 00000100:00100000:3.0:1746147257.699030:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465835264:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147257.699034:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2582 00002000:00100000:1.0:1746147257.699039:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1454080->2097151) req@ffff88008e918e00 x1830967465835776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147257.699043:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465835520:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:1.0:1746147257.699045:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918e00 with x1830967465835776 ext(1454080->2097151) 00002000:00010000:1.0:1746147257.699048:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e918e00 00000100:00100000:1.0:1746147257.699060:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7522 00000100:00100000:1.0:1746147257.699064:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465835776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.701816:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465835264:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2774us (3673us total) trans 21474841408 rc 0/0 00000100:00100000:3.0:1746147257.701828:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2581 00002000:00100000:3.0:1746147257.701839:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1863680->2097151) req@ffff88008e91bb80 x1830967465835264/t21474841408(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147257.701850:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91bb80 with x1830967465835264 ext(1863680->2097151) 00010000:00010000:3.0:1746147257.701861:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 22 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.701875:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 22 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746147257.701881:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e91bb80 00000100:00100000:2.0:1746147257.704582:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465835520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5528us (6240us total) trans 0 rc 815104/815104 00000100:00100000:2.0:1746147257.704596:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2582 00002000:00100000:2.0:1746147257.704607:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1863679) req@ffff88008e91b480 x1830967465835520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.704617:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b480 with x1830967465835520 ext(1048576->1863679) 00010000:00010000:2.0:1746147257.704628:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 20 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.704643:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 20 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.704650:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e91b480 00000100:00100000:1.0:1746147257.708789:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465835776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9716us (10344us total) trans 0 rc 643072/643072 00000100:00100000:1.0:1746147257.708799:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7522 00002000:00100000:1.0:1746147257.708809:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1454080->2097151) req@ffff88008e918e00 x1830967465835776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.708817:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918e00 with x1830967465835776 ext(1454080->2097151) 00002000:00010000:1.0:1746147257.708822:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e918e00 00000100:00100000:1.0:1746147257.714023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.714075:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465835904 00000100:00100000:3.0:1746147257.714087:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465835904 00010000:00010000:3.0:1746147257.714142:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 18 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.714181:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8057 00000100:00100000:3.0:1746147257.714189:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967465835904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.714205:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.714227:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 18 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.714239:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 18 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.714261:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e59400/0xb4b2209fbdad18b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed026 expref: 18 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.714294:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.714296:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.714304:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.714311:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.714347:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 27 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147257.714359:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467079552:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147257.714446:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.716808:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467079552:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147257.716832:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.716885:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1959:x1830967465835904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2696us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.716897:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8057 00000100:00100000:0.0:1746147257.717126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.717823:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836032 00000100:00100000:2.0:1746147257.717831:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836032 00000100:00100000:2.0:1746147257.717874:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15803 00000100:00100000:2.0:1746147257.717881:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465836032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.717899:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.717969:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed049 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.717994:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.717996:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147257.718003:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 18 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.718017:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 18 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.718031:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205a00, rc 0) 00000100:00100000:2.0:1746147257.718063:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465836032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 183us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.718068:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15803 00000100:00100000:0.0:1746147257.719366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.719451:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836288 00000100:00100000:1.0:1746147257.719466:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836288 00002000:00100000:1.0:1746147257.719520:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e918380 x1830967465836288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.719530:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918380 with x1830967465836288 ext(1048576->2097151) 00002000:00010000:1.0:1746147257.719535:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e918380 00000100:00100000:1.0:1746147257.719577:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7523 00000100:00100000:1.0:1746147257.719584:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465836288:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147257.729308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.729322:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465836288:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9731us (9956us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147257.729333:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7523 00002000:00100000:1.0:1746147257.729343:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e918380 x1830967465836288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.729352:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918380 with x1830967465836288 ext(1048576->2097151) 00002000:00010000:1.0:1746147257.729356:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e918380 00000100:00100000:3.0:1746147257.729466:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836416 00000100:00100000:3.0:1746147257.729475:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836416 00000100:00100000:3.0:1746147257.729511:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15804 00000100:00100000:3.0:1746147257.729518:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32011:x1830967465836416:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147257.729534:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.729550:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed050 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.729579:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.729587:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.729593:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.729595:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.729598:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2412544->3141631] (req 2412544->3141631) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.729630:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.729642:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 17 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.729653:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.730680:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.730693:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 29 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.730707:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079808:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.730741:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.733190:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079680:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147257.734320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.734428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.734515:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836544 00000100:00100000:2.0:1746147257.734524:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836544 00000100:00100000:2.0:1746147257.734579:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15805 00000100:00100000:2.0:1746147257.734586:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32016:x1830967465836544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.734606:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147257.734662:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836672 00000100:00100000:3.0:1746147257.734666:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836672 00010000:00010000:3.0:1746147257.734686:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 18 pid: 11147 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.734716:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8058 00000100:00100000:3.0:1746147257.734720:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967465836672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.734732:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.734752:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 18 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.734763:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 18 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.734784:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad18a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed018 expref: 18 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.734808:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.734847:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1958:x1830967465836672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.734853:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8058 00010000:00010000:2.0:1746147257.734891:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed057 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.734913:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.734919:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147257.734921:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147257.734924:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.734975:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.734985:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 16 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.735002:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467079936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.735056:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147257.736495:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467079808:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.736524:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2412544->3141631] (req 2412544->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 31 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.736537:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc000, rc 0) 00000100:00100000:3.0:1746147257.736566:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32011:x1830967465836416:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7048us (7270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.736574:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15804 00000100:00100000:0.0:1746147257.737435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.737472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.737527:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836800 00000100:00100000:1.0:1746147257.737534:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836800 00000100:00100000:2.0:1746147257.737535:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467079936:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.737555:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.737557:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 31 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.737565:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b204e00, rc 0) 00000100:00100000:2.0:1746147257.737599:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32016:x1830967465836544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3013us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.737606:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15805 00000100:00100000:2.0:1746147257.737639:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465836928 00000100:00100000:2.0:1746147257.737642:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465836928 00002000:00100000:2.0:1746147257.737667:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1454079) req@ffff88008e91a300 x1830967465836928/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.737675:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a300 with x1830967465836928 ext(1048576->1454079) 00010000:00010000:2.0:1746147257.737680:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.737689:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 17 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.737695:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e91a300 00000100:00100000:2.0:1746147257.737713:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2583 00000100:00100000:2.0:1746147257.737718:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465836928:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147257.737870:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8059 00000100:00100000:1.0:1746147257.737876:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465836800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.737885:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.737905:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 30 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.737914:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 30 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.737933:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5426e00/0xb4b2209fbdad189b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed011 expref: 30 pid: 11147 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.737975:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.737977:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.737984:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.737992:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.738017:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147257.738029:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467080064:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147257.738076:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147257.740729:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467080064:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147257.740755:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147257.740806:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465836800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2928us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.740816:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8059 00000100:00100000:2.0:1746147257.741245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.741774:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465837184 00000100:00100000:0.0:1746147257.741781:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465837184 00002000:00100000:0.0:1746147257.741820:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2412544->2416639) req@ffff88012db2f100 x1830967465837184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.741829:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2f100 with x1830967465837184 ext(2412544->2416639) 00002000:00010000:0.0:1746147257.741834:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2f100 00000100:00100000:0.0:1746147257.741865:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7524 00000100:00100000:0.0:1746147257.741871:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465837184:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147257.742047:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465837184:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 175us (803us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147257.742053:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7524 00002000:00100000:0.0:1746147257.742057:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2412544->2416639) req@ffff88012db2f100 x1830967465837184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147257.742064:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2f100 with x1830967465837184 ext(2412544->2416639) 00002000:00010000:0.0:1746147257.742067:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2f100 00000100:00100000:2.0:1746147257.744480:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465836928:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6752us (6997us total) trans 21474841409 rc 0/0 00000100:00100000:2.0:1746147257.744492:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2583 00002000:00100000:2.0:1746147257.744502:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1454079) req@ffff88008e91a300 x1830967465836928/t21474841409(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.744511:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a300 with x1830967465836928 ext(1048576->1454079) 00010000:00010000:2.0:1746147257.744521:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746147257.744537:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746147257.744544:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e91a300 00000100:00100000:0.0:1746147257.746653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.746724:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465837312 00000100:00100000:1.0:1746147257.746737:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465837312 00010000:00010000:1.0:1746147257.746768:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746147257.747048:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8060 00000100:00100000:1.0:1746147257.747056:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465837312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147257.747071:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147257.747091:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.747114:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.747138:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad18b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed02d expref: 19 pid: 8478 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746147257.747153:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.747155:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.747162:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.747169:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.747204:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147257.747221:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467080192:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147257.747303:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.748336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.748502:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465837568 00000100:00100000:2.0:1746147257.748508:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465837568 00002000:00100000:2.0:1746147257.748545:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3137536->3141631) req@ffff88009f152680 x1830967465837568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.748555:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152680 with x1830967465837568 ext(3137536->3141631) 00002000:00010000:2.0:1746147257.748560:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f152680 00000100:00100000:2.0:1746147257.748591:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7525 00000100:00100000:2.0:1746147257.748597:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465837568:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147257.749181:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465837568:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 582us (845us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147257.749191:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7525 00002000:00100000:2.0:1746147257.749197:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3137536->3141631) req@ffff88009f152680 x1830967465837568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.749205:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152680 with x1830967465837568 ext(3137536->3141631) 00002000:00010000:2.0:1746147257.749208:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f152680 00000100:00100000:2.0:1746147257.749534:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467080192:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147257.749549:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147257.749642:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967465837312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2586us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.749650:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8060 00000100:00100000:0.0:1746147257.752066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.752323:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465837824 00000100:00100000:1.0:1746147257.752332:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465837824 00002000:00100000:1.0:1746147257.752373:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f151c00 x1830967465837824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.752382:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151c00 with x1830967465837824 ext(1048576->2097151) 00002000:00010000:1.0:1746147257.752387:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f151c00 00000100:00100000:1.0:1746147257.752418:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7526 00000100:00100000:1.0:1746147257.752425:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465837824:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147257.761867:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465837824:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9430us (9796us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147257.761878:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7526 00002000:00100000:1.0:1746147257.761889:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f151c00 x1830967465837824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.761896:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151c00 with x1830967465837824 ext(1048576->2097151) 00002000:00010000:1.0:1746147257.761902:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f151c00 00000100:00100000:0.0:1746147257.774558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.774622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.774991:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838080 00000100:00100000:2.0:1746147257.775002:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838080 00002000:00100000:2.0:1746147257.775051:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3874815) req@ffff88009f152a00 x1830967465838080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 504/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.775061:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152a00 with x1830967465838080 ext(2097152->3874815) 00002000:00010000:2.0:1746147257.775067:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f152a00 00000100:00100000:2.0:1746147257.775090:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838336 00000100:00100000:2.0:1746147257.775093:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838336 00002000:00100000:2.0:1746147257.775118:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3874816->4194303) req@ffff88009f151f80 x1830967465838336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.775125:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151f80 with x1830967465838336 ext(3874816->4194303) 00002000:00010000:2.0:1746147257.775128:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f151f80 00000100:00100000:2.0:1746147257.775154:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7527 00000100:00100000:1.0:1746147257.775161:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7528 00000100:00100000:2.0:1746147257.775162:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465838080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147257.775170:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465838336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147257.781034:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465838336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5854us (6400us total) trans 0 rc 319488/319488 00000100:00100000:2.0:1746147257.781047:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7528 00002000:00100000:2.0:1746147257.781060:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3874816->4194303) req@ffff88009f151f80 x1830967465838336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 319488/319488 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.781070:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151f80 with x1830967465838336 ext(3874816->4194303) 00002000:00010000:2.0:1746147257.781076:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f151f80 00000100:00100000:2.0:1746147257.785128:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465838080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9955us (10570us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.785140:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7527 00002000:00100000:2.0:1746147257.785152:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3874815) req@ffff88009f152a00 x1830967465838080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 504/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.785161:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152a00 with x1830967465838080 ext(2097152->3874815) 00002000:00010000:2.0:1746147257.785167:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f152a00 00000100:00100000:0.0:1746147257.932095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.934509:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838464 00000100:00100000:2.0:1746147257.934519:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838464 00000100:00100000:2.0:1746147257.934592:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11496 00000100:00100000:2.0:1746147257.934600:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:32027:x1830967465838464:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147257.934622:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.934637:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad18e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed05e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.934684:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934699:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934707:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934718:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934722:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934727:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934821:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934831:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 327 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.934837:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 37 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.934842:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 5/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.934868:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 37 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.934878:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 37 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.934892:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080320:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.935022:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 327 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.935031:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 327 pid: 14049 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.935241:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080448:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.935379:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.938036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.938453:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838592 00000100:00100000:3.0:1746147257.938461:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838592 00000100:00100000:0.0:1746147257.938463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147257.938488:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 38 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746147257.938489:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838720 00000100:00100000:0.0:1746147257.938491:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838720 00010000:00010000:0.0:1746147257.938503:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 328 pid: 14049 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.938574:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080320:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.938582:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080448:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.938599:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147257.938792:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8061 00000100:00100000:0.0:1746147257.938796:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8062 00000100:00100000:3.0:1746147257.938799:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+38:1956:x1830967465838592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147257.938801:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+328:1956:x1830967465838720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.938810:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147257.938810:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.938814:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 38 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.938815:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 328 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.938822:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 328 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.938910:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 38 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.938931:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdad182b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfb6 expref: 328 pid: 14049 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.938986:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.938987:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd200/0xb4b2209fbdad1839 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfbd expref: 38 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.938990:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.939000:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.939005:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.939108:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.939111:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147257.939128:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.939150:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1956:x1830967465838592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 351us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147257.939150:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+327:1956:x1830967465838720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 348us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147257.939155:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8062 00010000:00010000:2.0:1746147257.939179:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939184:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147257.939219:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:2.0:1746147257.939222:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147257.939233:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939242:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939252:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939257:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939261:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939267:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309eda00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147257.939271:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939276:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939288:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147257.939290:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746147257.939293:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8061 00010000:00010000:2.0:1746147257.939293:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939297:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309eda00/0xb4b2209fbdad18ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939308:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939313:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939318:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939322:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309ecc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147257.939324:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939354:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939362:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76a00) 00010000:00010000:2.0:1746147257.939364:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147257.939366:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939371:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ecc00/0xb4b2209fbdad18f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.939396:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad18e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.939405:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.939410:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147257.939411:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147257.939413:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ece00, rc 0) 00000100:00100000:2.0:1746147257.939433:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:32027:x1830967465838464:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4835us (7351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.939439:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11496 00000100:00100000:0.0:1746147257.947409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.947458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.947491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.947557:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838976 00000100:00100000:1.0:1746147257.947566:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838976 00000100:00100000:1.0:1746147257.947672:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465839104 00000100:00100000:1.0:1746147257.947676:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465839104 00000100:00100000:1.0:1746147257.947691:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465838848 00000100:00100000:1.0:1746147257.947693:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465838848 00000100:00100000:1.0:1746147257.947710:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15806 00000100:00100000:1.0:1746147257.947717:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465838976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147257.947737:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147257.947790:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15807 00000100:00100000:2.0:1746147257.947801:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465839104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147257.947811:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.947832:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad1904 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed073 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.947895:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467080576:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147257.948008:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15808 00000100:00100000:3.0:1746147257.948019:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1958:x1830967465838848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147257.948029:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.948039:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed065 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.948053:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.948055:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.948065:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 7 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.948081:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 7 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.948093:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc800, rc 0) 00010000:00010000:1.0:1746147257.948131:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed06c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147257.948142:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.948144:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147257.948149:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147257.948159:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147257.948166:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a1600, rc 0) 00000100:00100000:0.0:1746147257.948168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.948465:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.948483:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465839232 00000100:00100000:2.0:1746147257.948486:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465839232 00000100:00100000:3.0:1746147257.948537:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465838848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 520us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.948543:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15808 00000100:00100000:3.0:1746147257.948562:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15809 00000100:00100000:3.0:1746147257.948566:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465839232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147257.948573:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.948579:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed07a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.948589:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.948590:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147257.948594:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.948603:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.948611:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dce00, rc 0) 00000100:00100000:0.0:1746147257.949057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.949155:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465838976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1438us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147257.949167:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15806 00000100:00100000:2.0:1746147257.949398:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465839360 00000100:00100000:2.0:1746147257.949404:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465839360 00000100:00100000:2.0:1746147257.949444:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15810 00000100:00100000:2.0:1746147257.949451:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465839360:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147257.949461:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.949471:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad1920 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed081 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.949509:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467080704:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.949555:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.949619:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465839232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1049us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147257.949625:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15809 00000100:00100000:3.0:1746147257.957264:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467080704:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.957304:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad1920 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed081 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.957319:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad1920 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed081 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147257.957346:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed800, rc 0) 00000100:00100000:3.0:1746147257.957393:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465839360:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7941us (8337us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147257.957402:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15810 00000100:00100000:2.0:1746147257.957737:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467080576:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147257.957753:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad1904 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed073 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.957762:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad1904 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed073 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.957777:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ec600, rc 0) 00000100:00100000:2.0:1746147257.957795:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465839104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9998us (10336us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147257.957800:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15807 00000100:00100000:1.0:1746147257.961539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.962180:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465839616 00000100:00100000:2.0:1746147257.962190:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465839616 00000100:00100000:2.0:1746147257.962248:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11497 00000100:00100000:2.0:1746147257.962257:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+19:32027:x1830967465839616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147257.962282:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.962301:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad1927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed088 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.962392:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.962404:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.962410:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.962437:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.962446:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 20 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746147257.962456:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080832:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147257.962535:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147257.970277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.970478:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080832:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.970510:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147257.971512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.971595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.971795:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840000 00000100:00100000:2.0:1746147257.971804:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840000 00002000:00100000:2.0:1746147257.971855:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009edcbb80 x1830967465840000/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.971866:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967465840000 ext(1048576->2097151) 00002000:00010000:2.0:1746147257.971871:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcbb80 00000100:00100000:2.0:1746147257.971915:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840128 00000100:00100000:2.0:1746147257.971920:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840128 00002000:00100000:2.0:1746147257.971960:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009edcb100 x1830967465840128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.971968:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb100 with x1830967465840128 ext(1048576->2097151) 00002000:00010000:2.0:1746147257.971972:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcb100 00000100:00100000:2.0:1746147257.971994:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7529 00000100:00100000:2.0:1746147257.972004:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465840000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147257.973275:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7530 00000100:00100000:1.0:1746147257.973288:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465840128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147257.973953:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465839744 00000100:00100000:3.0:1746147257.973960:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465839744 00010000:00010000:3.0:1746147257.973992:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 21 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.974018:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8063 00000100:00100000:3.0:1746147257.974023:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+21:1956:x1830967465839744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.974034:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.974039:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 21 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.974050:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 21 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.974073:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdad18fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed05e expref: 21 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.974092:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.974097:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.974118:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.974124:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.974153:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.974188:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:1956:x1830967465839744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 163us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.974194:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8063 00010000:00010000:2.0:1746147257.974207:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147257.974214:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147257.974232:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147257.975417:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec600/0xb4b2209fbdad1927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.975447:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147257.975455:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147257.975458:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147257.975460:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed800, rc 0) 00000100:00100000:2.0:1746147257.975485:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32027:x1830967465839616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 13231us (13957us total) trans 8589945510 rc 0/0 00000100:00100000:2.0:1746147257.975492:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11497 00000100:00100000:2.0:1746147257.981582:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465840000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9569us (10062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147257.981595:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7529 00002000:00100000:2.0:1746147257.981606:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009edcbb80 x1830967465840000/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147257.981616:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967465840000 ext(1048576->2097151) 00002000:00010000:2.0:1746147257.981623:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcbb80 00000100:00100000:2.0:1746147257.985454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.985559:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840384 00000100:00100000:3.0:1746147257.985572:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840384 00000100:00100000:3.0:1746147257.985643:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11498 00000100:00100000:3.0:1746147257.985650:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32027:x1830967465840384:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147257.985747:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.985766:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dda00/0xb4b2209fbdad193c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed08f expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.985845:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.985858:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.985864:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.985895:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.985906:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 21 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.985918:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080960:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147257.986036:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147257.986254:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465840128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12969us (14657us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147257.986264:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7530 00002000:00100000:1.0:1746147257.986273:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009edcb100 x1830967465840128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:633/0 lens 488/440 e 0 to 0 dl 1746147268 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.986282:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb100 with x1830967465840128 ext(1048576->2097151) 00002000:00010000:1.0:1746147257.986287:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcb100 00000100:00100000:3.0:1746147257.989771:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467080960:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.989934:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147257.990613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.990655:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840512 00000100:00100000:3.0:1746147257.990661:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840512 00010000:00010000:3.0:1746147257.990685:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 22 pid: 14125 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.990723:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8064 00000100:00100000:3.0:1746147257.990730:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+22:1956:x1830967465840512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147257.990741:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147257.990746:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 22 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.990755:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 22 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.990772:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdad192e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed088 expref: 22 pid: 14125 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147257.990796:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147257.990800:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.990808:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.990814:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147257.990829:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147257.990861:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+21:1956:x1830967465840512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 132us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.990866:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8064 00010000:00010000:0.0:1746147257.990889:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.990896:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147257.990930:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:0.0:1746147257.990933:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147257.990988:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.991010:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dda00/0xb4b2209fbdad193c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.991033:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.991043:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147257.991045:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147257.991047:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dcc00, rc 0) 00000100:00100000:0.0:1746147257.991069:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32027:x1830967465840384:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5420us (5622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147257.991076:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11498 00000100:00100000:0.0:1746147257.992312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147257.992554:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840640 00000100:00100000:2.0:1746147257.992559:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840640 00000100:00100000:2.0:1746147257.992597:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15811 00000100:00100000:2.0:1746147257.992603:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465840640:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147257.992613:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147257.992625:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e6eba00/0xb4b2209fbdad194a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed096 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.992659:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467081088:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147257.992721:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147257.994924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147257.995162:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840768 00000100:00100000:3.0:1746147257.995172:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840768 00000100:00100000:3.0:1746147257.995203:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15812 00000100:00100000:3.0:1746147257.995208:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32030:x1830967465840768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147257.995222:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147257.995235:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed09d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.995301:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.995309:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.995311:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147257.995314:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147257.995326:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467081088:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147257.995336:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.995346:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 28 pid: 8480 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147257.995355:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467081216:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147257.995358:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e6eba00/0xb4b2209fbdad194a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed096 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.995369:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e6eba00/0xb4b2209fbdad194a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed096 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147257.995392:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6eba00, rc 0) 00000100:00100000:3.0:1746147257.995436:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147257.995463:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465840640:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2859us (3152us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147257.995469:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15811 00000100:00100000:3.0:1746147257.997375:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467081216:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147257.997395:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147257.997412:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd600, rc 0) 00000100:00100000:3.0:1746147257.997448:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32030:x1830967465840768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2239us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147257.997454:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15812 00000100:00100000:0.0:1746147257.998681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147257.998717:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147257.998731:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465840896 00000100:00100000:0.0:1746147257.998732:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465841152 00000100:00100000:1.0:1746147257.998737:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465840896 00000100:00100000:0.0:1746147257.998737:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465841152 00002000:00100000:1.0:1746147257.998765:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2412544->3141631) req@ffff88008e977b80 x1830967465840896/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/0 e 0 to 0 dl 1746147268 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147257.998773:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977b80 with x1830967465840896 ext(2412544->3141631) 00000100:00100000:0.0:1746147257.998777:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11499 00010000:00010000:1.0:1746147257.998780:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 29 pid: 8480 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746147257.998783:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32027:x1830967465841152:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147257.998791:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 29 pid: 8480 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147257.998794:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746147257.998797:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e977b80 00010000:00010000:0.0:1746147257.998806:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad1958 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0a4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147257.998810:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2584 00000100:00100000:1.0:1746147257.998815:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465840896:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147257.998874:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998886:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998894:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998904:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998909:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998914:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998923:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8c7800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147257.998926:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998931:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998961:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147257.998964:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147257.998967:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998971:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad195f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147257.998993:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad1958 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0a4 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.998998:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad1958 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0a4 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147257.999004:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6e00, rc 0) 00000100:00100000:0.0:1746147257.999035:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32027:x1830967465841152:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 253us (317us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147257.999041:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11499 00000100:00100000:2.0:1746147258.001676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.001747:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465841408 00000100:00100000:3.0:1746147258.001754:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465841408 00000100:00100000:3.0:1746147258.001825:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4814 00000100:00100000:3.0:1746147258.001833:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32027:x1830967465841408:12345-192.168.203.36@tcp:35:lfs.0 00000100:00080000:1.0:1746147258.001961:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147258.002046:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+21:32027:x1830967465841408:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 213us (373us total) trans 8589945511 rc 0/0 00000100:00100000:3.0:1746147258.002052:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4814 00000100:00100000:0.0:1746147258.007335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.007802:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465841536 00000100:00100000:3.0:1746147258.007811:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465841536 00000100:00100000:3.0:1746147258.007872:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15813 00000100:00100000:3.0:1746147258.007880:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:32024:x1830967465841536:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147258.007900:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.007915:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0ab expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.007967:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.007985:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 7 pid: 8480 timeout: 0 lvb_type: 1 00000100:00080000:1.0:1746147258.008028:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746147258.009385:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.009392:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.009394:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.009398:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.009431:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.009442:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147258.009456:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467081344:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.009579:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 7 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.009588:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 7 pid: 8480 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147258.009596:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467081472:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.009633:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.009648:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 19 pid: 21080 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147258.009656:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467081600:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.009680:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147258.010735:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147258.011402:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467081344:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.011416:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467081472:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.011425:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467081600:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.011452:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.011466:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd400, rc 0) 00000100:00100000:3.0:1746147258.011668:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:32024:x1830967465841536:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3785us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.011677:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15813 00000100:00100000:0.0:1746147258.013613:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465840896:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14792us (14928us total) trans 21474841410 rc 0/0 00000100:00100000:0.0:1746147258.013623:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2584 00002000:00100000:0.0:1746147258.013633:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2412544->3141631) req@ffff88008e977b80 x1830967465840896/t21474841410(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:633/0 lens 488/448 e 0 to 0 dl 1746147268 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.013642:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977b80 with x1830967465840896 ext(2412544->3141631) 00010000:00010000:0.0:1746147258.013651:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 31 pid: 8480 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746147258.013664:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 31 pid: 8480 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746147258.013670:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e977b80 00000100:00100000:0.0:1746147258.018606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.018655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.018694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.018745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.018783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.018859:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465842048 00000100:00100000:3.0:1746147258.018871:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465842048 00000100:00100000:3.0:1746147258.018913:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465842176 00000100:00100000:3.0:1746147258.018915:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465842176 00000100:00100000:3.0:1746147258.018971:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15814 00000100:00100000:3.0:1746147258.018978:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967465842048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.018995:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.019011:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad196d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0b2 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.019031:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.019039:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad196d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0b2 expref: 35 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.019050:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad196d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0b2 expref: 35 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.019063:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dca00, rc 0) 00000100:00100000:0.0:1746147258.019094:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15815 00000100:00100000:3.0:1746147258.019122:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967465842048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (376us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147258.019124:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465842176:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147258.019128:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15814 00010000:00010000:0.0:1746147258.019142:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147258.019150:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465841792 00000100:00100000:3.0:1746147258.019154:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465841792 00010000:00010000:0.0:1746147258.019158:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad1974 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0b9 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.019170:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 8 pid: 8480 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147258.019205:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465841920 00000100:00100000:3.0:1746147258.019208:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465841920 00000100:00100000:0.0:1746147258.019210:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467081728:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.019219:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 20 pid: 21080 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746147258.019232:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465841664 00000100:00100000:3.0:1746147258.019234:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465841664 00010000:00010000:3.0:1746147258.019244:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746147258.019262:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8065 00000100:00100000:3.0:1746147258.019268:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465841792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.019275:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147258.019286:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00010000:00010000:3.0:1746147258.019294:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 8 pid: 8480 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147258.019302:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 8 pid: 8480 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147258.019318:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdad17c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf77 expref: 8 pid: 8480 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147258.019327:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.019348:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465841792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.019353:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8065 00000100:00100000:3.0:1746147258.019363:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8066 00000100:00100000:3.0:1746147258.019368:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465841920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.019375:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.019382:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 20 pid: 21080 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147258.019389:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 20 pid: 21080 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147258.019403:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00aa00/0xb4b2209fbdad1736 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf15 expref: 20 pid: 21080 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746147258.019410:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.019425:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465841920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.019429:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8066 00000100:00100000:3.0:1746147258.019438:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8067 00000100:00100000:3.0:1746147258.019443:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967465841664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.019449:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.019455:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147258.019462:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147258.019471:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f194600/0xb4b2209fbdad174b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf31 expref: 34 pid: 4445 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746147258.019478:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.019479:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.019484:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.019491:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.019515:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.019525:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467081856:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.019554:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00080000:2.0:1746147258.019850:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746147258.019853:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147258.020011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.020066:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465842304 00000100:00100000:3.0:1746147258.020182:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465842304 00010000:00010000:3.0:1746147258.020196:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 33 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.020752:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8068 00000100:00100000:3.0:1746147258.020759:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465842304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.020768:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.020781:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 33 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.020791:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 33 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.020805:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.020806:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.020811:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.020818:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.020837:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.020846:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467081984:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.020893:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147258.021359:0:8481:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88012c9f2680 x1830967467081728) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 33 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.021394:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad18da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2412544->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed050 expref: 33 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.022807:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467081728:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147258.022851:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad1974 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0b9 expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.022872:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad1974 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0b9 expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.022884:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6e00, rc 0) 00000100:00100000:0.0:1746147258.022964:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967465842176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3858us (4177us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147258.022973:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15815 00000100:00100000:3.0:1746147258.023398:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467081856:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.023423:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.023473:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465841664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4028us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.023483:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8067 00000100:00100000:0.0:1746147258.023839:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.024756:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467081984:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.024771:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.024808:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465842560 00000100:00100000:1.0:1746147258.024817:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465842560 00002000:00100000:1.0:1746147258.024858:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3993600->3997695) req@ffff88012c9f2680 x1830967465842560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.024879:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967465842560 ext(3993600->3997695) 00002000:00010000:1.0:1746147258.024884:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:3.0:1746147258.024975:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465842304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4214us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.024983:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8068 00000100:00100000:2.0:1746147258.024984:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7531 00000100:00100000:2.0:1746147258.024992:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465842560:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.025142:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465842560:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 151us (1303us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.025148:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7531 00002000:00100000:2.0:1746147258.025154:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3993600->3997695) req@ffff88012c9f2680 x1830967465842560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.025163:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967465842560 ext(3993600->3997695) 00002000:00010000:2.0:1746147258.025167:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:0.0:1746147258.027399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.027450:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465842816 00000100:00100000:2.0:1746147258.027458:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465842816 00002000:00100000:2.0:1746147258.027491:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f2d80 x1830967465842816/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.027500:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2d80 with x1830967465842816 ext(2097152->3145727) 00002000:00010000:2.0:1746147258.027504:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2d80 00000100:00100000:2.0:1746147258.027533:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7532 00000100:00100000:2.0:1746147258.027539:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465842816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147258.028817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.028893:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465842944 00000100:00100000:1.0:1746147258.028898:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465842944 00000100:00100000:1.0:1746147258.028924:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15816 00000100:00100000:1.0:1746147258.028929:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32024:x1830967465842944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147258.028953:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.028967:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0c0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.028988:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.028994:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.028996:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.028999:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->3825663] (req 3145728->3825663) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.029021:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.029031:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 21 pid: 17530 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.029040:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082112:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.029094:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.033245:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082112:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.033274:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->3825663] (req 3145728->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.033288:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a0800, rc 0) 00000100:00100000:1.0:1746147258.033344:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32024:x1830967465842944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4414us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.033352:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15816 00000100:00100000:0.0:1746147258.037535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.037626:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843200 00000100:00100000:1.0:1746147258.037637:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843200 00002000:00100000:1.0:1746147258.037677:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c9f2300 x1830967465843200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.037687:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2300 with x1830967465843200 ext(2097152->3145727) 00002000:00010000:1.0:1746147258.037692:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2300 00000100:00100000:1.0:1746147258.037722:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7533 00000100:00100000:1.0:1746147258.037729:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465843200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.039932:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465842816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12387us (12532us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.039956:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7532 00002000:00100000:3.0:1746147258.039966:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f2d80 x1830967465842816/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.039975:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2d80 with x1830967465842816 ext(2097152->3145727) 00010000:00010000:3.0:1746147258.039984:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 20 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.040001:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 20 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746147258.040007:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f2d80 00000100:00100000:0.0:1746147258.043777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.043818:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843328 00000100:00100000:1.0:1746147258.043825:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843328 00000100:00100000:1.0:1746147258.044288:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15817 00000100:00100000:1.0:1746147258.044296:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32026:x1830967465843328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147258.044312:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.044325:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0c7 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.044348:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.044361:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 7 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.044368:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.044373:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.044375:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.044378:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.044400:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.044408:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.044418:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082240:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.044502:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 7 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.044510:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 7 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.044517:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082368:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.044539:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.044546:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 30 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.044553:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082496:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.044568:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.046447:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.046509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.046783:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465843200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9053us (9256us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147258.046792:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7533 00002000:00100000:1.0:1746147258.046801:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c9f2300 x1830967465843200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.046809:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2300 with x1830967465843200 ext(2097152->3145727) 00002000:00010000:1.0:1746147258.046814:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2300 00000100:00100000:0.0:1746147258.046838:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843456 00000100:00100000:0.0:1746147258.046844:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843456 00000100:00100000:0.0:1746147258.046867:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15818 00000100:00100000:0.0:1746147258.046873:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32030:x1830967465843456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147258.046883:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147258.046885:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843584 00000100:00100000:3.0:1746147258.046888:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843584 00010000:00010000:0.0:1746147258.046896:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0ce expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.046903:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 22 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.046913:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.046918:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8069 00010000:00010000:0.0:1746147258.046920:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147258.046921:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746147258.046922:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465843584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.046924:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.046929:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.046957:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.046958:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 22 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.046966:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 32 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.046967:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 22 pid: 17530 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.046975:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467082624:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.046980:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1951 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed09d expref: 22 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.046992:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.046993:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.046998:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.047007:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00010000:00010000:3.0:1746147258.047009:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.047027:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.047035:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467082752:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.047057:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.047637:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082240:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.047646:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082368:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.047652:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467082496:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.047672:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.047680:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a0400, rc 0) 00000100:00100000:1.0:1746147258.047698:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32026:x1830967465843328:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3403us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.047707:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15817 00000100:00100000:0.0:1746147258.048830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.048869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.048887:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843712 00000100:00100000:3.0:1746147258.048891:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843712 00000100:00100000:2.0:1746147258.048926:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843840 00000100:00100000:2.0:1746147258.048929:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843840 00010000:00010000:2.0:1746147258.048965:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.048994:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8070 00000100:00100000:2.0:1746147258.049000:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465843840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147258.049010:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147258.049024:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746147258.049033:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746147258.049046:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad18d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed049 expref: 21 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746147258.049063:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147258.049085:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465843840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.049090:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8070 00010000:00010000:3.0:1746147258.050054:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 8 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.050071:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8071 00000100:00100000:3.0:1746147258.050077:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465843712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.050084:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.050094:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 8 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.050113:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 8 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.050125:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad190b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed065 expref: 8 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.050138:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.050161:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465843712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.050166:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8071 00000100:00080000:2.0:1746147258.050297:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147258.053121:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467082624:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.053144:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.053157:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd800, rc 0) 00000100:00100000:0.0:1746147258.053197:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32030:x1830967465843456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6323us (6755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.053205:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15818 00000100:00100000:3.0:1746147258.053296:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467082752:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.053308:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.053340:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465843584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6417us (6831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.053346:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8069 00000100:00100000:2.0:1746147258.053425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.053483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.053532:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465844096 00000100:00100000:1.0:1746147258.053538:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465844096 00002000:00100000:1.0:1746147258.053564:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3993600->4194303) req@ffff88012db2d180 x1830967465844096/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.053573:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d180 with x1830967465844096 ext(3993600->4194303) 00010000:00010000:1.0:1746147258.053579:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 33 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.053587:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 33 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746147258.053593:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012db2d180 00000100:00100000:1.0:1746147258.053607:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2585 00000100:00100000:1.0:1746147258.053612:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465844096:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147258.053787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.053800:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465844352 00000100:00100000:0.0:1746147258.053803:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465844352 00002000:00100000:0.0:1746147258.053842:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f1f80 x1830967465844352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.053849:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967465844352 ext(2097152->3145727) 00002000:00010000:0.0:1746147258.053852:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f1f80 00000100:00100000:0.0:1746147258.053865:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7534 00000100:00100000:0.0:1746147258.053870:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465844352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.053978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.054018:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465844480 00000100:00100000:2.0:1746147258.054021:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465844480 00002000:00100000:2.0:1746147258.054033:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3821568->3825663) req@ffff88012db2d500 x1830967465844480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.054039:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d500 with x1830967465844480 ext(3821568->3825663) 00002000:00010000:2.0:1746147258.054041:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d500 00000100:00100000:2.0:1746147258.054053:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7535 00000100:00100000:2.0:1746147258.054057:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465844480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.054155:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465844480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 97us (177us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.054160:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7535 00002000:00100000:2.0:1746147258.054164:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3821568->3825663) req@ffff88012db2d500 x1830967465844480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.054169:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d500 with x1830967465844480 ext(3821568->3825663) 00002000:00010000:2.0:1746147258.054171:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2d500 00000100:00100000:3.0:1746147258.054246:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465843968 00000100:00100000:3.0:1746147258.054249:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465843968 00010000:00010000:3.0:1746147258.054261:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 32 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.054274:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8072 00000100:00100000:3.0:1746147258.054278:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465843968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.054284:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.054295:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 32 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.054302:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 32 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.054318:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b205c00/0xb4b2209fbdad18cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed042 expref: 32 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.054332:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.054334:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.054339:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.054346:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.054368:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.054377:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467082880:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.054413:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.058049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.058070:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467082880:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147258.058071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147258.058089:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.058118:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465845120 00000100:00100000:3.0:1746147258.058122:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465845120 00000100:00100000:3.0:1746147258.058158:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4815 00000100:00100000:3.0:1746147258.058164:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+327:32024:x1830967465845120:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147258.058305:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+328:32024:x1830967465845120:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 140us (232us total) trans 8589945512 rc 0/0 00000100:00100000:3.0:1746147258.058310:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4815 00000100:00100000:3.0:1746147258.058330:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465843968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4051us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.058339:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8072 00000100:00100000:2.0:1746147258.058414:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465844864 00000100:00100000:2.0:1746147258.058418:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465844864 00002000:00100000:2.0:1746147258.058437:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1814528->1818623) req@ffff88012c9f0a80 x1830967465844864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.058445:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0a80 with x1830967465844864 ext(1814528->1818623) 00002000:00010000:2.0:1746147258.058449:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0a80 00000100:00100000:2.0:1746147258.058469:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7536 00000100:00100000:2.0:1746147258.058473:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465844864:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.058552:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465844864:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 78us (509us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.058557:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7536 00002000:00100000:2.0:1746147258.058560:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1814528->1818623) req@ffff88012c9f0a80 x1830967465844864/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.058567:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0a80 with x1830967465844864 ext(1814528->1818623) 00002000:00010000:2.0:1746147258.058569:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0a80 00000100:00080000:0.0:1746147258.058619:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147258.060223:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465844096:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6603us (6791us total) trans 17179874056 rc 0/0 00000100:00100000:1.0:1746147258.060233:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2585 00002000:00100000:1.0:1746147258.060242:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3993600->4194303) req@ffff88012db2d180 x1830967465844096/t17179874056(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.060250:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2d180 with x1830967465844096 ext(3993600->4194303) 00010000:00010000:1.0:1746147258.060258:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 35 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.060275:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 35 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746147258.060282:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012db2d180 00000100:00100000:0.0:1746147258.063135:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465844352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9256us (9340us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147258.063145:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7534 00002000:00100000:0.0:1746147258.063154:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f1f80 x1830967465844352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.063161:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967465844352 ext(2097152->3145727) 00002000:00010000:0.0:1746147258.063166:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f1f80 00000100:00100000:0.0:1746147258.063420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.063525:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465845376 00000100:00100000:2.0:1746147258.063531:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465845376 00002000:00100000:2.0:1746147258.063557:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3993599) req@ffff88012c9f1500 x1830967465845376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.063564:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1500 with x1830967465845376 ext(3145728->3993599) 00010000:00010000:2.0:1746147258.063571:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 35 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.063583:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 35 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.063593:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f1500 00000100:00100000:2.0:1746147258.063820:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2586 00000100:00100000:2.0:1746147258.063827:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465845376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.066007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.067301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.067392:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465845632 00000100:00100000:2.0:1746147258.067399:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465845632 00002000:00100000:2.0:1746147258.067432:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3825664->4194303) req@ffff88009e6f2300 x1830967465845632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.067441:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2300 with x1830967465845632 ext(3825664->4194303) 00002000:00010000:2.0:1746147258.067446:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f2300 00000100:00100000:2.0:1746147258.067458:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465845888 00000100:00100000:2.0:1746147258.067460:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465845888 00002000:00100000:2.0:1746147258.067468:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e6f1500 x1830967465845888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.067475:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1500 with x1830967465845888 ext(4194304->4976639) 00010000:00010000:2.0:1746147258.067482:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 37 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.067494:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 37 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.067501:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e6f1500 00000100:00100000:2.0:1746147258.067511:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2587 00000100:00100000:2.0:1746147258.067516:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465845888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.068290:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7537 00000100:00100000:2.0:1746147258.068296:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465845632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147258.069879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.069953:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846016 00000100:00100000:2.0:1746147258.069959:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846016 00000100:00100000:2.0:1746147258.071037:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15819 00000100:00100000:2.0:1746147258.071045:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32026:x1830967465846016:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.071058:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.071071:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0d5 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.071093:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.071116:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.071261:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.071268:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.071269:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.071273:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1048576->1646591] (req 1048576->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.071296:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.071310:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.071320:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083008:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.071449:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 6 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.071457:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 6 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.071464:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.071490:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.071497:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 31 pid: 8478 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.071504:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.071517:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.076342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.076471:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083008:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.076731:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465845376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12903us (13311us total) trans 0 rc 847872/847872 00000100:00100000:2.0:1746147258.076740:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2586 00002000:00100000:2.0:1746147258.076751:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3993599) req@ffff88012c9f1500 x1830967465845376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147258.076752:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465845888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9234us (9454us total) trans 0 rc 782336/782336 00002000:00100000:2.0:1746147258.076759:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1500 with x1830967465845376 ext(3145728->3993599) 00000100:00100000:3.0:1746147258.076760:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2587 00002000:00100000:3.0:1746147258.076766:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e6f1500 x1830967465845888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147258.076767:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00002000:00100000:3.0:1746147258.076774:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1500 with x1830967465845888 ext(4194304->4976639) 00010000:00010000:2.0:1746147258.076778:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.076779:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.076784:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f1500 00010000:00010000:3.0:1746147258.076788:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746147258.076794:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e6f1500 00000100:00100000:1.0:1746147258.076998:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846144 00000100:00100000:1.0:1746147258.077003:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846144 00000100:00100000:1.0:1746147258.077028:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15820 00000100:00100000:1.0:1746147258.077033:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:32034:x1830967465846144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.077044:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.077055:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0dc expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.077074:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.077079:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.077089:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.077098:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49a00, rc 0) 00000100:00100000:1.0:1746147258.077131:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32034:x1830967465846144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 97us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.077136:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15820 00000100:00100000:0.0:1746147258.077667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.077804:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083136:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.077813:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083264:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.077833:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1048576->1646591] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.077842:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ede00, rc 0) 00000100:00100000:3.0:1746147258.078134:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32026:x1830967465846016:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7090us (8256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.078145:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15819 00000100:00100000:3.0:1746147258.078164:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846272 00000100:00100000:3.0:1746147258.078166:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846272 00010000:00010000:3.0:1746147258.078182:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.078443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.078893:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846400 00000100:00100000:3.0:1746147258.078897:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846400 00010000:00010000:3.0:1746147258.078910:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 7 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.078931:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8073 00000100:00100000:3.0:1746147258.078953:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465846272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.078963:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.078980:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.078990:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.079006:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a1600/0xb4b2209fbdad1912 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed06c expref: 20 pid: 4445 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.079022:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.079042:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465846272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.079051:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8073 00000100:00100000:3.0:1746147258.079064:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8074 00000100:00100000:3.0:1746147258.079068:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465846400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.079073:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.079080:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 7 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.079087:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 7 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.079097:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1919 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed07a expref: 7 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.079116:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.079128:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465846400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 60us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.079133:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8074 00000100:00100000:2.0:1746147258.079324:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465845632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11028us (13321us total) trans 0 rc 368640/368640 00000100:00100000:2.0:1746147258.079331:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7537 00002000:00100000:2.0:1746147258.079337:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3825664->4194303) req@ffff88009e6f2300 x1830967465845632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.079346:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2300 with x1830967465845632 ext(3825664->4194303) 00002000:00010000:2.0:1746147258.079349:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f2300 00000100:00100000:0.0:1746147258.081702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.081748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.081873:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846528 00000100:00100000:1.0:1746147258.081881:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846528 00010000:00010000:1.0:1746147258.081906:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 30 pid: 8478 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.081965:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846656 00000100:00100000:1.0:1746147258.081968:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846656 00010000:00010000:1.0:1746147258.081979:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.081994:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8075 00000100:00100000:1.0:1746147258.082000:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465846528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.082011:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.082028:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 30 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.082038:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 30 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.082055:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b204e00/0xb4b2209fbdad18e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed057 expref: 30 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.082071:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.082072:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.082078:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.082084:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.082129:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.082139:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467083392:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147258.082197:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.082207:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8076 00000100:00100000:3.0:1746147258.082215:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465846656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.082226:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147258.082240:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147256 -> 1746147257 00002000:00010000:3.0:1746147258.082242:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147256 -> 1746147257 00010000:00010000:3.0:1746147258.082247:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.082261:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.082278:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1966 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ab expref: 36 pid: 17530 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.082287:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.082288:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.082292:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.082298:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.082303:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.082304:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.082307:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.082313:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.082332:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.082339:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467083520:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.082367:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.082373:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467083648:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.082383:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.086658:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467083392:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147258.086676:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.086712:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465846528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4711us (5015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.086720:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8075 00000100:00100000:3.0:1746147258.087087:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467083520:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.087096:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467083648:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.087121:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.087153:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465846656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4939us (5404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.087159:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8076 00000100:00100000:0.0:1746147258.089284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.089355:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465846912 00000100:00100000:2.0:1746147258.089362:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465846912 00002000:00100000:2.0:1746147258.089402:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e682300 x1830967465846912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.089410:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682300 with x1830967465846912 ext(3145728->4194303) 00002000:00010000:2.0:1746147258.089415:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682300 00000100:00100000:2.0:1746147258.089446:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7538 00000100:00100000:2.0:1746147258.089453:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465846912:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147258.091051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.091488:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465847168 00000100:00100000:3.0:1746147258.091495:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465847168 00002000:00100000:3.0:1746147258.091523:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e680a80 x1830967465847168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.091530:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680a80 with x1830967465847168 ext(3145728->4194303) 00002000:00010000:3.0:1746147258.091534:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680a80 00000100:00100000:3.0:1746147258.091561:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7539 00000100:00100000:3.0:1746147258.091567:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465847168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147258.093603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.094826:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465847424 00000100:00100000:3.0:1746147258.094840:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465847424 00002000:00100000:3.0:1746147258.094877:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1642496->1646591) req@ffff88009e680700 x1830967465847424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.094885:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967465847424 ext(1642496->1646591) 00002000:00010000:3.0:1746147258.094890:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680700 00000100:00100000:3.0:1746147258.094922:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7540 00000100:00100000:3.0:1746147258.094929:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465847424:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147258.096460:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465847424:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1526us (2858us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147258.096469:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7540 00002000:00100000:3.0:1746147258.096476:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1642496->1646591) req@ffff88009e680700 x1830967465847424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.096483:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967465847424 ext(1642496->1646591) 00002000:00010000:3.0:1746147258.096487:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680700 00000100:00100000:2.0:1746147258.102349:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465846912:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12888us (13062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147258.102359:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7538 00002000:00100000:2.0:1746147258.102370:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e682300 x1830967465846912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.102378:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682300 with x1830967465846912 ext(3145728->4194303) 00002000:00010000:2.0:1746147258.102383:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682300 00000100:00100000:3.0:1746147258.104096:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465847168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12522us (13041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.104114:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7539 00002000:00100000:3.0:1746147258.104122:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e680a80 x1830967465847168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.104131:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680a80 with x1830967465847168 ext(3145728->4194303) 00002000:00010000:3.0:1746147258.104135:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680a80 00000100:00100000:0.0:1746147258.104915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.104961:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465847680 00000100:00100000:1.0:1746147258.104968:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465847680 00000100:00080000:0.0:1746147258.105055:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147258.105217:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4816 00000100:00100000:1.0:1746147258.105225:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+37:32026:x1830967465847680:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147258.107372:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+38:32026:x1830967465847680:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 2139us (2497us total) trans 8589945513 rc 0/0 00000100:00100000:1.0:1746147258.107383:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4816 00000100:00100000:0.0:1746147258.107986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.108145:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465847808 00000100:00100000:3.0:1746147258.108152:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465847808 00000100:00100000:3.0:1746147258.108186:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15821 00000100:00100000:3.0:1746147258.108193:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32030:x1830967465847808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.108207:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.108222:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0e3 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.108249:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.108255:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147258.108257:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147258.108260:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.108282:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.108292:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 28 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.108302:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083776:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.108360:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.110723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.110757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.110869:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465847936 00000100:00100000:2.0:1746147258.110877:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465847936 00000100:00100000:2.0:1746147258.110907:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848064 00000100:00100000:2.0:1746147258.110910:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848064 00000100:00100000:2.0:1746147258.110924:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15822 00000100:00100000:2.0:1746147258.110930:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967465847936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147258.110972:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.110985:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad19a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0ea expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.111031:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467083904:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147258.111084:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15823 00000100:00100000:2.0:1746147258.111094:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.111098:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465848064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.111124:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.111137:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa49800/0xb4b2209fbdad19ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0f1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.111177:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467084032:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147258.111229:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.111237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.111352:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848192 00000100:00100000:2.0:1746147258.111355:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848192 00002000:00100000:2.0:1746147258.111375:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3825663) req@ffff88009e682680 x1830967465848192/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.111382:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682680 with x1830967465848192 ext(3145728->3825663) 00010000:00010000:2.0:1746147258.111388:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 33 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.111398:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 33 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.111403:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e682680 00000100:00100000:2.0:1746147258.111414:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2588 00000100:00100000:2.0:1746147258.111418:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465848192:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147258.112008:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467083776:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.112032:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.112042:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f600, rc 0) 00000100:00100000:3.0:1746147258.112061:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32030:x1830967465847808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3869us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.112067:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15821 00000100:00100000:3.0:1746147258.116233:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467083904:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.116264:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad19a5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ea expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.116277:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad19a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ea expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.116297:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6eb800, rc 0) 00000100:00100000:3.0:1746147258.116336:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465847936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5405us (5619us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.116343:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15822 00000100:00100000:1.0:1746147258.116405:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467084032:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147258.116433:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa49800/0xb4b2209fbdad19ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0f1 expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.116444:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49800/0xb4b2209fbdad19ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0f1 expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.116458:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49800, rc 0) 00000100:00100000:1.0:1746147258.116494:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465848064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5401us (5736us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147258.116500:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15823 00000100:00100000:0.0:1746147258.119849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.119906:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848448 00000100:00100000:1.0:1746147258.119915:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848448 00002000:00100000:1.0:1746147258.119963:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880099f68a80 x1830967465848448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.119972:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68a80 with x1830967465848448 ext(4194304->4976639) 00002000:00010000:1.0:1746147258.119976:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68a80 00000100:00100000:1.0:1746147258.120007:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7541 00000100:00100000:1.0:1746147258.120014:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465848448:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.120908:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465848192:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9486us (9669us total) trans 21474841411 rc 0/0 00000100:00100000:2.0:1746147258.120917:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2588 00002000:00100000:2.0:1746147258.120924:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3825663) req@ffff88009e682680 x1830967465848192/t21474841411(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.120932:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682680 with x1830967465848192 ext(3145728->3825663) 00010000:00010000:2.0:1746147258.120956:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.121145:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.121151:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e682680 00000100:00100000:1.0:1746147258.127414:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465848448:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7393us (7563us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147258.127431:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7541 00002000:00100000:1.0:1746147258.127440:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880099f68a80 x1830967465848448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.127449:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68a80 with x1830967465848448 ext(4194304->4976639) 00002000:00010000:1.0:1746147258.127454:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68a80 00000100:00100000:0.0:1746147258.128511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.131124:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848576 00000100:00100000:1.0:1746147258.131138:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848576 00010000:00010000:1.0:1746147258.131184:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.131230:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8077 00000100:00100000:1.0:1746147258.131238:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465848576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.131252:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.131275:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.131288:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.131311:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0800/0xb4b2209fbdad197b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3825663) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c0 expref: 31 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.131347:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.131349:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.131356:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.131364:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.131400:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.131413:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467084160:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147258.131515:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.136826:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467084160:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147258.136827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.136842:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.136867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.136879:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967465848576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5641us (8369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.136887:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8077 00000100:00100000:0.0:1746147258.136964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.136981:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848704 00000100:00100000:2.0:1746147258.136981:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848960 00000100:00100000:3.0:1746147258.136987:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848704 00000100:00100000:2.0:1746147258.136987:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848960 00000100:00100000:0.0:1746147258.136996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.137011:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465848832 00000100:00100000:3.0:1746147258.137012:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465848832 00000100:00100000:2.0:1746147258.137016:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15824 00000100:00100000:2.0:1746147258.137021:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465848704:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147258.137024:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15825 00000100:00100000:3.0:1746147258.137028:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967465848960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.137034:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.137034:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.137047:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed106 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.137047:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad19b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0f8 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.137062:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.137063:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.137070:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.137081:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147258.137081:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467084288:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.137098:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0e400, rc 0) 00000100:00100000:3.0:1746147258.137122:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465848960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.137127:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15825 00000100:00100000:2.0:1746147258.137134:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.137135:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15826 00000100:00100000:3.0:1746147258.137139:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465848832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.137144:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.137150:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad19c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed0ff expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.137169:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467084416:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147258.137190:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.137475:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465849216 00000100:00100000:1.0:1746147258.137479:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465849216 00002000:00100000:1.0:1746147258.137499:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880099f6a680 x1830967465849216/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.137507:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a680 with x1830967465849216 ext(3145728->4194303) 00002000:00010000:1.0:1746147258.137510:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6a680 00000100:00100000:1.0:1746147258.137536:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7542 00000100:00100000:1.0:1746147258.137542:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465849216:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147258.138835:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467084288:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.138854:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad19b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0f8 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.138864:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad19b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0f8 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.138881:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890400, rc 0) 00000100:00100000:3.0:1746147258.138910:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465848704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1888us (2089us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.138915:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15824 00000100:00100000:3.0:1746147258.139226:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467084416:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.139239:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad19c1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ff expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.139247:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad19c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ff expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.139258:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ee00, rc 0) 00000100:00100000:3.0:1746147258.139285:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465848832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2145us (2348us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.139291:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15826 00000100:00100000:0.0:1746147258.143788:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.143822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.143872:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465849344 00000100:00100000:3.0:1746147258.143879:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465849344 00000100:00100000:3.0:1746147258.143959:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465849472 00000100:00100000:3.0:1746147258.143962:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465849472 00000100:00100000:3.0:1746147258.144074:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15827 00000100:00100000:3.0:1746147258.144082:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465849344:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147258.144082:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15828 00000100:00100000:2.0:1746147258.144087:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465849472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.144099:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.144117:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.144124:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed10d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.144124:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad19cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed114 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.144162:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467084544:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147258.144162:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467084672:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147258.144217:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.144832:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.145072:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465849216:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 7528us (8073us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147258.145080:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7542 00002000:00100000:1.0:1746147258.145088:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880099f6a680 x1830967465849216/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.145096:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a680 with x1830967465849216 ext(3145728->4194303) 00002000:00010000:1.0:1746147258.145108:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6a680 00000100:00100000:2.0:1746147258.147467:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467084672:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147258.147495:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad19cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed114 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.147506:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad19cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed114 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147258.147508:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467084544:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.147521:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed10d expref: 33 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.147539:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed10d expref: 33 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.147551:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ea00, rc 0) 00000100:00100000:3.0:1746147258.147595:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465849344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3513us (3814us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.147602:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15827 00010000:00010000:2.0:1746147258.147689:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890400, rc 0) 00000100:00100000:2.0:1746147258.147713:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465849472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3625us (3889us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147258.147717:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15828 00000100:00100000:0.0:1746147258.152349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.152435:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465849728 00000100:00100000:1.0:1746147258.152443:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465849728 00002000:00100000:1.0:1746147258.152478:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e585f80 x1830967465849728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.152487:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585f80 with x1830967465849728 ext(4194304->4976639) 00002000:00010000:1.0:1746147258.152491:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585f80 00000100:00100000:1.0:1746147258.152519:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7543 00000100:00100000:1.0:1746147258.152526:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465849728:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.159681:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967465849728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7146us (7331us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147258.159691:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7543 00002000:00100000:1.0:1746147258.159700:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e585f80 x1830967465849728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.159709:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585f80 with x1830967465849728 ext(4194304->4976639) 00002000:00010000:1.0:1746147258.159714:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585f80 00000100:00100000:0.0:1746147258.289755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.290927:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465849984 00000100:00100000:2.0:1746147258.290968:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465849984 00000100:00100000:2.0:1746147258.291019:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11500 00000100:00100000:2.0:1746147258.291025:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+328:32040:x1830967465849984:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.291047:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.291061:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891200/0xb4b2209fbdad19d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed11b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.291160:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.291173:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.291179:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.291204:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.291214:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 20 pid: 14125 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.291224:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467084800:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.291308:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.293459:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467084800:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.293463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147258.293477:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147258.293559:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465850112 00000100:00100000:1.0:1746147258.293565:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465850112 00010000:00010000:1.0:1746147258.293588:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 21 pid: 14125 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.293617:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8078 00000100:00100000:1.0:1746147258.293624:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+21:1957:x1830967465850112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.293634:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.293639:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 21 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.293652:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 21 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.293669:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1943 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed08f expref: 21 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.293683:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147258.293686:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.293693:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.293699:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.293726:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147258.293751:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147258.293758:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147258.293758:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:1957:x1830967465850112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 134us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.293764:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8078 00000004:00200000:3.0:1746147258.293772:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147258.293881:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891200/0xb4b2209fbdad19d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 331 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.293899:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 330 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.293905:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.293907:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147258.293909:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891400, rc 0) 00000100:00100000:3.0:1746147258.294376:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+330:32040:x1830967465849984:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3350us (4626us total) trans 8589945514 rc 0/0 00000100:00100000:3.0:1746147258.294382:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11500 00000100:00100000:0.0:1746147258.320781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.322016:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465850240 00000100:00100000:2.0:1746147258.322025:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465850240 00000100:00100000:2.0:1746147258.322199:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15829 00000100:00100000:2.0:1746147258.322207:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:32040:x1830967465850240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.322222:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.322236:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed122 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.322257:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.322264:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.322270:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.322271:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.322274:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2301952->2723839] (req 2301952->2723839) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.322296:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.322305:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.322314:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467084928:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.323445:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.323461:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 19 pid: 4444 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.323470:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467085056:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.323498:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.327739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.327977:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467084928:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.327987:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467085056:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.328008:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2301952->2723839] (req 2301952->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.328021:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891c00, rc 0) 00000100:00100000:2.0:1746147258.328056:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32040:x1830967465850240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5850us (7282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.328064:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15829 00000100:00100000:3.0:1746147258.328169:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465850496 00000100:00100000:3.0:1746147258.328174:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465850496 00000100:00100000:3.0:1746147258.328456:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11501 00000100:00100000:3.0:1746147258.328463:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+38:32042:x1830967465850496:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147258.328478:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.328491:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad19f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed129 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.328559:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147258.328570:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147258.328651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.328670:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465850624 00000100:00100000:0.0:1746147258.328672:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465850624 00010000:00010000:0.0:1746147258.328687:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 20 pid: 4444 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.328704:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8079 00000100:00100000:0.0:1746147258.328709:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465850624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.328716:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.328730:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 20 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.328738:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 20 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.328753:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0ce expref: 20 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.328766:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.328783:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465850624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.328788:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8079 00010000:00010000:3.0:1746147258.328984:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147258.328994:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147258.329078:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad19f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 41 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.329096:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 40 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.329112:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.329115:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147258.329117:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ea00, rc 0) 00000100:00100000:3.0:1746147258.329135:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+40:32042:x1830967465850496:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 674us (1404us total) trans 8589945515 rc 0/0 00000100:00100000:3.0:1746147258.329140:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11501 00000100:00100000:0.0:1746147258.329917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.330039:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465850752 00000100:00100000:3.0:1746147258.330043:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465850752 00010000:00010000:3.0:1746147258.330057:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.330320:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8080 00000100:00100000:3.0:1746147258.330326:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465850752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.330333:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.330345:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.330354:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.330367:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1997 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0dc expref: 36 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.330376:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.330378:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.330406:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.330414:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.330438:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.330448:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467085184:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.330612:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.332575:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467085184:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.332591:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.332605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.332624:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465850752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2298us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.332632:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8080 00000100:00100000:1.0:1746147258.332789:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851008 00000100:00100000:1.0:1746147258.332794:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851008 00002000:00100000:1.0:1746147258.332821:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2301952->2306047) req@ffff88009b208000 x1830967465851008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.332829:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967465851008 ext(2301952->2306047) 00002000:00010000:1.0:1746147258.332833:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208000 00000100:00100000:1.0:1746147258.332846:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7544 00000100:00100000:1.0:1746147258.332851:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465851008:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147258.332989:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465851008:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 138us (384us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147258.332994:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7544 00002000:00100000:1.0:1746147258.332999:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2301952->2306047) req@ffff88009b208000 x1830967465851008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.333005:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967465851008 ext(2301952->2306047) 00002000:00010000:1.0:1746147258.333008:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208000 00000100:00100000:1.0:1746147258.338200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.338757:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851264 00000100:00100000:3.0:1746147258.338765:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851264 00002000:00100000:3.0:1746147258.338799:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2719744->2723839) req@ffff88012d49aa00 x1830967465851264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.338808:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49aa00 with x1830967465851264 ext(2719744->2723839) 00002000:00010000:3.0:1746147258.338813:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49aa00 00000100:00100000:3.0:1746147258.339031:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7545 00000100:00100000:3.0:1746147258.339038:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465851264:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147258.339221:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465851264:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 184us (1027us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147258.339228:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7545 00002000:00100000:3.0:1746147258.339233:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2719744->2723839) req@ffff88012d49aa00 x1830967465851264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.339239:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49aa00 with x1830967465851264 ext(2719744->2723839) 00002000:00010000:3.0:1746147258.339242:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49aa00 00000100:00100000:0.0:1746147258.369054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.369226:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851392 00000100:00100000:2.0:1746147258.369237:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851392 00000100:00100000:2.0:1746147258.369289:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15830 00000100:00100000:2.0:1746147258.369295:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465851392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147258.369310:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.369323:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f891200/0xb4b2209fbdad1a07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed130 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.369363:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467085312:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147258.369689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.369720:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.369770:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851520 00000100:00100000:3.0:1746147258.369775:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851520 00000100:00100000:3.0:1746147258.369807:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15831 00000100:00100000:3.0:1746147258.369813:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465851520:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.369821:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.369829:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5426600/0xb4b2209fbdad1a0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed137 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.369853:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467085440:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147258.369881:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.374584:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467085312:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147258.374613:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f891200/0xb4b2209fbdad1a07 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed130 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.374624:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f891200/0xb4b2209fbdad1a07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed130 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.374652:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891200, rc 0) 00000100:00100000:3.0:1746147258.374681:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467085440:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147258.374696:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465851392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5400us (5653us total) trans 0 rc 301/301 00010000:00010000:3.0:1746147258.374700:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5426600/0xb4b2209fbdad1a0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed137 expref: 33 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147258.374703:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15830 00010000:00010000:3.0:1746147258.374710:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5426600/0xb4b2209fbdad1a0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed137 expref: 33 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.374722:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5426600, rc 0) 00000100:00100000:3.0:1746147258.374739:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465851520:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4927us (5051us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.374744:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15831 00000100:00100000:1.0:1746147258.387025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.387164:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851648 00000100:00100000:3.0:1746147258.387171:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851648 00000100:00100000:3.0:1746147258.387216:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15832 00000100:00100000:3.0:1746147258.387223:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32046:x1830967465851648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.387237:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.387251:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed13e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.387274:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.387282:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147258.387283:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147258.387286:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 32 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.387309:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.387318:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 19 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.387325:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467085568:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.387424:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.388596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.388647:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851776 00000100:00100000:2.0:1746147258.388652:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851776 00000100:00100000:2.0:1746147258.388712:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15833 00000100:00100000:2.0:1746147258.388719:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32042:x1830967465851776:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.388727:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.388735:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed145 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.388750:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.388758:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.388767:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.388769:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.388771:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3977216->4194303] (req 3977216->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.388787:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.388795:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 32 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.388802:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467085696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.388990:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.388998:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 21 pid: 4444 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.389006:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467085824:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.389237:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.391933:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.392023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.392058:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.392128:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852160 00000100:00100000:0.0:1746147258.392136:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852160 00000100:00100000:3.0:1746147258.392143:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852032 00000100:00100000:3.0:1746147258.392148:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852032 00000100:00100000:0.0:1746147258.392174:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15834 00010000:00010000:3.0:1746147258.392178:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 33 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.392181:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465852160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147258.392196:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147258.392201:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8081 00000100:00100000:3.0:1746147258.392206:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465852032:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.392209:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd23200/0xb4b2209fbdad1a23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed14c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.392219:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.392239:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 33 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.392249:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 33 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.392253:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467085952:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.392268:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.392346:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465851904 00000100:00100000:1.0:1746147258.392350:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465851904 00002000:00100000:1.0:1746147258.392375:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1814528->2097151) req@ffff88009b208a80 x1830967465851904/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.392384:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967465851904 ext(1814528->2097151) 00010000:00010000:1.0:1746147258.392390:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 24 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.392399:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 24 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746147258.392405:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b208a80 00000100:00100000:1.0:1746147258.392418:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2589 00000100:00100000:1.0:1746147258.392423:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465851904:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:2.0:1746147258.392520:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad19ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed106 expref: 33 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.392542:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467085696:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.392553:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467085824:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.392573:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3977216->4194303] (req 3977216->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.392582:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891000, rc 0) 00000100:00100000:0.0:1746147258.393018:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.393072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.393134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.393157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.393188:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852544 00000100:00100000:0.0:1746147258.393191:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852544 00010000:00010000:0.0:1746147258.393203:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 25 pid: 4444 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.393219:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8082 00000100:00100000:0.0:1746147258.393223:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465852544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.393229:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.393238:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 25 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.393247:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 25 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.393264:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad199e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0e3 expref: 25 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.393275:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.393277:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.393282:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.393290:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.393308:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.393317:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467086080:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147258.393337:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.393391:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852288 00000100:00100000:0.0:1746147258.393393:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852288 00000100:00100000:0.0:1746147258.393408:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852416 00000100:00100000:0.0:1746147258.393410:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852416 00000100:00100000:0.0:1746147258.393424:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15835 00000100:00100000:0.0:1746147258.393429:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465852288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147258.393437:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147258.393446:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd23800/0xb4b2209fbdad1a2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed153 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.393472:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467086208:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147258.393492:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.393508:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15836 00000100:00100000:0.0:1746147258.393513:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465852416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147258.393518:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147258.393524:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd23e00/0xb4b2209fbdad1a31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed15a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.393540:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467086336:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147258.393556:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934c6000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.394158:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32042:x1830967465851776:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5438us (5567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.394166:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15833 00000100:00100000:2.0:1746147258.394216:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467085568:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.394234:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 32 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.394244:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f400, rc 0) 00000100:00100000:2.0:1746147258.394263:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:32046:x1830967465851648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7041us (7246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.394269:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15832 00000100:00100000:3.0:1746147258.394424:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465852032:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2217us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.394431:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8081 00000100:00100000:2.0:1746147258.397869:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467085952:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147258.397905:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd23200/0xb4b2209fbdad1a23 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed14c expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.397919:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd23200/0xb4b2209fbdad1a23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed14c expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.397931:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd23200, rc 0) 00000100:00100000:2.0:1746147258.398012:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967465852160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5829us (5986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147258.398022:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15834 00002000:00010000:0.0:1746147258.399292:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147257 -> 1746147258 00002000:00010000:0.0:1746147258.399297:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147256 -> 1746147258 00002000:00010000:0.0:1746147258.399299:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147257 -> 1746147258 00000100:00100000:0.0:1746147258.399314:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467086208:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147258.399338:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd23800/0xb4b2209fbdad1a2a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed153 expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.399349:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd23800/0xb4b2209fbdad1a2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed153 expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.399379:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd23800, rc 0) 00000100:00100000:0.0:1746147258.399409:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967465852288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5978us (6336us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147258.399416:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15835 00000100:00100000:1.0:1746147258.399788:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467086080:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147258.399800:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.399821:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465852544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6597us (6664us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.399829:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8082 00000100:00100000:0.0:1746147258.401426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.401664:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467086336:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147258.401697:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd23e00/0xb4b2209fbdad1a31 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed15a expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.401711:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd23e00/0xb4b2209fbdad1a31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed15a expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.401736:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd23e00, rc 0) 00000100:00100000:1.0:1746147258.401783:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465852416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8269us (8648us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147258.401791:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15836 00000100:00100000:1.0:1746147258.402420:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852800 00000100:00100000:1.0:1746147258.402426:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852800 00002000:00100000:1.0:1746147258.402460:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3977216->3981311) req@ffff88009b209c00 x1830967465852800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.402469:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209c00 with x1830967465852800 ext(3977216->3981311) 00002000:00010000:1.0:1746147258.402473:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209c00 00000100:00100000:1.0:1746147258.402491:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7546 00000100:00100000:1.0:1746147258.402497:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465852800:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147258.402550:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465851904:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 10125us (10624us total) trans 21474841412 rc 0/0 00000100:00100000:3.0:1746147258.402558:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2589 00002000:00100000:3.0:1746147258.402564:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1814528->2097151) req@ffff88009b208a80 x1830967465851904/t21474841412(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.402571:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967465851904 ext(1814528->2097151) 00010000:00010000:3.0:1746147258.402578:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 23 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.402589:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 23 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746147258.402594:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b208a80 00000100:00100000:1.0:1746147258.402619:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465852800:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 122us (1273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147258.402629:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7546 00002000:00100000:1.0:1746147258.402634:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3977216->3981311) req@ffff88009b209c00 x1830967465852800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.402641:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209c00 with x1830967465852800 ext(3977216->3981311) 00002000:00010000:1.0:1746147258.402644:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209c00 00000100:00100000:0.0:1746147258.404696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.404797:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465852928 00000100:00100000:1.0:1746147258.404804:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465852928 00010000:00010000:1.0:1746147258.404831:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 22 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.404864:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8083 00000100:00100000:1.0:1746147258.404871:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465852928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.404883:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.404900:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 22 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.404912:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 22 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.404934:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a0400/0xb4b2209fbdad1982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0c7 expref: 22 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.404977:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.404980:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.404987:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.405001:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.405031:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.405043:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467086464:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147258.405129:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.405996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.406056:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465853056 00000100:00100000:1.0:1746147258.406060:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465853056 00000100:00100000:1.0:1746147258.406088:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15837 00000100:00100000:1.0:1746147258.406093:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32042:x1830967465853056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147258.406120:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.406134:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed161 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.406154:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.406161:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.406162:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.406166:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4194304->4681727] (req 4194304->4681727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.406185:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.406200:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 34 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.406209:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467086592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.406261:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.408109:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467086464:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147258.408134:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.408189:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465852928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3317us (3500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.408200:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8083 00000100:00100000:0.0:1746147258.408350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.408575:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465853184 00000100:00100000:1.0:1746147258.408581:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465853184 00000100:00100000:1.0:1746147258.408622:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15838 00000100:00100000:1.0:1746147258.408628:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32049:x1830967465853184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.408645:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.408660:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed168 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.408682:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.408684:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.408691:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.408705:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.408721:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa48800, rc 0) 00000100:00100000:1.0:1746147258.408744:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32049:x1830967465853184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.408748:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15838 00000100:00100000:0.0:1746147258.408915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.410142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.410291:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465853440 00000100:00100000:0.0:1746147258.410298:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465853440 00002000:00100000:0.0:1746147258.410335:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f045880 x1830967465853440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.410345:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830967465853440 ext(1048576->2097151) 00002000:00010000:0.0:1746147258.410349:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045880 00000100:00100000:0.0:1746147258.410363:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465853568 00000100:00100000:0.0:1746147258.410365:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465853568 00002000:00100000:0.0:1746147258.410378:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2301952->2723839) req@ffff88009f045c00 x1830967465853568/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.410384:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830967465853568 ext(2301952->2723839) 00010000:00010000:0.0:1746147258.410391:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 35 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.410404:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 35 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746147258.410410:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f045c00 00000100:00100000:0.0:1746147258.410421:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2590 00000100:00100000:0.0:1746147258.410427:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465853568:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147258.410746:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7547 00000100:00100000:3.0:1746147258.410764:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465853440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.410853:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467086592:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.410879:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4194304->4681727] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.410897:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa48200, rc 0) 00000100:00100000:1.0:1746147258.410923:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32042:x1830967465853056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4830us (4930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.410930:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15837 00000100:00100000:3.0:1746147258.416529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.416577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.416602:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465853952 00000100:00100000:3.0:1746147258.416610:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465853952 00002000:00100000:3.0:1746147258.416658:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1646592->2097151) req@ffff88009e6f1c00 x1830967465853952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.416668:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1c00 with x1830967465853952 ext(1646592->2097151) 00002000:00010000:3.0:1746147258.416673:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f1c00 00000100:00100000:2.0:1746147258.416682:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465853824 00000100:00100000:2.0:1746147258.416686:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465853824 00000100:00100000:3.0:1746147258.416692:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7548 00000100:00100000:3.0:1746147258.416699:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465853952:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147258.416704:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009e6f0700 x1830967465853824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.416711:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0700 with x1830967465853824 ext(1048576->2097151) 00002000:00010000:2.0:1746147258.416715:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f0700 00000100:00100000:2.0:1746147258.416735:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7549 00000100:00100000:2.0:1746147258.416740:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465853824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.418653:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465853568:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8220us (8509us total) trans 17179874057 rc 0/0 00000100:00100000:1.0:1746147258.418663:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2590 00002000:00100000:1.0:1746147258.418671:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2301952->2723839) req@ffff88009f045c00 x1830967465853568/t17179874057(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.418679:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830967465853568 ext(2301952->2723839) 00010000:00010000:1.0:1746147258.418686:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 37 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.418699:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 37 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746147258.418710:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f045c00 00000100:00100000:0.0:1746147258.422836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.424411:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465854208 00000100:00100000:1.0:1746147258.424422:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465854208 00010000:00010000:1.0:1746147258.424460:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 37 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.424497:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8084 00000100:00100000:1.0:1746147258.424505:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465854208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.424522:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.424544:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 37 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.424555:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 37 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.424577:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465853440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13819us (15664us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746147258.424578:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891c00/0xb4b2209fbdad19eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2723839) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed122 expref: 37 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.424587:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7547 00002000:00100000:3.0:1746147258.424596:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f045880 x1830967465853440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147258.424597:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.424599:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746147258.424604:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830967465853440 ext(1048576->2097151) 00002000:00010000:3.0:1746147258.424608:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045880 00010000:00010000:1.0:1746147258.424608:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.424615:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.424658:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.424670:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467086720:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.424914:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465853952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8214us (8395us total) trans 0 rc 450560/450560 00000100:00100000:3.0:1746147258.424919:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7548 00002000:00100000:3.0:1746147258.424925:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x421:0x0] (1646592->2097151) req@ffff88009e6f1c00 x1830967465853952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.424932:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1c00 with x1830967465853952 ext(1646592->2097151) 00002000:00010000:3.0:1746147258.424952:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f1c00 00000100:00100000:1.0:1746147258.425059:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.426858:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467086720:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147258.426880:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.427029:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465854208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2524us (4201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.427038:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8084 00000100:00100000:2.0:1746147258.427238:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465853824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10490us (10653us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147258.427249:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7549 00002000:00100000:2.0:1746147258.427259:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009e6f0700 x1830967465853824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.427268:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0700 with x1830967465853824 ext(1048576->2097151) 00002000:00010000:2.0:1746147258.427272:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f0700 00000100:00100000:0.0:1746147258.430477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.430741:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465854336 00000100:00100000:1.0:1746147258.430754:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465854336 00000100:00100000:0.0:1746147258.431156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.431163:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15839 00000100:00100000:1.0:1746147258.431182:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32046:x1830967465854336:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147258.431334:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465854592 00000100:00100000:3.0:1746147258.431340:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465854592 00002000:00100000:3.0:1746147258.431378:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4677632->4681727) req@ffff88009f730e00 x1830967465854592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.431388:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967465854592 ext(4677632->4681727) 00002000:00010000:3.0:1746147258.431394:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f730e00 00000100:00100000:3.0:1746147258.431410:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7550 00000100:00100000:3.0:1746147258.431416:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465854592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.431621:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465854592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 203us (464us total) trans 0 rc 4096/4096 00010000:00010000:1.0:1746147258.431645:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.431664:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed16f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.431689:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.431697:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.431699:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.431702:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.431737:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.431749:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 21 pid: 4444 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.431762:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467086848:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.432270:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.432614:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7550 00002000:00100000:3.0:1746147258.432622:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4677632->4681727) req@ffff88009f730e00 x1830967465854592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.432629:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967465854592 ext(4677632->4681727) 00002000:00010000:3.0:1746147258.432632:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f730e00 00000100:00100000:1.0:1746147258.433671:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467086848:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.433694:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.433778:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa48000, rc 0) 00000100:00100000:1.0:1746147258.433819:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:32046:x1830967465854336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2647us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.433826:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15839 00000100:00100000:0.0:1746147258.434160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.434246:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465854720 00000100:00100000:3.0:1746147258.434251:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465854720 00002000:00100000:3.0:1746147258.434275:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1646591) req@ffff88009f732300 x1830967465854720/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.434284:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732300 with x1830967465854720 ext(1048576->1646591) 00010000:00010000:3.0:1746147258.434290:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 22 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.434301:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 22 pid: 4444 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746147258.434307:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f732300 00000100:00100000:3.0:1746147258.434321:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2591 00000100:00100000:3.0:1746147258.434327:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465854720:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147258.441221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.441357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.441392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.441425:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465854976 00000100:00100000:1.0:1746147258.441437:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465854976 00000100:00100000:3.0:1746147258.441461:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465855232 00000100:00100000:3.0:1746147258.441470:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465855232 00002000:00100000:1.0:1746147258.441483:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012db2ea00 x1830967465854976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.441493:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ea00 with x1830967465854976 ext(2097152->3145727) 00002000:00010000:1.0:1746147258.441498:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2ea00 00002000:00100000:3.0:1746147258.441505:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012db2c000 x1830967465855232/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.441513:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c000 with x1830967465855232 ext(3145728->4194303) 00000100:00100000:1.0:1746147258.441517:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465855488 00002000:00010000:3.0:1746147258.441518:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2c000 00000100:00100000:1.0:1746147258.441519:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465855488 00002000:00100000:1.0:1746147258.441530:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012db2e300 x1830967465855488/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.441536:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e300 with x1830967465855488 ext(2097152->3145727) 00002000:00010000:1.0:1746147258.441540:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2e300 00000100:00100000:3.0:1746147258.441545:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7551 00000100:00100000:3.0:1746147258.441553:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465854976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.441562:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7552 00000100:00100000:1.0:1746147258.441567:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465855232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.441636:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7553 00000100:00100000:2.0:1746147258.441643:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465855488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.443890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.443979:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465855744 00000100:00100000:3.0:1746147258.443986:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465855744 00002000:00100000:3.0:1746147258.444024:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3977215) req@ffff88012db2ed80 x1830967465855744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.444032:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ed80 with x1830967465855744 ext(3145728->3977215) 00002000:00010000:3.0:1746147258.444036:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2ed80 00000100:00100000:3.0:1746147258.444757:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7554 00000100:00100000:3.0:1746147258.444765:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465855744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147258.444876:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465854720:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10541us (10708us total) trans 21474841413 rc 0/0 00000100:00100000:0.0:1746147258.445680:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2591 00002000:00100000:0.0:1746147258.445692:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1646591) req@ffff88009f732300 x1830967465854720/t21474841413(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.445700:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732300 with x1830967465854720 ext(1048576->1646591) 00010000:00010000:0.0:1746147258.445711:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 28 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.445726:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 28 pid: 4444 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746147258.445733:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f732300 00000100:00100000:0.0:1746147258.450335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.451028:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465855872 00000100:00100000:1.0:1746147258.451039:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465855872 00010000:00010000:1.0:1746147258.451072:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 28 pid: 4444 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.451119:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8085 00000100:00100000:1.0:1746147258.451126:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465855872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.451137:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147258.451152:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147257 -> 1746147258 00002000:00010000:1.0:1746147258.451155:0:8494:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147257 -> 1746147258 00010000:00010000:1.0:1746147258.451160:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 28 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.451171:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 28 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.451189:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ede00/0xb4b2209fbdad1990 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed0d5 expref: 28 pid: 4444 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.451220:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.451223:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.451229:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 31 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.451236:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 31 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.451260:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 31 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.451270:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467086976:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147258.452483:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.453024:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465855232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11448us (11658us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147258.453036:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7552 00002000:00100000:1.0:1746147258.453050:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012db2c000 x1830967465855232/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.453059:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2c000 with x1830967465855232 ext(3145728->4194303) 00002000:00010000:1.0:1746147258.453065:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2c000 00000100:00100000:1.0:1746147258.455741:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467086976:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147258.455767:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.455828:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465855872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4702us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.455839:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8085 00000100:00100000:3.0:1746147258.455875:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465855488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14225us (14475us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.455886:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7553 00002000:00100000:3.0:1746147258.455897:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012db2e300 x1830967465855488/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.455905:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2e300 with x1830967465855488 ext(2097152->3145727) 00002000:00010000:3.0:1746147258.455910:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2e300 00000100:00100000:3.0:1746147258.458837:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465854976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17276us (17614us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.458852:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7551 00002000:00100000:3.0:1746147258.458863:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012db2ea00 x1830967465854976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.458873:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ea00 with x1830967465854976 ext(2097152->3145727) 00002000:00010000:3.0:1746147258.458878:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2ea00 00000100:00100000:0.0:1746147258.459371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.459886:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465856128 00000100:00100000:3.0:1746147258.459893:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465856128 00002000:00100000:3.0:1746147258.459927:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f730000 x1830967465856128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.459964:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730000 with x1830967465856128 ext(1048576->2097151) 00002000:00010000:3.0:1746147258.459968:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730000 00000100:00100000:3.0:1746147258.459986:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7555 00000100:00100000:3.0:1746147258.459992:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465856128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.464626:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465855744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19637us (20516us total) trans 0 rc 831488/831488 00000100:00100000:3.0:1746147258.464640:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7554 00002000:00100000:3.0:1746147258.464653:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3977215) req@ffff88012db2ed80 x1830967465855744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.464662:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ed80 with x1830967465855744 ext(3145728->3977215) 00002000:00010000:3.0:1746147258.465001:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2ed80 00000100:00100000:2.0:1746147258.470414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.470972:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465856128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10977us (11598us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.470984:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7555 00002000:00100000:3.0:1746147258.470997:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f730000 x1830967465856128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.471006:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730000 with x1830967465856128 ext(1048576->2097151) 00002000:00010000:3.0:1746147258.471012:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730000 00000100:00100000:1.0:1746147258.471229:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465856256 00000100:00100000:1.0:1746147258.471239:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465856256 00000100:00100000:1.0:1746147258.471307:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15840 00000100:00100000:1.0:1746147258.471318:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465856256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.471336:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.471355:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed176 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.471381:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.471383:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.471394:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.471410:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.471422:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa48600, rc 0) 00000100:00100000:1.0:1746147258.471478:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465856256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 162us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.471485:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15840 00000100:00100000:0.0:1746147258.480274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.480381:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465856384 00000100:00100000:1.0:1746147258.480391:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465856384 00000100:00100000:1.0:1746147258.480451:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15841 00000100:00100000:1.0:1746147258.480465:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465856384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.480484:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.480503:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa49000/0xb4b2209fbdad1a54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed17d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.480605:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467087104:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147258.480738:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.481865:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467087104:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147258.481891:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa49000/0xb4b2209fbdad1a54 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed17d expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.481902:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa49000/0xb4b2209fbdad1a54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed17d expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.482123:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49000, rc 0) 00000100:00100000:1.0:1746147258.482167:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465856384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1703us (1901us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147258.482174:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15841 00000100:00100000:2.0:1746147258.482281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.482424:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465856512 00000100:00100000:1.0:1746147258.482430:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465856512 00000100:00100000:1.0:1746147258.482452:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15842 00000100:00100000:1.0:1746147258.482457:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465856512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.482467:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.482478:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1a5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed184 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.482508:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467087232:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147258.482553:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.483028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.483135:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465856768 00000100:00100000:3.0:1746147258.483139:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465856768 00002000:00100000:3.0:1746147258.483168:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4681728->4976639) req@ffff88009f731880 x1830967465856768/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.483178:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731880 with x1830967465856768 ext(4681728->4976639) 00002000:00010000:3.0:1746147258.483182:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f731880 00000100:00100000:3.0:1746147258.483205:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7556 00000100:00100000:3.0:1746147258.483211:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465856768:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:1.0:1746147258.484257:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147257 -> 1746147258 00002000:00010000:1.0:1746147258.484262:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147257 -> 1746147258 00002000:00010000:1.0:1746147258.484264:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147257 -> 1746147258 00000100:00100000:1.0:1746147258.484284:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467087232:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147258.484312:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1a5b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed184 expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.484323:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49a00/0xb4b2209fbdad1a5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed184 expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.484333:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49a00, rc 0) 00000100:00100000:1.0:1746147258.484362:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967465856512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1905us (2083us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147258.484368:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15842 00000100:00100000:3.0:1746147258.487081:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465856768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 3860us (4043us total) trans 0 rc 294912/294912 00000100:00100000:3.0:1746147258.487094:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7556 00002000:00100000:3.0:1746147258.487121:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4681728->4976639) req@ffff88009f731880 x1830967465856768/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 294912/294912 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.487132:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731880 with x1830967465856768 ext(4681728->4976639) 00002000:00010000:3.0:1746147258.487137:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f731880 00000100:00100000:0.0:1746147258.488817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.490357:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465856896 00000100:00100000:1.0:1746147258.490369:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465856896 00000100:00100000:1.0:1746147258.490433:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15843 00000100:00100000:1.0:1746147258.490442:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32046:x1830967465856896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.490462:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.490483:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed18b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.490511:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.490518:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.490519:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.490522:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.490553:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.490565:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 19 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.490577:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467087360:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.490683:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.492548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.492613:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465857024 00000100:00100000:2.0:1746147258.492621:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465857024 00000100:00100000:2.0:1746147258.492671:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15844 00000100:00100000:2.0:1746147258.492678:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+32:32052:x1830967465857024:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.492693:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.492706:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed192 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.492734:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.492741:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147258.492743:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147258.492746:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2543616->3014655] (req 2543616->3014655) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.492773:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.492783:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 23 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.492793:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467087488:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.492873:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.494599:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467087360:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.494630:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.494637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.494646:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa48e00, rc 0) 00000100:00100000:0.0:1746147258.494681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.494686:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32046:x1830967465856896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4245us (5874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.494695:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15843 00000100:00100000:0.0:1746147258.494704:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465857280 00000100:00100000:0.0:1746147258.494709:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465857280 00000100:00100000:3.0:1746147258.494726:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465857152 00000100:00100000:3.0:1746147258.494729:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465857152 00002000:00100000:0.0:1746147258.494742:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3977216->4194303) req@ffff8800a4faea00 x1830967465857280/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.494744:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4681727) req@ffff8800a4fac000 x1830967465857152/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.494751:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967465857152 ext(4194304->4681727) 00002000:00100000:0.0:1746147258.494751:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faea00 with x1830967465857280 ext(3977216->4194303) 00010000:00010000:3.0:1746147258.494757:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 20 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.494757:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 24 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.494766:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 20 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.494766:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 24 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746147258.494772:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4fac000 00002000:00010000:0.0:1746147258.494772:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4faea00 00000100:00100000:3.0:1746147258.494788:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2592 00000100:00100000:3.0:1746147258.494794:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967465857152:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147258.494804:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467087488:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.494819:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2543616->3014655] (req 2543616->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.494828:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c99400, rc 0) 00000100:00100000:2.0:1746147258.494847:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:32052:x1830967465857024:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2169us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.494852:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15844 00000100:00100000:0.0:1746147258.494916:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2593 00000100:00100000:0.0:1746147258.494921:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465857280:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147258.501027:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465857280:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6097us (6383us total) trans 21474841414 rc 0/0 00000100:00100000:2.0:1746147258.501038:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2593 00002000:00100000:2.0:1746147258.501048:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3977216->4194303) req@ffff8800a4faea00 x1830967465857280/t21474841414(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.501056:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faea00 with x1830967465857280 ext(3977216->4194303) 00010000:00010000:2.0:1746147258.501065:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 26 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.501075:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 26 pid: 8481 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.501081:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4faea00 00000100:00100000:3.0:1746147258.504739:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465857152:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9932us (10045us total) trans 17179874058 rc 0/0 00000100:00100000:3.0:1746147258.504754:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2592 00002000:00100000:3.0:1746147258.504766:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4681727) req@ffff8800a4fac000 x1830967465857152/t17179874058(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.504776:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967465857152 ext(4194304->4681727) 00010000:00010000:3.0:1746147258.504787:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 22 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.504802:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 22 pid: 8480 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746147258.504809:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4fac000 00000100:00100000:0.0:1746147258.510063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.510093:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465857408 00000100:00100000:1.0:1746147258.510113:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465857408 00010000:00010000:1.0:1746147258.510152:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 26 pid: 8481 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.510189:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8086 00000100:00100000:1.0:1746147258.510197:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465857408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.510210:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.510231:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 26 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.510246:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 26 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.510268:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f891000/0xb4b2209fbdad1a1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3977216->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed145 expref: 26 pid: 8481 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.510294:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.510296:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.510304:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 32 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.510312:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 32 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.510344:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 32 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.510356:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467087616:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147258.510433:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.511546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.511631:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465857536 00000100:00100000:2.0:1746147258.511641:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465857536 00010000:00010000:2.0:1746147258.511674:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 22 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.511713:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8087 00000100:00100000:2.0:1746147258.511720:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465857536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147258.511735:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147258.511753:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 22 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.511764:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 22 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.511783:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48200/0xb4b2209fbdad1a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed161 expref: 22 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.511811:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.511813:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.511820:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.511827:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.511896:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.511907:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467087744:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147258.512033:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.512078:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467087616:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147258.512094:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.512131:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465857408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1934us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.512132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.512139:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8086 00000100:00100000:2.0:1746147258.512218:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465857792 00000100:00100000:2.0:1746147258.512222:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465857792 00002000:00100000:2.0:1746147258.512247:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2543616->2547711) req@ffff88012d499880 x1830967465857792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.512260:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967465857792 ext(2543616->2547711) 00002000:00010000:2.0:1746147258.512264:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:2.0:1746147258.512367:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7557 00000100:00100000:2.0:1746147258.512374:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465857792:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.512490:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465857792:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 116us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.512497:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7557 00002000:00100000:2.0:1746147258.512502:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2543616->2547711) req@ffff88012d499880 x1830967465857792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.512508:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967465857792 ext(2543616->2547711) 00002000:00010000:2.0:1746147258.512511:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:0.0:1746147258.517519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.517566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.517585:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465858048 00000100:00100000:1.0:1746147258.517594:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465858048 00002000:00100000:1.0:1746147258.517638:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a4fac380 x1830967465858048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147258.517644:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465858304 00000100:00100000:2.0:1746147258.517647:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465858304 00002000:00100000:1.0:1746147258.517648:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac380 with x1830967465858048 ext(2097152->3145727) 00002000:00010000:1.0:1746147258.517654:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fac380 00002000:00100000:2.0:1746147258.517665:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2543615) req@ffff8800a4fac700 x1830967465858304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.517671:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac700 with x1830967465858304 ext(2097152->2543615) 00000100:00100000:1.0:1746147258.517673:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7558 00002000:00010000:2.0:1746147258.517674:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac700 00000100:00100000:1.0:1746147258.517680:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465858048:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.517684:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7559 00000100:00100000:2.0:1746147258.517687:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465858304:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147258.517797:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467087744:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.517818:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.517869:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465857536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6149us (6326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.517877:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8087 00000100:00100000:0.0:1746147258.518422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.518436:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465858560 00000100:00100000:0.0:1746147258.518439:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465858560 00002000:00100000:0.0:1746147258.518455:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3010560->3014655) req@ffff8800a4fad180 x1830967465858560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.518462:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967465858560 ext(3010560->3014655) 00002000:00010000:0.0:1746147258.518465:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad180 00000100:00100000:0.0:1746147258.518476:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7560 00000100:00100000:0.0:1746147258.518481:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465858560:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147258.518575:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465858560:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 93us (153us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147258.518581:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7560 00002000:00100000:0.0:1746147258.518586:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3010560->3014655) req@ffff8800a4fad180 x1830967465858560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.518591:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967465858560 ext(3010560->3014655) 00002000:00010000:0.0:1746147258.518594:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad180 00000100:00100000:1.0:1746147258.526588:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465858048:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8896us (9068us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147258.526601:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7558 00002000:00100000:1.0:1746147258.526615:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a4fac380 x1830967465858048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.526626:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac380 with x1830967465858048 ext(2097152->3145727) 00002000:00010000:1.0:1746147258.526632:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fac380 00000100:00100000:2.0:1746147258.528252:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465858304:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10557us (10679us total) trans 0 rc 446464/446464 00000100:00100000:2.0:1746147258.528261:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7559 00002000:00100000:2.0:1746147258.528270:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2543615) req@ffff8800a4fac700 x1830967465858304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 446464/446464 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.528278:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac700 with x1830967465858304 ext(2097152->2543615) 00002000:00010000:2.0:1746147258.528283:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac700 00000100:00100000:0.0:1746147258.531762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.531805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.531834:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465859072 00000100:00100000:2.0:1746147258.531853:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465859072 00002000:00100000:2.0:1746147258.531908:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a4faca80 x1830967465859072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.531920:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faca80 with x1830967465859072 ext(3145728->4194303) 00002000:00010000:2.0:1746147258.531926:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faca80 00000100:00100000:2.0:1746147258.531969:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465858944 00000100:00100000:2.0:1746147258.531972:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465858944 00002000:00100000:2.0:1746147258.531987:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3014656->3145727) req@ffff8800a4faf100 x1830967465858944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.531995:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf100 with x1830967465858944 ext(3014656->3145727) 00002000:00010000:2.0:1746147258.531998:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4faf100 00000100:00100000:2.0:1746147258.532025:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7561 00000100:00100000:2.0:1746147258.532031:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465859072:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147258.532065:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7562 00000100:00100000:0.0:1746147258.532078:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967465858944:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147258.533120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.533488:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465859328 00000100:00100000:3.0:1746147258.533496:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465859328 00002000:00100000:3.0:1746147258.533528:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a4fae300 x1830967465859328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.533536:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967465859328 ext(3145728->4194303) 00002000:00010000:3.0:1746147258.533541:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:3.0:1746147258.533745:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7563 00000100:00100000:3.0:1746147258.533752:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465859328:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.537523:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465858944:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 5439us (5707us total) trans 0 rc 131072/131072 00000100:00100000:2.0:1746147258.537534:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7562 00002000:00100000:2.0:1746147258.537546:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3014656->3145727) req@ffff8800a4faf100 x1830967465858944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 131072/131072 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.537556:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf100 with x1830967465858944 ext(3014656->3145727) 00002000:00010000:2.0:1746147258.537562:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4faf100 00000100:00100000:2.0:1746147258.544069:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465859072:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12025us (12302us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147258.544081:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7561 00002000:00100000:2.0:1746147258.544091:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a4faca80 x1830967465859072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.544110:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faca80 with x1830967465859072 ext(3145728->4194303) 00002000:00010000:2.0:1746147258.544115:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faca80 00000100:00100000:3.0:1746147258.545689:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465859328:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11932us (12566us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.545698:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7563 00002000:00100000:3.0:1746147258.545705:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a4fae300 x1830967465859328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.545712:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967465859328 ext(3145728->4194303) 00002000:00010000:3.0:1746147258.545717:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:0.0:1746147258.551149:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.551234:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465859584 00000100:00100000:3.0:1746147258.551242:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465859584 00002000:00100000:3.0:1746147258.551281:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012b0c0380 x1830967465859584/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.551289:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0380 with x1830967465859584 ext(4194304->4976639) 00002000:00010000:3.0:1746147258.551294:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0380 00000100:00100000:3.0:1746147258.551323:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7564 00000100:00100000:3.0:1746147258.551328:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465859584:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.555673:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465859584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 4335us (4523us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147258.555682:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7564 00002000:00100000:3.0:1746147258.555695:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012b0c0380 x1830967465859584/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.555704:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0380 with x1830967465859584 ext(4194304->4976639) 00002000:00010000:3.0:1746147258.555710:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0380 00000100:00100000:0.0:1746147258.662042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.662140:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465859712 00000100:00100000:2.0:1746147258.662147:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465859712 00000100:00100000:2.0:1746147258.662197:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15845 00000100:00100000:2.0:1746147258.662204:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:32057:x1830967465859712:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.662218:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.662231:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed199 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.662255:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.662263:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.662267:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.662269:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.662272:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1196032->1433599] (req 1196032->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.662300:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.662310:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 24 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.662320:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467087872:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.663649:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.663660:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.663669:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467088000:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.663718:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.667140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.667256:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467087872:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.667358:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465859840 00000100:00100000:3.0:1746147258.667363:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465859840 00010000:00010000:3.0:1746147258.667392:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 25 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.667427:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8088 00000100:00100000:3.0:1746147258.667433:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465859840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.667444:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.667461:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 25 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.667469:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 25 pid: 8480 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.667485:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1a4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed176 expref: 25 pid: 8480 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.667599:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467088000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.667622:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1196032->1433599] (req 1196032->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.667633:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c99c00, rc 0) 00000100:00100000:2.0:1746147258.667674:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:32057:x1830967465859712:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5470us (5637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.667683:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15845 00010000:00010000:3.0:1746147258.667871:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.667902:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465859840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 468us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.668085:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8088 00000100:00100000:0.0:1746147258.668617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.668727:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465859968 00000100:00100000:3.0:1746147258.668731:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465859968 00010000:00010000:3.0:1746147258.668745:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.668759:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8089 00000100:00100000:3.0:1746147258.668765:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465859968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.668772:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.668781:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.668790:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.668803:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48000/0xb4b2209fbdad1a46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed16f expref: 34 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.668812:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.668813:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.668819:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.668827:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.668854:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.668863:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467088128:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.670046:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.672885:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467088128:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147258.672913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.672990:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465860224 00000100:00100000:2.0:1746147258.673004:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465860224 00002000:00100000:2.0:1746147258.673039:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1196032->1200127) req@ffff88012b0c1180 x1830967465860224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.673047:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1180 with x1830967465860224 ext(1196032->1200127) 00002000:00010000:2.0:1746147258.673051:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c1180 00010000:00010000:3.0:1746147258.673064:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147258.673069:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7565 00000100:00100000:2.0:1746147258.673075:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967465860224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147258.673111:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967465859968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4345us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.673119:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8089 00000100:00100000:2.0:1746147258.673207:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967465860224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 132us (294us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.673213:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7565 00002000:00100000:2.0:1746147258.673217:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1196032->1200127) req@ffff88012b0c1180 x1830967465860224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.673223:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1180 with x1830967465860224 ext(1196032->1200127) 00002000:00010000:2.0:1746147258.673226:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c1180 00000100:00100000:0.0:1746147258.675798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.676198:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465860480 00000100:00100000:2.0:1746147258.676205:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465860480 00002000:00100000:2.0:1746147258.676231:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1429504->1433599) req@ffff88012b0c0000 x1830967465860480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.676237:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0000 with x1830967465860480 ext(1429504->1433599) 00002000:00010000:2.0:1746147258.676241:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0000 00000100:00100000:2.0:1746147258.676260:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7566 00000100:00100000:2.0:1746147258.676266:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465860480:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.676390:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967465860480:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 124us (598us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.676394:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7566 00002000:00100000:2.0:1746147258.676397:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1429504->1433599) req@ffff88012b0c0000 x1830967465860480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.676402:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0000 with x1830967465860480 ext(1429504->1433599) 00002000:00010000:2.0:1746147258.676404:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0000 00000100:00100000:0.0:1746147258.718075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.718146:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465860608 00000100:00100000:2.0:1746147258.718153:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465860608 00000100:00100000:2.0:1746147258.718200:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15846 00000100:00100000:2.0:1746147258.718207:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32059:x1830967465860608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.718222:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.718237:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1a0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.718259:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 32 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.718266:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147258.718268:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147258.718271:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2375680->2969599] (req 2375680->2969599) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.718300:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 32 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.718314:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 32 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.718323:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467088256:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.718403:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.719220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.719339:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465860736 00000100:00100000:1.0:1746147258.719344:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465860736 00000100:00100000:1.0:1746147258.719478:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15847 00000100:00100000:1.0:1746147258.719485:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465860736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.719493:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.719503:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1a7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1a7 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.719528:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467088384:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147258.719577:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.720026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.720049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.720130:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467088256:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.720150:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2375680->2969599] (req 2375680->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.720160:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c98600, rc 0) 00000100:00100000:3.0:1746147258.720182:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465860864 00000100:00100000:3.0:1746147258.720186:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465860864 00000100:00100000:0.0:1746147258.720190:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32059:x1830967465860608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1983us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.720196:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15846 00000100:00100000:3.0:1746147258.720204:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465860992 00000100:00100000:3.0:1746147258.720206:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465860992 00000100:00100000:0.0:1746147258.720214:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15848 00000100:00100000:3.0:1746147258.720219:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15849 00000100:00100000:0.0:1746147258.720220:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465860864:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147258.720224:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465860992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147258.720226:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.720231:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147258.720234:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1ae expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.720237:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093782600/0xb4b2209fbdad1a8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1b5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.720245:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.720246:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.720251:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147258.720258:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467088512:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147258.720260:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.720274:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbe600, rc 0) 00000100:00100000:3.0:1746147258.720286:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.720288:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465860864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.720293:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15848 00000100:00100000:0.0:1746147258.721194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.721260:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465861120 00000100:00100000:2.0:1746147258.721265:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465861120 00002000:00100000:2.0:1746147258.721287:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2543616->3014655) req@ffff880134c56a00 x1830967465861120/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.721294:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56a00 with x1830967465861120 ext(2543616->3014655) 00010000:00010000:2.0:1746147258.721299:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 33 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.721308:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 33 pid: 4445 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.721313:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c56a00 00000100:00100000:2.0:1746147258.721325:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2594 00000100:00100000:2.0:1746147258.721330:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967465861120:12345-192.168.203.36@tcp:4:multiop.0 00002000:00010000:0.0:1746147258.723112:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147257 -> 1746147258 00000100:00100000:0.0:1746147258.723134:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467088384:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147258.723160:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1a7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a7 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.723170:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1a7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a7 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.723181:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49c00, rc 0) 00000100:00100000:0.0:1746147258.723208:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465860736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3724us (3988us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147258.723214:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15847 00000100:00100000:3.0:1746147258.723439:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467088512:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.723456:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093782600/0xb4b2209fbdad1a8c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1b5 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.723465:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093782600/0xb4b2209fbdad1a8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1b5 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.723482:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782600, rc 0) 00000100:00100000:3.0:1746147258.723513:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465860992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3288us (3463us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.723520:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15849 00000100:00100000:1.0:1746147258.730020:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967465861120:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8681us (8819us total) trans 21474841415 rc 0/0 00000100:00100000:1.0:1746147258.730030:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2594 00002000:00100000:1.0:1746147258.730040:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2543616->3014655) req@ffff880134c56a00 x1830967465861120/t21474841415(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.730065:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56a00 with x1830967465861120 ext(2543616->3014655) 00010000:00010000:1.0:1746147258.730074:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 35 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.730087:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 35 pid: 4445 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746147258.730092:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c56a00 00000100:00100000:0.0:1746147258.732499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.732610:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465861248 00000100:00100000:3.0:1746147258.732618:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465861248 00000100:00100000:3.0:1746147258.732665:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15850 00000100:00100000:3.0:1746147258.732672:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0598c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32063:x1830967465861248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147258.732686:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.732698:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1bc expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.732722:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.732728:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147258.732730:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147258.732733:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.732756:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.732768:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 34 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.732777:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467088640:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.732847:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.734187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.734361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.734400:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467088640:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.734411:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465861504 00000100:00100000:1.0:1746147258.734415:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465861504 00010000:00010000:2.0:1746147258.734426:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.734442:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782400, rc 0) 00002000:00100000:1.0:1746147258.734442:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1196032->1433599) req@ffff880134c56300 x1830967465861504/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.734450:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56300 with x1830967465861504 ext(1196032->1433599) 00010000:00010000:1.0:1746147258.734455:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 35 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.734464:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 35 pid: 4445 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746147258.734470:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c56300 00000100:00100000:2.0:1746147258.734486:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0598c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32063:x1830967465861248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1814us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.734486:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2595 00000100:00100000:1.0:1746147258.734491:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465861504:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147258.734492:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15850 00000100:00100000:3.0:1746147258.734635:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465861376 00000100:00100000:3.0:1746147258.734642:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465861376 00010000:00010000:3.0:1746147258.734670:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 36 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.734834:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8090 00000100:00100000:3.0:1746147258.734842:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465861376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.734853:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.734874:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 37 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.734885:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 37 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.734906:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1a69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3014655) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed192 expref: 37 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.735498:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.735501:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.735509:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.735519:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.735551:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.735563:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467088768:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.736019:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.737469:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465861504:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2971us (3101us total) trans 21474841416 rc 0/0 00000100:00100000:2.0:1746147258.737479:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2595 00002000:00100000:2.0:1746147258.737489:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1196032->1433599) req@ffff880134c56300 x1830967465861504/t21474841416(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.737496:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56300 with x1830967465861504 ext(1196032->1433599) 00010000:00010000:2.0:1746147258.737505:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 37 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.737517:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 37 pid: 4445 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.737523:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c56300 00000100:00100000:3.0:1746147258.738678:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467088768:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.738697:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.738736:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465861376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3895us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.738743:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8090 00000100:00100000:0.0:1746147258.739315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.739350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.739413:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465861760 00000100:00100000:2.0:1746147258.739421:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465861760 00002000:00100000:2.0:1746147258.739453:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2375680->2379775) req@ffff880134c54000 x1830967465861760/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.739462:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967465861760 ext(2375680->2379775) 00002000:00010000:2.0:1746147258.739466:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:2.0:1746147258.739480:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7567 00000100:00100000:2.0:1746147258.739492:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465861760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.739557:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465861888 00000100:00100000:3.0:1746147258.739561:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465861888 00010000:00010000:3.0:1746147258.739577:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 36 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.739611:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8091 00000100:00100000:3.0:1746147258.739616:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465861888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.739624:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.739638:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 36 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.739653:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 36 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.739816:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1a70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed199 expref: 36 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.739869:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465861760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 377us (555us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.739876:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7567 00002000:00100000:2.0:1746147258.739881:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2375680->2379775) req@ffff880134c54000 x1830967465861760/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.739891:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967465861760 ext(2375680->2379775) 00002000:00010000:2.0:1746147258.739894:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54000 00010000:00010000:3.0:1746147258.739912:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.739915:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.739922:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.739931:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.740072:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.740084:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467088896:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147258.740314:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.742664:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467088896:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147258.742684:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.742887:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465861888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3269us (3534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.742898:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8091 00000100:00100000:0.0:1746147258.744551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.744674:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465862144 00000100:00100000:2.0:1746147258.744682:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465862144 00002000:00100000:2.0:1746147258.744720:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134c54a80 x1830967465862144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.744728:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54a80 with x1830967465862144 ext(1048576->2097151) 00002000:00010000:2.0:1746147258.744732:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54a80 00000100:00100000:2.0:1746147258.744750:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7568 00000100:00100000:2.0:1746147258.744756:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465862144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.745188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.745255:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465862400 00000100:00100000:0.0:1746147258.745258:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465862400 00002000:00100000:0.0:1746147258.745274:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2965504->2969599) req@ffff88012d49bb80 x1830967465862400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.745280:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49bb80 with x1830967465862400 ext(2965504->2969599) 00002000:00010000:0.0:1746147258.745284:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49bb80 00000100:00100000:0.0:1746147258.745433:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7569 00000100:00100000:0.0:1746147258.745439:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465862400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147258.745928:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465862400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 488us (739us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147258.745934:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7569 00002000:00100000:0.0:1746147258.745956:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2965504->2969599) req@ffff88012d49bb80 x1830967465862400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.745963:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49bb80 with x1830967465862400 ext(2965504->2969599) 00002000:00010000:0.0:1746147258.745966:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49bb80 00000100:00100000:2.0:1746147258.753140:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465862144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8373us (8581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147258.753152:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7568 00002000:00100000:2.0:1746147258.753166:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134c54a80 x1830967465862144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.753174:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54a80 with x1830967465862144 ext(1048576->2097151) 00002000:00010000:2.0:1746147258.753180:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54a80 00000100:00100000:0.0:1746147258.763287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.763330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.763428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.763470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.763584:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465862656 00000100:00100000:3.0:1746147258.763594:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465862656 00000100:00100000:0.0:1746147258.763595:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465862912 00000100:00100000:0.0:1746147258.763599:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465862912 00002000:00100000:3.0:1746147258.763636:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c55500 x1830967465862656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.763636:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c54e00 x1830967465862912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.763646:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55500 with x1830967465862656 ext(2097152->3145727) 00002000:00100000:0.0:1746147258.763646:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54e00 with x1830967465862912 ext(3145728->4194303) 00002000:00010000:3.0:1746147258.763652:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55500 00002000:00010000:0.0:1746147258.763652:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54e00 00000100:00100000:3.0:1746147258.763669:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465863168 00000100:00100000:3.0:1746147258.763671:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465863168 00000100:00100000:1.0:1746147258.763678:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465863424 00002000:00100000:3.0:1746147258.763681:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3739647) req@ffff880134c54380 x1830967465863168/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 504/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147258.763682:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465863424 00002000:00100000:3.0:1746147258.763688:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967465863168 ext(2097152->3739647) 00002000:00010000:3.0:1746147258.763691:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54380 00002000:00100000:1.0:1746147258.763698:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3739648->4194303) req@ffff880134c54700 x1830967465863424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.763705:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54700 with x1830967465863424 ext(3739648->4194303) 00000100:00100000:3.0:1746147258.763706:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7570 00002000:00010000:1.0:1746147258.763708:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54700 00000100:00100000:3.0:1746147258.763711:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465862912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147258.763720:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7571 00000100:00100000:2.0:1746147258.763728:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465862656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.763731:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7572 00000100:00100000:1.0:1746147258.763736:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465863168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.763780:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7573 00000100:00100000:3.0:1746147258.764958:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465863424:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.770516:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465862912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6792us (7173us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.770528:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7570 00002000:00100000:3.0:1746147258.770541:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c54e00 x1830967465862912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.770551:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54e00 with x1830967465862912 ext(3145728->4194303) 00002000:00010000:3.0:1746147258.770556:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54e00 00000100:00100000:2.0:1746147258.773761:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465862656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10023us (10474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147258.773773:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7571 00002000:00100000:2.0:1746147258.773785:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c55500 x1830967465862656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.773794:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55500 with x1830967465862656 ext(2097152->3145727) 00002000:00010000:2.0:1746147258.773799:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55500 00000100:00100000:1.0:1746147258.776653:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465863168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12904us (13213us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147258.776666:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7572 00002000:00100000:1.0:1746147258.776679:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3739647) req@ffff880134c54380 x1830967465863168/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 504/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.776689:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967465863168 ext(2097152->3739647) 00002000:00010000:1.0:1746147258.776695:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:3.0:1746147258.779360:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465863424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15565us (15880us total) trans 0 rc 454656/454656 00000100:00100000:3.0:1746147258.779376:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7573 00002000:00100000:3.0:1746147258.779387:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3739648->4194303) req@ffff880134c54700 x1830967465863424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 454656/454656 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.779397:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54700 with x1830967465863424 ext(3739648->4194303) 00002000:00010000:3.0:1746147258.779403:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54700 00000100:00100000:0.0:1746147258.787674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.787711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.787800:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465863552 00000100:00100000:1.0:1746147258.787801:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465863680 00000100:00100000:2.0:1746147258.787810:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465863552 00000100:00100000:1.0:1746147258.787810:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465863680 00000100:00100000:0.0:1746147258.787870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.787912:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15851 00000100:00100000:1.0:1746147258.787920:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465863680:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147258.787923:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15852 00000100:00100000:2.0:1746147258.787930:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465863552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147258.787964:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.787964:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.787980:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1c3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.787980:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1a9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1ca expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.788001:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.788004:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.788013:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.788029:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147258.788031:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467089024:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147258.788038:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c99c00, rc 0) 00000100:00100000:2.0:1746147258.788084:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465863552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 153us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.788090:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15852 00000100:00100000:1.0:1746147258.788117:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.788217:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465863936 00000100:00100000:3.0:1746147258.788221:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465863936 00002000:00100000:3.0:1746147258.788251:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134c56680 x1830967465863936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.788259:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56680 with x1830967465863936 ext(4194304->4976639) 00002000:00010000:3.0:1746147258.788263:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56680 00000100:00100000:3.0:1746147258.788290:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7574 00000100:00100000:3.0:1746147258.788295:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465863936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.789527:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467089024:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147258.789558:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1a9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ca expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.789570:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1a9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ca expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.789597:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49c00, rc 0) 00000100:00100000:1.0:1746147258.789949:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465863680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2014us (2221us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147258.789957:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15851 00000100:00100000:3.0:1746147258.793410:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465863936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5102us (5527us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147258.793423:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7574 00002000:00100000:3.0:1746147258.793436:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134c56680 x1830967465863936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.793446:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56680 with x1830967465863936 ext(4194304->4976639) 00002000:00010000:3.0:1746147258.793453:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56680 00000100:00100000:0.0:1746147258.799873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.799978:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465864192 00000100:00100000:3.0:1746147258.799988:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465864192 00002000:00100000:3.0:1746147258.800033:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134c57b80 x1830967465864192/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.800050:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57b80 with x1830967465864192 ext(1048576->2097151) 00002000:00010000:3.0:1746147258.800055:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c57b80 00000100:00100000:3.0:1746147258.800087:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7575 00000100:00100000:3.0:1746147258.800094:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465864192:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147258.806672:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465864192:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6567us (6798us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147258.806682:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7575 00002000:00100000:3.0:1746147258.806693:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134c57b80 x1830967465864192/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147258.806700:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57b80 with x1830967465864192 ext(1048576->2097151) 00002000:00010000:3.0:1746147258.806705:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c57b80 00000100:00100000:0.0:1746147258.812844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.814552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.814737:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465864320 00000100:00100000:1.0:1746147258.814747:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465864320 00000100:00100000:1.0:1746147258.814805:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15853 00000100:00100000:1.0:1746147258.814812:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32067:x1830967465864320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147258.814830:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.814846:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1d1 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.814875:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.814882:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.814883:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147258.814891:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.814922:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.814934:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 25 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.814958:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467089152:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.815037:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.815195:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465864448 00000100:00100000:2.0:1746147258.815200:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465864448 00000100:00100000:2.0:1746147258.815240:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11502 00000100:00100000:2.0:1746147258.815245:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+20:32069:x1830967465864448:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147258.815260:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.815272:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99000/0xb4b2209fbdad1aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1d8 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.815325:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815340:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815616:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815629:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815635:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815639:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815742:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815751:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 329 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.815758:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 39 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.815762:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.815779:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 39 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.815785:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 39 pid: 14125 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.815792:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089280:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.815836:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 329 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.815843:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 329 pid: 14125 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.815850:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089408:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.815864:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.818370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.818395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.818405:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467089152:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.818432:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089280:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.818436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.818437:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.818442:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089408:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.818453:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa49600, rc 0) 00010000:00010000:2.0:1746147258.818465:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147258.818472:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465864832 00000100:00100000:0.0:1746147258.818478:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465864832 00000100:00100000:2.0:1746147258.818496:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465864576 00000100:00100000:1.0:1746147258.818498:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32067:x1830967465864320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3685us (5662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.818499:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465864576 00000100:00100000:1.0:1746147258.818506:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15853 00000100:00100000:0.0:1746147258.818512:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865088 00000100:00100000:0.0:1746147258.818514:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865088 00002000:00100000:2.0:1746147258.818523:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2375680->2969599) req@ffff880090508a80 x1830967465864576/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.818533:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508a80 with x1830967465864576 ext(2375680->2969599) 00000100:00100000:0.0:1746147258.818533:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4817 00010000:00010000:2.0:1746147258.818539:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 26 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.818539:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+40:19602:x1830967465864832:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147258.818540:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4818 00000100:00100000:3.0:1746147258.818548:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+330:7641:x1830967465865088:12345-192.168.203.36@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746147258.818550:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 26 pid: 4445 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.818556:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090508a80 00000100:00100000:2.0:1746147258.818577:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2596 00000100:00100000:2.0:1746147258.818583:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465864576:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147258.818757:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+41:19602:x1830967465864832:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 217us (393us total) trans 8589945517 rc 0/0 00000100:00100000:0.0:1746147258.818763:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4817 00000100:00100000:3.0:1746147258.818788:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+331:7641:x1830967465865088:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 242us (391us total) trans 8589945516 rc 0/0 00000100:00100000:3.0:1746147258.818794:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4818 00000100:00100000:0.0:1746147258.821399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.821453:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865216 00000100:00100000:3.0:1746147258.821460:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865216 00010000:00010000:3.0:1746147258.821491:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 41 pid: 14125 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.821522:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8092 00000100:00100000:3.0:1746147258.821527:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+41:1957:x1830967465865216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.821538:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.821542:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 41 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.821550:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 41 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.821567:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad19f9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed129 expref: 41 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.821582:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.821586:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.821592:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.821595:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.821597:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.821633:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+40:1957:x1830967465865216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.821638:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8092 00000100:00100000:1.0:1746147258.821788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.821801:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865344 00000100:00100000:1.0:1746147258.821804:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865344 00010000:00010000:1.0:1746147258.821818:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 331 pid: 14125 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.821830:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8093 00000100:00100000:1.0:1746147258.821835:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+331:1956:x1830967465865344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.821841:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.821844:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 331 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.821855:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 331 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.821867:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad19dd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed11b expref: 331 pid: 14125 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.821884:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147258.821887:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.821894:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.821900:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.821921:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.821934:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1956:x1830967465865344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.821956:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8093 00010000:00010000:3.0:1746147258.822297:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822304:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147258.822347:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147258.822351:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147258.822366:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822375:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822383:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822389:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822395:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822400:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4c99400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147258.822404:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822411:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822419:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147258.822421:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147258.822425:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822429:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99400/0xb4b2209fbdad1ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822437:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822442:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822447:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822451:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4c98000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147258.822454:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822458:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822463:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76500) 00010000:00010000:3.0:1746147258.822465:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147258.822467:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822472:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98000/0xb4b2209fbdad1abd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.822505:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c99000/0xb4b2209fbdad1aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.822515:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.822521:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.822522:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147258.822524:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c98200, rc 0) 00000100:00100000:3.0:1746147258.822558:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+21:32069:x1830967465864448:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7313us (8010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.822565:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11502 00000100:00100000:2.0:1746147258.825932:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465864576:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7338us (7484us total) trans 21474841417 rc 0/0 00000100:00100000:2.0:1746147258.825968:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2596 00002000:00100000:2.0:1746147258.825979:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2375680->2969599) req@ffff880090508a80 x1830967465864576/t21474841417(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:634/0 lens 488/448 e 0 to 0 dl 1746147269 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.825988:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508a80 with x1830967465864576 ext(2375680->2969599) 00010000:00010000:2.0:1746147258.825998:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 28 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.826013:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 28 pid: 4445 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746147258.826021:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090508a80 00000100:00100000:0.0:1746147258.826319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.826378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.826403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.826420:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865472 00000100:00100000:0.0:1746147258.826426:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865472 00000100:00100000:0.0:1746147258.826453:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865728 00000100:00100000:0.0:1746147258.826455:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865728 00000100:00100000:3.0:1746147258.826460:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865600 00000100:00100000:3.0:1746147258.826465:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865600 00000100:00100000:0.0:1746147258.826468:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15854 00000100:00100000:0.0:1746147258.826473:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465865472:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147258.826487:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15855 00010000:00010000:0.0:1746147258.826487:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147258.826492:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465865728:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.826502:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147258.826502:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1df expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.826512:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1ed expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.826519:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.826522:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.826524:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.826525:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.826530:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.826530:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.826542:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.826543:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.826552:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782a00, rc 0) 00010000:00010000:0.0:1746147258.826552:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ec00, rc 0) 00000100:00100000:0.0:1746147258.826569:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465865472:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.826572:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465865728:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.826573:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15854 00000100:00100000:3.0:1746147258.826578:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15855 00000100:00100000:0.0:1746147258.826584:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15856 00000100:00100000:0.0:1746147258.826587:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465865600:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147258.826592:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147258.826597:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1e6 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.826670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.826698:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865856 00000100:00100000:3.0:1746147258.826701:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865856 00000100:00100000:3.0:1746147258.826716:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15857 00000100:00100000:3.0:1746147258.826720:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465865856:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.826726:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.826731:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1ae0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1f4 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147258.826773:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467089536:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147258.826829:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147258.826881:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.826882:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.826887:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.826899:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.826905:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f600, rc 0) 00000100:00100000:0.0:1746147258.826920:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465865600:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 332us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.826928:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15856 00000100:00100000:3.0:1746147258.829368:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467089536:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147258.829402:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1ae0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1f4 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.829414:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1ae0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1f4 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.829425:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782e00, rc 0) 00000100:00100000:3.0:1746147258.829800:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465865856:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3077us (3127us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147258.829808:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15857 00000100:00100000:0.0:1746147258.829983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.830048:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465865984 00000100:00100000:1.0:1746147258.830055:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465865984 00010000:00010000:1.0:1746147258.830078:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 28 pid: 4445 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.830108:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8094 00000100:00100000:1.0:1746147258.830115:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465865984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.830130:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.830140:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 28 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.830150:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 28 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.830279:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98600/0xb4b2209fbdad1a77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2375680->2969599) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1a0 expref: 28 pid: 4445 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.830345:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.830347:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.830354:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.830361:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.830388:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.830399:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467089664:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147258.830468:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.831828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.831912:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467089664:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147258.831926:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.831977:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465865984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1863us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.831986:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8094 00000100:00100000:3.0:1746147258.832060:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465866240 00000100:00100000:3.0:1746147258.832065:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465866240 00000100:00100000:3.0:1746147258.832119:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11503 00000100:00100000:3.0:1746147258.832125:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+21:32069:x1830967465866240:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.832142:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.832157:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed1fb expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.832247:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.832261:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.832268:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.832292:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.832303:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 22 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.832312:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089792:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.832375:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147258.834209:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089792:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.834232:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147258.834522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.834726:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465866368 00000100:00100000:1.0:1746147258.834733:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465866368 00010000:00010000:1.0:1746147258.834761:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 23 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.834795:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8095 00000100:00100000:1.0:1746147258.834801:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+23:1957:x1830967465866368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.834814:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.834819:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 23 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.834829:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 23 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.834832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.834849:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c98200/0xb4b2209fbdad1ac4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d8 expref: 23 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.834862:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147258.834867:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.834875:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.834881:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147258.834882:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465866624 00000100:00100000:2.0:1746147258.834886:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465866624 00010000:00010000:1.0:1746147258.834898:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147258.834912:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00002000:00100000:2.0:1746147258.834917:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880090509880 x1830967465866624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147258.834922:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00002000:00100000:2.0:1746147258.834925:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509880 with x1830967465866624 ext(2097152->3145727) 00002000:00010000:2.0:1746147258.834929:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509880 00000100:00100000:1.0:1746147258.834959:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+22:1957:x1830967465866368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 157us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.834960:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7576 00000100:00100000:2.0:1746147258.834965:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465866624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.834965:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8095 00000004:00200000:3.0:1746147258.834970:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147258.835088:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.835131:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.835139:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.835142:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147258.835145:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783200, rc 0) 00000100:00100000:3.0:1746147258.835188:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+22:32069:x1830967465866240:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3063us (3362us total) trans 8589945518 rc 0/0 00000100:00100000:3.0:1746147258.835195:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11503 00000100:00100000:0.0:1746147258.835803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.835907:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465866752 00000100:00100000:1.0:1746147258.835912:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465866752 00002000:00100000:1.0:1746147258.835931:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880090508e00 x1830967465866752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147258.835957:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967465866752 ext(3145728->4194303) 00002000:00010000:1.0:1746147258.835960:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:1.0:1746147258.835983:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7577 00000100:00100000:1.0:1746147258.835989:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465866752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147258.837775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.838483:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867008 00000100:00100000:3.0:1746147258.838491:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867008 00000100:00100000:3.0:1746147258.838543:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11504 00000100:00100000:3.0:1746147258.838550:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+22:32069:x1830967465867008:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.838572:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.838592:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783400/0xb4b2209fbdad1afc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed202 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.838675:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.838689:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.838695:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.838725:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.838736:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 23 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.838748:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089920:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.838836:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.845087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.845154:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867136 00000100:00100000:1.0:1746147258.845162:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867136 00000100:00100000:3.0:1746147258.845170:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467089920:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.845190:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 24 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.845197:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147258.845219:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8096 00000100:00100000:1.0:1746147258.845226:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+24:1956:x1830967465867136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.845237:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.845243:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 24 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.845253:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 24 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.845270:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783200/0xb4b2209fbdad1aee lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1fb expref: 24 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.845282:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147258.845286:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.845294:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.845299:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.845316:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147258.845564:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.845571:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147258.845600:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+23:1956:x1830967465867136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 373us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.845607:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8096 00000004:00200000:3.0:1746147258.845613:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147258.845617:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147258.845633:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147258.845655:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465866624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10688us (10822us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147258.845665:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7576 00010000:00010000:3.0:1746147258.845666:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783400/0xb4b2209fbdad1afc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed202 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147258.845674:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880090509880 x1830967465866624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.845682:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509880 with x1830967465866624 ext(2097152->3145727) 00002000:00010000:2.0:1746147258.845687:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509880 00010000:00010000:3.0:1746147258.845694:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed202 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.845700:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.845703:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147258.845705:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783600, rc 0) 00000100:00100000:3.0:1746147258.845738:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+22:32069:x1830967465867008:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7188us (7968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.845744:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11504 00000100:00100000:0.0:1746147258.846632:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465866752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10641us (10828us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147258.846640:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7577 00002000:00100000:0.0:1746147258.846647:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880090508e00 x1830967465866752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/440 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147258.846655:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967465866752 ext(3145728->4194303) 00002000:00010000:0.0:1746147258.846659:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:0.0:1746147258.849601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.849683:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867264 00000100:00100000:3.0:1746147258.849689:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867264 00000100:00100000:3.0:1746147258.849736:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15858 00000100:00100000:3.0:1746147258.849743:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465867264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.849757:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.849769:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed209 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.849787:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.849789:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.849796:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.849808:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.849818:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783800, rc 0) 00000100:00100000:3.0:1746147258.849861:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465867264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 118us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.849867:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15858 00000100:00100000:0.0:1746147258.851786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.851865:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867520 00000100:00100000:3.0:1746147258.851872:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867520 00000100:00100000:3.0:1746147258.851967:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11505 00000100:00100000:3.0:1746147258.851975:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+22:32069:x1830967465867520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.851989:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.852002:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b11 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed210 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.852088:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.852113:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.852124:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147258.852133:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147258.852221:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b11 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 25 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.852246:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.852253:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.852256:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147258.852258:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783c00, rc 0) 00000100:00100000:3.0:1746147258.852295:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+24:32069:x1830967465867520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 322us (515us total) trans 8589945519 rc 0/0 00000100:00100000:3.0:1746147258.852300:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11505 00000100:00100000:0.0:1746147258.853911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.853990:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867648 00000100:00100000:3.0:1746147258.853995:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867648 00000100:00100000:0.0:1746147258.854044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.854078:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867776 00000100:00100000:2.0:1746147258.854082:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867776 00000100:00100000:0.0:1746147258.854103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.854120:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465867904 00000100:00100000:3.0:1746147258.854123:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465867904 00000100:00100000:2.0:1746147258.854167:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15859 00000100:00100000:1.0:1746147258.854176:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15860 00000100:00100000:1.0:1746147258.854184:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465867776:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:3.0:1746147258.854189:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15861 00000100:00100000:3.0:1746147258.854194:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465867904:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147258.854208:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.854210:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.854221:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854221:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.854228:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.854228:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.854234:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.854235:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.854240:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.854242:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.854243:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.854244:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854244:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.854246:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854265:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.854266:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.854274:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 26 pid: 17548 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.854275:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 36 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.854284:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467090176:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.854284:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467090048:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.854324:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465867648:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147258.854342:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854344:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.854350:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 10 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746147258.854355:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.854357:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467090304:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.854362:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.854369:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.854373:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.854374:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.854376:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.854390:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.854398:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 8 pid: 21080 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.854406:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467090432:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.854451:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.854457:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147258.854458:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.854465:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 36 pid: 11147 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.854468:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467090560:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.854471:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.854478:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467090688:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.854482:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147258.854494:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147258.854496:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868032 00000100:00100000:1.0:1746147258.854499:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868032 00010000:00010000:3.0:1746147258.854502:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 10 pid: 21080 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.854509:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467090816:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.854515:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15862 00000100:00100000:1.0:1746147258.854519:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465868032:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147258.854531:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854540:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.854543:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854546:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 21 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.854551:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 21 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.854553:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147258.854558:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467090944:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.854558:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.854559:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.854561:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.854561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.854571:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868160 00000100:00100000:2.0:1746147258.854572:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147258.854572:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147258.854573:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868160 00010000:00010000:1.0:1746147258.854584:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 10 pid: 8478 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.854589:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15863 00000100:00100000:1.0:1746147258.854591:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467091072:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.854593:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465868160:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147258.854611:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 21 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.854615:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854617:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 21 pid: 4444 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.854624:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467091200:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.854624:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.854630:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.854634:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.854637:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147258.854641:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.854641:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.854642:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.854643:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147258.854645:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.854648:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.854649:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467091328:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.854655:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467091456:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.854657:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147258.854660:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1acf00 going to sleep for 11 seconds 00010000:00010000:0.0:1746147258.854663:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 21 pid: 4445 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.854668:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.854670:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467091584:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.854689:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147258.854699:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 10 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.854706:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467091712:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.854720:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.854726:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.854732:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467091840:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.854740:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.854778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.854842:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868288 00000100:00100000:2.0:1746147258.854845:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868288 00000100:00100000:2.0:1746147258.854871:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15864 00000100:00100000:2.0:1746147258.854875:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465868288:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147258.854888:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.854897:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.854903:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.854908:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.854909:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.855084:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.855110:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147258.855117:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 11 pid: 8481 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.855325:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467091968:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.855419:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.855427:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.855484:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467092096:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.855505:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.865794:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467090048:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.866146:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467090432:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.866156:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467090688:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.866454:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467090176:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.866513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.866542:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467090304:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.866549:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467090560:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.866556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.866573:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.866579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.866595:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868672 00000100:00100000:0.0:1746147258.866603:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868672 00000100:00100000:3.0:1746147258.866619:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868544 00000100:00100000:3.0:1746147258.866622:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868544 00010000:00010000:0.0:1746147258.866628:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 37 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.866633:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.866649:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868416 00000100:00100000:0.0:1746147258.866651:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868416 00010000:00010000:0.0:1746147258.866659:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 12 pid: 21080 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.866674:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8097 00000100:00100000:3.0:1746147258.866680:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465868672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.866692:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.866712:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 37 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.866720:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 37 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.866723:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8098 00000100:00100000:0.0:1746147258.866728:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465868544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.866734:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.866738:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad1aa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1c3 expref: 37 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.866745:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.866752:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.866756:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147258.866763:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad17bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf70 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.866783:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.866786:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465868672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.866791:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8097 00000100:00100000:0.0:1746147258.866793:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465868544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.866797:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8098 00000100:00100000:0.0:1746147258.866807:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8099 00000100:00100000:0.0:1746147258.866811:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465868416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.866817:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.866825:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 12 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.866832:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 12 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.866846:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1acb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1df expref: 12 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.866854:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.866866:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465868416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.866871:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8099 00000100:00100000:0.0:1746147258.866914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.866958:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868800 00000100:00100000:1.0:1746147258.866961:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868800 00010000:00010000:1.0:1746147258.866972:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 27 pid: 17548 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.866985:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8100 00000100:00100000:1.0:1746147258.866989:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465868800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.866994:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.867000:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 27 pid: 17548 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.867007:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 27 pid: 17548 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.867016:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48800/0xb4b2209fbdad1a3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed168 expref: 27 pid: 17548 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.867027:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.867040:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465868800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.867044:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8100 00000100:00100000:1.0:1746147258.867068:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467091072:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.867130:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467090944:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.867150:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.867376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.867549:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467090816:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.867555:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467091328:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.867566:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.867785:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467091200:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.867874:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869184 00000100:00100000:2.0:1746147258.867878:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869184 00000100:00100000:1.0:1746147258.867912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.867950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.867954:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465868928 00000100:00100000:3.0:1746147258.867957:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465868928 00000100:00100000:1.0:1746147258.867964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147258.867970:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 37 pid: 11147 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.867983:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869312 00000100:00100000:3.0:1746147258.867985:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869312 00000100:00100000:1.0:1746147258.867985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147258.867992:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.867994:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869440 00000100:00100000:1.0:1746147258.867996:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869440 00000100:00100000:3.0:1746147258.867999:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869056 00000100:00100000:3.0:1746147258.868000:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869056 00010000:00010000:1.0:1746147258.868005:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 22 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.868007:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.868014:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8101 00000100:00100000:1.0:1746147258.868018:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465868928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147258.868050:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 10 pid: 8478 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.868085:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8102 00000100:00100000:3.0:1746147258.868090:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465869312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.868104:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.868113:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.868120:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.868130:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491f600/0xb4b2209fbdad1ad9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1e6 expref: 11 pid: 21080 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.868143:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8103 00000100:00100000:0.0:1746147258.868149:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465869440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147258.868150:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8104 00000100:00100000:2.0:1746147258.868155:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967465869056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.868155:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147258.868160:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.868164:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 22 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.868166:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.868171:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 22 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.868173:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746147258.868182:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1a15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed13e expref: 36 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.868182:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d59cc00/0xb4b2209fbdad1775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecf54 expref: 22 pid: 8478 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.868191:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147258.868195:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.868196:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.868200:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.868208:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868208:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465869440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 61us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.868213:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8103 00010000:00010000:2.0:1746147258.868222:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.868225:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8105 00000100:00100000:0.0:1746147258.868228:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465869184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147258.868234:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967465869056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 80us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147258.868234:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147258.868238:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8104 00010000:00010000:0.0:1746147258.868241:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 10 pid: 8478 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.868248:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 10 pid: 8478 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.868257:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad15bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece12 expref: 10 pid: 8478 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.868264:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.868273:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465869184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.868277:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8105 00010000:00010000:1.0:1746147258.868330:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147258.868335:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467091584:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.868338:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 37 pid: 11147 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.868346:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 37 pid: 11147 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.868356:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8800/0xb4b2209fbdad1816 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecfa8 expref: 37 pid: 11147 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.868365:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.868366:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.868368:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868370:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467091712:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147258.868375:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868399:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.868416:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465868928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 397us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.868421:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8101 00000100:00100000:0.0:1746147258.868427:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467091840:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147258.868437:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467091456:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.868440:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868448:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868460:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868466:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.868483:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.868489:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868494:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869952 00010000:00010000:1.0:1746147258.868496:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868497:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869952 00010000:00010000:1.0:1746147258.868501:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa48600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147258.868505:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.868506:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 12 pid: 8481 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.868512:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868515:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869824 00000100:00100000:0.0:1746147258.868516:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869824 00010000:00010000:1.0:1746147258.868520:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.868523:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.868526:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48600/0xb4b2209fbdad1b26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868532:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8106 00000100:00100000:0.0:1746147258.868535:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465869952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.868540:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.868550:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 12 pid: 8481 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.868557:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465867776:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14375us (14514us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147258.868557:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 12 pid: 8481 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.868563:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15860 00010000:00010000:0.0:1746147258.868565:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.868575:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465869952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 39us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.868578:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8107 00000100:00100000:0.0:1746147258.868581:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8106 00000100:00100000:1.0:1746147258.868582:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465869824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.868587:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.868593:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.868600:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.868600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.868607:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870080 00010000:00010000:1.0:1746147258.868609:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093782400/0xb4b2209fbdad1a93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1bc expref: 26 pid: 6881 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.868609:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870080 00010000:00010000:0.0:1746147258.868616:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.868617:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.868618:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.868621:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868627:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868630:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8108 00000100:00100000:0.0:1746147258.868634:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465870080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.868638:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147258.868639:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.868645:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.868649:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465869824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147258.868652:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.868654:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8107 00010000:00010000:0.0:1746147258.868661:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad1584 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecde8 expref: 36 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.868665:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.868667:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147258.868671:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868676:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465870080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.868681:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8108 00010000:00010000:1.0:1746147258.868682:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868688:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868693:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.868698:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093783400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147258.868701:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147258.868711:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868712:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869696 00000100:00100000:0.0:1746147258.868714:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869696 00010000:00010000:1.0:1746147258.868719:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.868721:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 9 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.868724:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093783400/0xb4b2209fbdad1b2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.868733:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8109 00000100:00100000:0.0:1746147258.868736:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465869696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147258.868743:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465867904:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14549us (14649us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147258.868743:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.868750:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 9 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.868757:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 9 pid: 6881 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746147258.868759:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15861 00010000:00010000:0.0:1746147258.868765:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ed expref: 9 pid: 6881 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746147258.868772:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.868783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.868783:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465869696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 47us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.868788:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8109 00000100:00100000:1.0:1746147258.868792:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465869568 00000100:00100000:1.0:1746147258.868794:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465869568 00010000:00010000:1.0:1746147258.868803:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 21 pid: 4444 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746147258.868812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147258.868850:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1b0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed209 expref: 9 pid: 8481 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746147258.868858:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467091968:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.869184:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.869203:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465869312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1113us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.869208:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8102 00000100:00100000:1.0:1746147258.869657:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870208 00000100:00100000:1.0:1746147258.869660:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870208 00010000:00010000:1.0:1746147258.869673:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 22 pid: 4445 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746147258.869685:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8110 00000100:00100000:3.0:1746147258.869690:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465869568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.869698:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.869707:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 22 pid: 4444 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.869714:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 22 pid: 4444 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.869727:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad1625 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ece43 expref: 22 pid: 4444 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746147258.869734:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.869736:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147258.869738:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.869744:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.869758:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.869772:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465869568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.869831:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8111 00000100:00100000:1.0:1746147258.869837:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465870208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.869843:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.869851:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 21 pid: 4445 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.869859:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 21 pid: 4445 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.869868:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbe600/0xb4b2209fbdad1a85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1ae expref: 21 pid: 4445 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746147258.869876:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147258.869906:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869914:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869928:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869951:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869958:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869963:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800912e1600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147258.869966:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869973:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869981:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.869986:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.870016:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465867648:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15843us (16107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.870022:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15859 00000100:00100000:3.0:1746147258.870023:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8110 00000100:00100000:1.0:1746147258.870110:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967465870208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 273us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.870115:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8111 00010000:00010000:1.0:1746147258.870291:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870298:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870309:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870315:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870321:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870330:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa49c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147258.870333:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870338:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870346:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870350:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa49c00/0xb4b2209fbdad1b3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147258.870390:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465868032:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15870us (15918us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.870396:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15862 00000100:00100000:1.0:1746147258.870424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.870433:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870464 00000100:00100000:1.0:1746147258.870436:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870464 00010000:00010000:1.0:1746147258.870446:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.870459:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8112 00000100:00100000:1.0:1746147258.870463:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465870464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.870468:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.870479:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.870486:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.870497:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.870498:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.870500:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870506:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870516:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.870527:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465870464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.870532:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8112 00000100:00100000:1.0:1746147258.870577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.870587:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870336 00000100:00100000:1.0:1746147258.870589:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870336 00010000:00010000:1.0:1746147258.870599:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.870612:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8113 00000100:00100000:1.0:1746147258.870616:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967465870336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.870621:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.870627:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.870635:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.870644:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa48e00/0xb4b2209fbdad1a62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed18b expref: 35 pid: 8480 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.870653:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.870654:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147258.870657:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870662:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.870672:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.870682:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967465870336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.870686:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8113 00010000:00010000:0.0:1746147258.870686:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870693:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870706:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870711:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870722:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870728:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092f1a600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147258.870730:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870736:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870744:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.870749:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f1a600/0xb4b2209fbdad1b42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.870782:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1956:x1830967465868160:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 16187us (16218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.870787:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15863 00010000:00010000:2.0:1746147258.870821:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa49600/0xb4b2209fbdad1aa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed1d1 expref: 34 pid: 8480 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.871263:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467092096:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147258.871283:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871290:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871295:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871309:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871315:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871321:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871325:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800912e0600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147258.871328:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871338:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871347:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.871352:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1b49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.871385:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465868288:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 16510us (16607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.871390:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15864 00000100:00100000:1.0:1746147258.873998:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.874017:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870720 00000100:00100000:3.0:1746147258.874024:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870720 00000100:00100000:3.0:1746147258.874057:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11506 00000100:00100000:3.0:1746147258.874063:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+24:32069:x1830967465870720:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147258.874111:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.874130:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783600/0xb4b2209fbdad1b03 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed202 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874142:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.874146:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147258.874169:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.874179:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 329 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874186:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 39 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874190:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874196:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874201:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 329 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874206:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 39 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874211:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.874234:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 39 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874243:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 39 pid: 16361 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.874253:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092224:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.874323:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 329 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874331:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 329 pid: 23726 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.874337:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092352:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.874355:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874361:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.874367:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.874382:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874388:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.874394:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092608:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.874411:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 39 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874417:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 39 pid: 16361 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.874428:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092736:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.874447:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 329 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.874454:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 329 pid: 14048 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.874460:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092864:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.874475:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147258.878077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.878115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.878137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.878148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.878179:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870976 00000100:00100000:0.0:1746147258.878184:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870976 00010000:00010000:0.0:1746147258.878210:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.878228:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465870848 00000100:00100000:0.0:1746147258.878230:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465870848 00010000:00010000:0.0:1746147258.878237:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 330 pid: 23726 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.878249:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8114 00000100:00100000:0.0:1746147258.878254:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+40:1957:x1830967465870976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.878265:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.878269:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.878278:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.878295:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147258.878299:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147258.878307:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.878335:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+40:1957:x1830967465870976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.878341:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8114 00000100:00100000:0.0:1746147258.878355:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8115 00000100:00100000:0.0:1746147258.878360:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1957:x1830967465870848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.878365:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.878368:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 330 pid: 23726 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.878376:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 330 pid: 23726 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.878385:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147258.878387:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147258.878391:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.878401:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1957:x1830967465870848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.878406:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8115 00000100:00100000:0.0:1746147258.878419:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465871232 00000100:00100000:0.0:1746147258.878421:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465871232 00000100:00100000:0.0:1746147258.878433:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465871488 00000100:00100000:0.0:1746147258.878435:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465871488 00000100:00100000:0.0:1746147258.878444:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4819 00000100:00100000:0.0:1746147258.878448:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:27397:x1830967465871232:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147258.878619:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+331:27397:x1830967465871232:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 164us (475us total) trans 8589945520 rc 0/0 00000100:00100000:0.0:1746147258.878625:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4819 00000100:00100000:0.0:1746147258.878635:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4820 00000100:00100000:0.0:1746147258.878639:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+40:27370:x1830967465871488:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147258.878694:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+41:27370:x1830967465871488:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 53us (544us total) trans 8589945521 rc 0/0 00000100:00100000:0.0:1746147258.878699:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4820 00010000:00010000:3.0:1746147258.878997:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d491600/0xb4b2209fbdad132a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc75 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.879009:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092224:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.879019:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b92e000/0xb4b2209fbdad1300 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecc67 expref: 330 pid: 23726 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.879026:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092352:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.879034:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092480:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.879041:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092608:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.879046:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092736:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147258.879052:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467092864:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147258.879076:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147258.879501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.880053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.880210:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465871744 00000100:00100000:3.0:1746147258.880215:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465871744 00010000:00010000:3.0:1746147258.880232:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 330 pid: 14048 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.880256:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465871616 00000100:00100000:3.0:1746147258.880258:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465871616 00010000:00010000:3.0:1746147258.880266:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.880282:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8116 00000100:00100000:3.0:1746147258.880287:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1957:x1830967465871744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.880297:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.880301:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 330 pid: 14048 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.880309:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 330 pid: 14048 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.880354:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad0ed8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9ea expref: 330 pid: 14048 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.880365:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.880369:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.880375:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.880398:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1957:x1830967465871744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 111us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.880404:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8116 00000100:00100000:3.0:1746147258.880413:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8117 00000100:00100000:3.0:1746147258.880416:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+40:1957:x1830967465871616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147258.880421:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147258.880424:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.880430:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.880438:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5a00/0xb4b2209fbdad0edf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ec9f1 expref: 40 pid: 16361 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746147258.880444:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.880446:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.880450:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147258.880463:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+39:1957:x1830967465871616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 47us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.880467:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8117 00000100:00100000:0.0:1746147258.882669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.882715:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465871872 00000100:00100000:1.0:1746147258.882722:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465871872 00010000:00010000:1.0:1746147258.882746:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.882766:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8118 00000100:00100000:1.0:1746147258.882772:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1956:x1830967465871872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.882784:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.882789:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.882797:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.882814:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad101a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecad1 expref: 329 pid: 23726 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.882826:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147258.882831:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147258.882837:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147258.882868:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+328:1956:x1830967465871872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.882874:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8118 00000100:00100000:0.0:1746147258.883296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.883339:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465872000 00000100:00100000:0.0:1746147258.883342:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465872000 00010000:00010000:0.0:1746147258.883356:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.883378:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8119 00000100:00100000:0.0:1746147258.883383:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+39:1959:x1830967465872000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.883390:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.883393:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.883401:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.883412:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53400/0xb4b2209fbdad0ff0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ecab5 expref: 39 pid: 14048 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.883421:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147258.883424:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147258.883430:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147258.883435:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147258.883453:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147258.883469:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+38:1959:x1830967465872000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.883474:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8119 00010000:00010000:3.0:1746147258.883498:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147258.883505:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:3.0:1746147258.884130:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3422, 88 off286624 00000004:00080000:3.0:1746147258.884138:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871200125ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884181:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3418, 88 off286272 00000004:00080000:3.0:1746147258.884185:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871247601ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884201:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3419, 88 off286360 00000004:00080000:3.0:1746147258.884204:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871266976ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884231:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3424, 88 off286808 00000004:00080000:3.0:1746147258.884234:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871296951ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884252:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3425, 88 off286896 00000004:00080000:3.0:1746147258.884255:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871318013ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884269:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3420, 88 off286448 00000004:00080000:3.0:1746147258.884272:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871334570ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884277:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3421, 88 off286536 00000004:00080000:3.0:1746147258.884280:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871342443ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884285:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3422, 88 off286624 00000004:00080000:3.0:1746147258.884287:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871350146ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884294:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3426, 88 off286984 00000004:00080000:3.0:1746147258.884296:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871358963ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884334:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3424, 88 off286808 00000004:00080000:3.0:1746147258.884337:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871399583ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884344:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3427, 88 off287072 00000004:00080000:3.0:1746147258.884346:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871408916ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884354:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3425, 88 off286896 00000004:00080000:3.0:1746147258.884356:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871418780ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147258.884361:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3428, 88 off287160 00000004:00080000:3.0:1746147258.884363:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871426066ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884370:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3429, 88 off287248 00000004:00080000:3.0:1746147258.884372:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871434721ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884379:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3430, 88 off287336 00000004:00080000:3.0:1746147258.884381:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871443564ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884387:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3431, 88 off287424 00000004:00080000:3.0:1746147258.884389:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645871451628ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147258.884395:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3426, 88 off286984 00000004:00080000:3.0:1746147258.884397:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645871459523ns, next at 607576201812ns, rc = 0 00000001:00080000:0.0:1746147258.894355:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945517 is committed 00000001:00080000:0.0:1746147258.894376:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945482 is committed 00000001:00080000:0.0:1746147258.894380:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945481 is committed 00000001:00080000:0.0:1746147258.894400:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945510 is committed 00000001:00080000:0.0:1746147258.894403:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945509 is committed 00000001:00080000:0.0:1746147258.894445:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945519 is committed 00000001:00080000:0.0:1746147258.894452:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945516 is committed 00000100:00100000:1.0:1746147258.900754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147258.900779:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465872256 00000100:00100000:1.0:1746147258.900785:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465872256 00000100:00100000:1.0:1746147258.900829:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11507 00000100:00100000:1.0:1746147258.900835:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32072:x1830967465872256:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147258.901394:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147258.901410:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed217 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.901486:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.901497:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.901506:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.901515:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.901520:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.901525:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00010000:3.0:1746147258.911112:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b208700 reply state ffff880094d49400 transno 8589945522 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147258.911123:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746147258.911147:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945521 is committed 00000001:00080000:0.0:1746147258.911155:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945520 is committed 00000001:00080000:0.0:1746147258.911160:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945522 is committed 00000004:00080000:0.0:1746147258.911163:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2552 committed 00000004:00080000:0.0:1746147258.911170:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2553 committed 00000004:00080000:0.0:1746147258.911175:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2552 committed 00000004:00080000:0.0:1746147258.911177:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2551 committed 00000004:00080000:0.0:1746147258.911178:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2550 committed 00000004:00080000:0.0:1746147258.911179:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2551 committed 00000004:00080000:0.0:1746147258.911181:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2549 committed 00000004:00080000:0.0:1746147258.911182:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2550 committed 00000004:00080000:0.0:1746147258.911183:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2548 committed 00000004:00080000:0.0:1746147258.911185:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2549 committed 00000004:00080000:0.0:1746147258.911186:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2548 committed 00000004:00080000:0.0:1746147258.911187:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2547 committed 00000004:00080000:0.0:1746147258.911188:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2547 committed 00000004:00080000:0.0:1746147258.911189:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2546 committed 00000004:00080000:0.0:1746147258.911190:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2546 committed 00000004:00080000:0.0:1746147258.911192:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2545 committed 00000004:00080000:0.0:1746147258.911194:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2545 committed 00010000:00080000:3.0:1746147258.911218:0:14049:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147258.911230:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32069:x1830967465870720:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 37164us (37233us total) trans 8589945522 rc 0/0 00000100:00100000:3.0:1746147258.911238:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11506 00000100:00100000:3.0:1746147258.911267:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467093376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.911305:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.911343:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467093888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.911355:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.911365:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147258.911368:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467092992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.911378:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.911386:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467093504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.911397:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147258.911400:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093376 00000100:00100000:0.0:1746147258.911405:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093376 00010000:00010000:1.0:1746147258.911467:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.911483:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147258.911490:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147258.911510:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147258.912047:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093888 00000100:00100000:0.0:1746147258.912052:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093888 00000100:00100000:3.0:1746147258.912054:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467092992 00000100:00100000:3.0:1746147258.912057:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467092992 00000100:00100000:0.0:1746147258.912064:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093504 00000100:00100000:0.0:1746147258.912066:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093504 00010000:00010000:1.0:1746147258.912068:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 7 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746147258.912073:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15865 00000100:00100000:0.0:1746147258.912077:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15866 00000100:00100000:3.0:1746147258.912078:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467093376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147258.912080:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467094016:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.912081:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467093888:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746147258.912091:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147258.912114:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15867 00000100:00100000:0.0:1746147258.912118:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467092992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147258.912129:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147258.912228:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467094144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.912253:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147258.912260:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3293:x1830967467092992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 140us (879us total) trans 21474841418 rc 0/0 00000100:00100000:0.0:1746147258.912265:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15867 00000100:00100000:3.0:1746147258.912267:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3293:x1830967467093376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (962us total) trans 21474841419 rc 0/0 00000100:00100000:1.0:1746147258.912267:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467094656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.912271:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15865 00000100:00100000:0.0:1746147258.912274:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094144 00000100:00100000:0.0:1746147258.912276:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094144 00000100:00100000:1.0:1746147258.912279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.912281:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15868 00000100:00100000:3.0:1746147258.912285:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467093504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147258.912290:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094656 00000100:00100000:1.0:1746147258.912291:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147258.912292:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094656 00000100:00100000:1.0:1746147258.912295:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467094528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.912299:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15869 00000100:00100000:0.0:1746147258.912301:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1830967467094144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.912308:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147258.912315:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467095040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.912329:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147258.912335:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.912342:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147258.912342:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467093248:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147258.912348:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147258.912353:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093782600 already unused, calling callback (ffffffffa136d690) 00000100:00100000:1.0:1746147258.912355:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147258.912356:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147258.912361:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467093760:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147258.912362:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147258.912371:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147258.912375:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147258.912378:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147258.912378:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467094400:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147258.912381:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147258.912383:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3293:x1830967467093504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (985us total) trans 21474841420 rc 0/0 00010000:00010000:2.0:1746147258.912385:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782600/0xb4b2209fbdad1b50 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147258.912388:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15868 00000100:00100000:0.0:1746147258.912388:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1830967467094144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (134us total) trans 17179874059 rc 0/0 00000100:00100000:1.0:1746147258.912390:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147258.912395:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467094912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.912401:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467093120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147258.912403:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15869 00000100:00100000:1.0:1746147258.912405:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.912410:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095040 00000100:00100000:0.0:1746147258.912410:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094528 00000100:00100000:3.0:1746147258.912412:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095040 00000100:00100000:0.0:1746147258.912412:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094528 00000100:00100000:2.0:1746147258.912418:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.912420:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093248 00000100:00100000:1.0:1746147258.912420:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093760 00000100:00100000:3.0:1746147258.912421:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093248 00000100:00100000:1.0:1746147258.912423:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093760 00000100:00100000:2.0:1746147258.912426:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467093632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.912427:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094400 00000100:00100000:3.0:1746147258.912428:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094400 00000100:00100000:0.0:1746147258.912429:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094912 00000100:00100000:0.0:1746147258.912431:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094912 00000100:00100000:1.0:1746147258.912434:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093120 00000100:00100000:3.0:1746147258.912436:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15870 00000100:00100000:1.0:1746147258.912436:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093120 00000100:00100000:2.0:1746147258.912437:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.912439:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3294:x1830967467094656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.912439:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467093632 00000100:00100000:0.0:1746147258.912441:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467093632 00000100:00100000:2.0:1746147258.912444:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467094272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.912444:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15871 00000100:00100000:1.0:1746147258.912449:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1830967467094528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.912449:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15872 00000100:00100000:0.0:1746147258.912453:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3294:x1830967467095040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.912454:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.912460:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467094784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.912470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147258.912470:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147258.912483:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094784 00000100:00100000:1.0:1746147258.912483:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467094272 00000100:00100000:2.0:1746147258.912486:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094784 00000100:00100000:1.0:1746147258.912486:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467094272 00000100:00100000:1.0:1746147258.912495:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15873 00000100:00100000:1.0:1746147258.912499:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467093248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.912502:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15874 00000100:00100000:2.0:1746147258.912506:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467093760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.912518:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967467094656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (237us total) trans 17179874060 rc 0/0 00000100:00100000:3.0:1746147258.912523:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15870 00000100:00100000:3.0:1746147258.912533:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15875 00000100:00100000:3.0:1746147258.912537:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467094400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.912559:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967467095040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (233us total) trans 17179874061 rc 0/0 00000100:00100000:0.0:1746147258.912564:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15872 00000100:00100000:0.0:1746147258.912572:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15876 00000100:00100000:1.0:1746147258.912575:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874037 gen 2 00000100:00100000:0.0:1746147258.912576:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467094912:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147258.912579:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f731180, transno 17179873975 00000004:00080000:1.0:1746147258.912772:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f733480, transno 17179873976 00000004:00080000:1.0:1746147258.912775:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f732680, transno 17179873977 00000100:00100000:2.0:1746147258.912776:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467093760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 269us (403us total) trans 21474841421 rc 0/0 00000004:00080000:1.0:1746147258.912777:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f731f80, transno 17179873978 00000004:00080000:1.0:1746147258.912779:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094400700, transno 17179873979 00000004:00080000:1.0:1746147258.912780:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f733100, transno 17179873980 00000100:00100000:2.0:1746147258.912782:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15874 00000004:00080000:1.0:1746147258.912783:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f733b80, transno 17179873981 00000004:00080000:1.0:1746147258.912785:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094400e00, transno 17179873982 00000004:00080000:1.0:1746147258.912787:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401c00, transno 17179873983 00000004:00080000:1.0:1746147258.912789:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20bb80, transno 17179873984 00000004:00080000:1.0:1746147258.912791:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975500, transno 17179873985 00000100:00100000:2.0:1746147258.912792:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15877 00000004:00080000:1.0:1746147258.912793:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974000, transno 17179873986 00000004:00080000:1.0:1746147258.912794:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974a80, transno 17179873987 00000100:00100000:2.0:1746147258.912796:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967467093120:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147258.912796:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977800, transno 17179873988 00000004:00080000:1.0:1746147258.912798:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977100, transno 17179873989 00000004:00080000:1.0:1746147258.912800:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b408000, transno 17179873990 00000004:00080000:1.0:1746147258.912802:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977480, transno 17179873991 00000004:00080000:1.0:1746147258.912804:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974e00, transno 17179873992 00000004:00080000:1.0:1746147258.912806:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919c00, transno 17179874008 00000004:00080000:1.0:1746147258.912808:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1f80, transno 17179874009 00000004:00080000:1.0:1746147258.912810:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2680, transno 17179874010 00000004:00080000:1.0:1746147258.912812:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4673800, transno 17179874011 00000004:00080000:1.0:1746147258.912813:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c3800, transno 17179874012 00000004:00080000:1.0:1746147258.912815:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4670a80, transno 17179874013 00000004:00080000:1.0:1746147258.912817:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919500, transno 17179874014 00000004:00080000:1.0:1746147258.912819:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1c00, transno 17179874015 00000004:00080000:1.0:1746147258.912821:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e681c00, transno 17179874016 00000004:00080000:1.0:1746147258.912824:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094402a00, transno 17179874020 00000004:00080000:1.0:1746147258.912826:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b40b800, transno 17179874021 00000004:00080000:1.0:1746147258.912828:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401880, transno 17179874022 00000004:00080000:1.0:1746147258.912830:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401f80, transno 17179874023 00000004:00080000:1.0:1746147258.912832:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401180, transno 17179874024 00000004:00080000:1.0:1746147258.912834:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b40bb80, transno 17179874025 00000100:00100000:3.0:1746147258.912835:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467094400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 296us (442us total) trans 17179874062 rc 0/0 00000004:00080000:1.0:1746147258.912836:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094402680, transno 17179874026 00000004:00080000:1.0:1746147258.912838:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b40a300, transno 17179874027 00000004:00080000:1.0:1746147258.912839:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012df79880, transno 17179874028 00000100:00100000:3.0:1746147258.912840:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15875 00000004:00080000:1.0:1746147258.912841:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046680, transno 17179874029 00000004:00080000:1.0:1746147258.912844:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047800, transno 17179874030 00000004:00080000:1.0:1746147258.912846:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f044000, transno 17179874031 00000004:00080000:1.0:1746147258.912848:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046300, transno 17179874032 00000100:00100000:3.0:1746147258.912850:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15878 00000004:00080000:1.0:1746147258.912850:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f045500, transno 17179874033 00000004:00080000:1.0:1746147258.912852:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047480, transno 17179874034 00000100:00100000:3.0:1746147258.912854:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467093632:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147258.912854:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d5dd880, transno 17179874035 00000004:00080000:1.0:1746147258.912856:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046d80, transno 17179874036 00000004:00080000:1.0:1746147258.912858:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047b80, transno 17179874037 00000100:00100000:1.0:1746147258.912863:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009b20a300 x1830967467095040/t17179874061(17179874061) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147274 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147258.912873:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b20a300/2, rc 0, transno 17179874061 00000100:00100000:2.0:1746147258.912874:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467093120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (456us total) trans 21474841422 rc 0/0 00000100:00100000:1.0:1746147258.912877:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467095040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.912879:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15877 00000004:00080000:1.0:1746147258.912886:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b209500/2, rc 0, transno 17179874059 00000100:00100000:2.0:1746147258.912889:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15879 00000100:00100000:1.0:1746147258.912889:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467094144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.912893:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967467094272:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147258.912894:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b209880/2, rc 0, transno 17179874060 00000100:00100000:1.0:1746147258.912897:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467094656:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147258.912958:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:3.0:1746147258.912961:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147258.912963:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147258.912964:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147258.912966:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:2.0:1746147258.912976:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467094272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (520us total) trans 17179874063 rc 0/0 00000100:00100000:1.0:1746147258.912976:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1830967467093248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 476us (620us total) trans 21474841424 rc 0/0 00000100:00100000:2.0:1746147258.912981:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15879 00000100:00100000:1.0:1746147258.912983:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15873 00000100:00100000:3.0:1746147258.912985:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967467093632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (547us total) trans 21474841423 rc 0/0 00000100:00100000:3.0:1746147258.912989:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15878 00000100:00100000:2.0:1746147258.912992:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15880 00000100:00100000:2.0:1746147258.912995:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967467094784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.913004:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841391 gen 2 00000004:00080000:1.0:1746147258.913007:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed5c00, transno 21474841323 00000004:00080000:1.0:1746147258.913012:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed6a00, transno 21474841324 00000004:00080000:1.0:1746147258.913015:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed5f80, transno 21474841325 00000004:00080000:1.0:1746147258.913017:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed6d80, transno 21474841326 00000004:00080000:1.0:1746147258.913020:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed6300, transno 21474841327 00000004:00080000:1.0:1746147258.913022:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed7100, transno 21474841328 00000004:00080000:1.0:1746147258.913024:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed6680, transno 21474841329 00000004:00080000:1.0:1746147258.913026:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed7480, transno 21474841330 00000004:00080000:1.0:1746147258.913028:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d5dc700, transno 21474841336 00000004:00080000:1.0:1746147258.913030:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f31c00, transno 21474841337 00000004:00080000:1.0:1746147258.913032:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f31880, transno 21474841338 00000004:00080000:1.0:1746147258.913033:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f31500, transno 21474841339 00000004:00080000:1.0:1746147258.913035:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f32300, transno 21474841340 00000004:00080000:1.0:1746147258.913038:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f32680, transno 21474841341 00000004:00080000:1.0:1746147258.913040:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f31f80, transno 21474841342 00000004:00080000:1.0:1746147258.913042:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f32d80, transno 21474841343 00000004:00080000:1.0:1746147258.913044:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2300, transno 21474841344 00000004:00080000:1.0:1746147258.913045:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a4700, transno 21474841345 00000004:00080000:1.0:1746147258.913047:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c0e00, transno 21474841346 00000004:00080000:1.0:1746147258.913049:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a5c00, transno 21474841347 00000004:00080000:1.0:1746147258.913051:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2d80, transno 21474841348 00000004:00080000:1.0:1746147258.913053:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a5500, transno 21474841349 00000004:00080000:1.0:1746147258.913055:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a6300, transno 21474841350 00000004:00080000:1.0:1746147258.913057:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312a4e00, transno 21474841351 00000004:00080000:1.0:1746147258.913059:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e2b8000, transno 21474841365 00000004:00080000:1.0:1746147258.913061:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0e300, transno 21474841366 00000004:00080000:1.0:1746147258.913063:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e2bb800, transno 21474841367 00000004:00080000:1.0:1746147258.913065:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e2baa00, transno 21474841368 00000004:00080000:1.0:1746147258.913066:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e2bb100, transno 21474841369 00000004:00080000:1.0:1746147258.913068:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e2b8a80, transno 21474841370 00000004:00080000:1.0:1746147258.913070:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0e680, transno 21474841371 00000004:00080000:1.0:1746147258.913072:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e2b9880, transno 21474841372 00000004:00080000:1.0:1746147258.913074:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b480, transno 21474841376 00000004:00080000:1.0:1746147258.913076:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bfe3800, transno 21474841377 00000004:00080000:1.0:1746147258.913077:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050a300, transno 21474841378 00000004:00080000:1.0:1746147258.913079:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bfe2300, transno 21474841379 00000004:00080000:1.0:1746147258.913081:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b800, transno 21474841380 00000004:00080000:1.0:1746147258.913083:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050ad80, transno 21474841381 00000004:00080000:1.0:1746147258.913085:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4faf480, transno 21474841382 00000004:00080000:1.0:1746147258.913087:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bfe2680, transno 21474841383 00000004:00080000:1.0:1746147258.913089:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f669f80, transno 21474841384 00000004:00080000:1.0:1746147258.913090:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f669880, transno 21474841385 00000004:00080000:1.0:1746147258.913092:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f669180, transno 21474841386 00000004:00080000:1.0:1746147258.913106:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f66bb80, transno 21474841387 00000004:00080000:1.0:1746147258.913108:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f668700, transno 21474841388 00000004:00080000:1.0:1746147258.913110:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f668e00, transno 21474841389 00000004:00080000:1.0:1746147258.913112:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f66ad80, transno 21474841390 00000004:00080000:1.0:1746147258.913114:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f669500, transno 21474841391 00000100:00100000:1.0:1746147258.913117:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880090509180 x1830967467093248/t21474841424(21474841424) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147274 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147258.913123:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509180/2, rc 0, transno 21474841424 00000100:00100000:2.0:1746147258.913126:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467094784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (655us total) trans 17179874064 rc 0/0 00000100:00100000:1.0:1746147258.913126:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467093248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147258.913127:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090508000/2, rc 0, transno 21474841418 00000100:00100000:3.0:1746147258.913131:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467092992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.913131:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15880 00000004:00080000:1.0:1746147258.913135:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094403800/2, rc 0, transno 21474841421 00000100:00100000:1.0:1746147258.913137:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467093760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147258.913141:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094403100/2, rc 0, transno 21474841420 00000100:00100000:3.0:1746147258.913144:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467093504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147258.913145:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b20b480/2, rc 0, transno 17179874062 00000100:00100000:1.0:1746147258.913148:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467094400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147258.913149:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094402300/2, rc 0, transno 21474841419 00000100:00100000:3.0:1746147258.913152:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467093376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147258.913153:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050a680/2, rc 0, transno 21474841422 00000100:00100000:2.0:1746147258.913156:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467093120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147258.913161:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094403480/2, rc 0, transno 21474841423 00000100:00100000:2.0:1746147258.913163:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467093632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147258.913167:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b20b100/2, rc 0, transno 17179874063 00000100:00100000:2.0:1746147258.913170:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467094272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147258.913174:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b20ad80/2, rc 0, transno 17179874064 00000100:00100000:2.0:1746147258.913176:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467094784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.913248:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467094912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 671us (841us total) trans 17179874065 rc 0/0 00000100:00100000:0.0:1746147258.913253:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15876 00000100:00100000:1.0:1746147258.913600:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967467094528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1150us (1290us total) trans 17179874066 rc 0/0 00000100:00100000:1.0:1746147258.913606:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15871 00000004:00080000:1.0:1746147258.913626:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b209180/2, rc 0, transno 17179874065 00000100:00100000:1.0:1746147258.913629:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467094912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147258.913693:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 1 in flight, 48 done 00000100:00100000:0.0:1746147258.913836:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967467093888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1754us (2479us total) trans 21474841425 rc 0/0 00000100:00100000:1.0:1746147258.913839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.913841:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15866 00000100:00100000:0.0:1746147258.913881:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467094016:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147258.913893:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00080000:1.0:1746147258.913894:0:14094:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 1 in flight, 45 done 00000100:00100000:3.0:1746147258.913961:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465872384 00000100:00100000:3.0:1746147258.913965:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465872384 00000100:00100000:3.0:1746147258.913985:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11508 00000100:00100000:3.0:1746147258.913990:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32069:x1830967465872384:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147258.914001:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147258.914010:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed21e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.914044:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.914054:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.914065:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.914068:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147258.914070:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f400, rc 0) 00000100:00100000:3.0:1746147258.914093:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32069:x1830967465872384:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 102us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147258.914112:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11508 00000004:00080000:3.0:1746147258.914170:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094403b80/2, rc 0, transno 21474841425 00000100:00100000:3.0:1746147258.914173:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467093888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.914179:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746147258.914184:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467095168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.914204:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147258.914267:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095168 00000100:00100000:0.0:1746147258.914270:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095168 00000004:00080000:2.0:1746147258.914336:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b20a680/2, rc 0, transno 17179874066 00000100:00100000:2.0:1746147258.914340:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467094528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.915241:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15881 00000100:00100000:0.0:1746147258.915247:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967467095168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.915397:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967467095168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (1190us total) trans 17179874067 rc 0/0 00000100:00100000:0.0:1746147258.915405:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15881 00000100:00100000:1.0:1746147258.915506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:3.0:1746147258.915521:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3800/2, rc 0, transno 17179874067 00000100:00100000:3.0:1746147258.915525:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467095168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.915626:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465872512 00000100:00100000:0.0:1746147258.915630:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465872512 00010000:00010000:0.0:1746147258.915646:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 8 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746147258.915673:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8120 00000100:00100000:0.0:1746147258.915678:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465872512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147258.915685:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147258.915690:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 8 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.915698:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 8 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.915712:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1b18 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed210 expref: 8 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746147258.915723:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147258.915727:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.915733:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.915738:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.915750:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147258.915760:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915766:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147258.915780:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147258.915859:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915864:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915868:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915872:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b9800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147258.915875:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915880:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915887:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147258.915889:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147258.915892:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915896:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9800/0xb4b2209fbdad1b6c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915906:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915911:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915915:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915921:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093783000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147258.915923:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915927:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915931:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147258.915933:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147258.915952:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915957:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783000/0xb4b2209fbdad1b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915964:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915968:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915972:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915975:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093783a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147258.915977:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915981:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915986:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f700) 00010000:00010000:2.0:1746147258.915987:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147258.915990:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.915994:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783a00/0xb4b2209fbdad1b65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147258.916026:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1b57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed217 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.916031:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed217 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.916037:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782c00, rc 0) 00000100:00100000:0.0:1746147258.916037:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465872512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 358us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147258.916042:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8120 00000100:00100000:2.0:1746147258.916770:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32072:x1830967465872256:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15933us (16020us total) trans 8589945523 rc 301/301 00000100:00100000:2.0:1746147258.916776:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11507 00000100:00100000:0.0:1746147258.919082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.919224:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465872768 00000100:00100000:3.0:1746147258.919231:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465872768 00000100:00100000:3.0:1746147258.919323:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4821 00000100:00100000:3.0:1746147258.919331:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32069:x1830967465872768:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147258.919620:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32069:x1830967465872768:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 289us (544us total) trans 8589945524 rc 0/0 00000100:00100000:3.0:1746147258.919626:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4821 00000100:00100000:0.0:1746147258.922863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.923140:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465873024 00000100:00100000:3.0:1746147258.923147:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465873024 00000100:00100000:3.0:1746147258.923192:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4822 00000100:00100000:3.0:1746147258.923198:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32069:x1830967465873024:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147258.923359:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32069:x1830967465873024:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 160us (503us total) trans 8589945525 rc 0/0 00000100:00100000:3.0:1746147258.923365:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4822 00000100:00100000:0.0:1746147258.940472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.940801:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465873152 00000100:00100000:2.0:1746147258.940810:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465873152 00000100:00100000:2.0:1746147258.941209:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11509 00000100:00100000:2.0:1746147258.941218:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32072:x1830967465873152:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.941238:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.941253:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1b81 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed225 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.941299:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1b81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed225 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.941309:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1b81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed225 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.941326:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147258.941328:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147258.941330:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0400, rc 0) 00000100:00100000:2.0:1746147258.941383:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32072:x1830967465873152:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 167us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.941389:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11509 00000100:00100000:0.0:1746147258.944933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.945060:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465873408 00000100:00100000:2.0:1746147258.945069:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465873408 00000100:00100000:2.0:1746147258.945602:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11510 00000100:00100000:2.0:1746147258.945610:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32072:x1830967465873408:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.945625:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.945627:0:23726:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147258.945646:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1b81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed225 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.945675:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147258.945679:0:23726:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147258.945689:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1400/0xb4b2209fbdad1b88 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed22c expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.945726:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147258.945736:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.945741:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147258.945800:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.945810:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 8 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746147258.945819:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467095296:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147258.945934:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147258.947805:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467095296:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147258.947808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147258.947830:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147258.947870:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465873536 00000100:00100000:1.0:1746147258.947876:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465873536 00010000:00010000:1.0:1746147258.947901:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 9 pid: 14049 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746147258.947930:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8121 00000100:00100000:1.0:1746147258.947954:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465873536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147258.947965:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147258.947970:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 9 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.947979:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 9 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.947996:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1b73 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed21e expref: 9 pid: 14049 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746147258.948024:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147258.948028:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147258.948035:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147258.948041:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147258.948058:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147258.948077:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147258.948084:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147258.948092:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465873536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 157us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147258.948107:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8121 00000040:00080000:2.0:1746147258.948605:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3432, 88 off287512 00000004:00080000:2.0:1746147258.948611:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935673643ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948656:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3427, 88 off287072 00000004:00080000:2.0:1746147258.948659:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935721892ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948684:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3428, 88 off287160 00000004:00080000:2.0:1746147258.948687:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935750109ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948694:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3433, 88 off287600 00000004:00080000:2.0:1746147258.948697:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935759560ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948702:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3434, 88 off287688 00000004:00080000:2.0:1746147258.948705:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935767914ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948712:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3429, 88 off287248 00000004:00080000:2.0:1746147258.948714:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935777193ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948721:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3430, 88 off287336 00000004:00080000:2.0:1746147258.948723:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935786173ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948730:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3431, 88 off287424 00000004:00080000:2.0:1746147258.948732:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935794387ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948738:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3435, 88 off287776 00000004:00080000:2.0:1746147258.948741:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935803409ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948746:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3432, 88 off287512 00000004:00080000:2.0:1746147258.948749:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935811840ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948755:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3436, 88 off287864 00000004:00080000:2.0:1746147258.948757:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935819480ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948762:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3433, 88 off287600 00000004:00080000:2.0:1746147258.948765:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935827432ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147258.948771:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3437, 88 off287952 00000004:00080000:2.0:1746147258.948773:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935835960ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948779:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3438, 88 off288040 00000004:00080000:2.0:1746147258.948783:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935845608ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948789:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3439, 88 off288128 00000004:00080000:2.0:1746147258.948792:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935854337ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948797:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3440, 88 off288216 00000004:00080000:2.0:1746147258.948800:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645935862518ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147258.948805:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3434, 88 off287688 00000004:00080000:2.0:1746147258.948807:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 645935870075ns, next at 607576201812ns, rc = 0 00000100:00100000:1.0:1746147258.965394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147258.966063:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465873792 00000100:00100000:0.0:1746147258.966071:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465873792 00000100:00100000:0.0:1746147258.966118:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11511 00000100:00100000:0.0:1746147258.966125:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+6:32076:x1830967465873792:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147258.966142:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147258.966156:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad1b96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed233 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.966228:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966238:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966246:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966255:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966260:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966265:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966347:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966353:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966359:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147258.966366:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147258.966448:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966453:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966458:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966463:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130aeb200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147258.966465:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966471:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966479:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147258.966481:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746147258.966484:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 2/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.966488:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad1bab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967782:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967789:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967793:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967797:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130aeba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147258.967800:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967804:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967811:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147258.967812:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147258.967815:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967819:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad1b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967827:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967831:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967835:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967838:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130aea400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147258.967840:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967844:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967849:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b1417f00) 00010000:00010000:0.0:1746147258.967850:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147258.967852:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967855:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad1ba4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147258.967888:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad1b96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed233 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.967894:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad1b96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed233 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147258.967900:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aeb800, rc 0) 00000100:00100000:0.0:1746147258.967960:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32076:x1830967465873792:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1836us (2574us total) trans 8589945527 rc 301/301 00000100:00100000:0.0:1746147258.967967:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11511 00000001:00080000:1.0:1746147258.976586:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945526 is committed 00000004:00080000:1.0:1746147258.976593:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2560 committed 00000004:00080000:1.0:1746147258.976598:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2562 committed 00000004:00080000:1.0:1746147258.976602:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2561 committed 00000004:00080000:1.0:1746147258.976603:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2560 committed 00000004:00080000:1.0:1746147258.976605:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2559 committed 00000004:00080000:1.0:1746147258.976607:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2559 committed 00000004:00080000:1.0:1746147258.976608:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2558 committed 00000004:00080000:1.0:1746147258.976609:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2558 committed 00000004:00080000:1.0:1746147258.976611:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2557 committed 00000004:00080000:1.0:1746147258.976612:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2557 committed 00000004:00080000:1.0:1746147258.976614:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2556 committed 00000004:00080000:1.0:1746147258.976615:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2555 committed 00000004:00080000:1.0:1746147258.976616:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2556 committed 00000004:00080000:1.0:1746147258.976618:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2555 committed 00000004:00080000:1.0:1746147258.976620:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2554 committed 00000004:00080000:1.0:1746147258.976621:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2553 committed 00000004:00080000:1.0:1746147258.976622:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2554 committed 00000001:00080000:1.0:1746147258.976628:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945525 is committed 00010000:00010000:3.0:1746147258.976630:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 302 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147258.976641:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.976644:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147258.976657:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1400/0xb4b2209fbdad1b88 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 302 pid: 23726 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147258.976672:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 301 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147258.976794:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467095424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.976844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.976882:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467095936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.976897:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.976907:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096448:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147258.976911:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147258.976914:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147258.976916:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e1000, rc 0) 00000100:00100000:2.0:1746147258.976920:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.976929:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.976956:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.976966:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32072:x1830967465873408:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 31356us (32040us total) trans 8589945526 rc 0/0 00000100:00100000:2.0:1746147258.976971:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746147258.976973:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11510 00000100:00100000:2.0:1746147258.976975:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467095552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.976994:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467095680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.976994:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.977003:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.977011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.977014:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.977023:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467096192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.977023:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.977033:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.977036:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467095808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.977043:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467096704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.977048:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.977058:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095424 00000100:00100000:2.0:1746147258.977059:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467096320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.977063:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095424 00000100:00100000:2.0:1746147258.977070:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.977078:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467096832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.977082:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095936 00000100:00100000:3.0:1746147258.977083:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095936 00000100:00100000:2.0:1746147258.977088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.977090:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096448 00000100:00100000:3.0:1746147258.977091:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096448 00000100:00100000:2.0:1746147258.977105:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467097344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.977110:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096960 00000100:00100000:3.0:1746147258.977112:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096960 00000100:00100000:3.0:1746147258.977117:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095552 00000100:00100000:3.0:1746147258.977118:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095552 00000100:00100000:2.0:1746147258.977118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.977123:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095680 00000100:00100000:3.0:1746147258.977124:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095680 00000100:00100000:3.0:1746147258.977130:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096064 00000100:00100000:3.0:1746147258.977132:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096064 00000100:00100000:2.0:1746147258.977133:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096192 00000100:00100000:2.0:1746147258.977135:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096192 00000100:00100000:3.0:1746147258.977136:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467095808 00000100:00100000:3.0:1746147258.977137:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467095808 00000100:00100000:3.0:1746147258.977142:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096320 00000100:00100000:3.0:1746147258.977143:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096320 00000100:00100000:2.0:1746147258.977143:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096832 00000100:00100000:2.0:1746147258.977144:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096832 00000100:00100000:3.0:1746147258.977148:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467097344 00000100:00100000:3.0:1746147258.977149:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467097344 00000100:00100000:2.0:1746147258.977151:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15882 00000100:00100000:3.0:1746147258.977156:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15883 00000100:00100000:2.0:1746147258.977156:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967467095424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.977160:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967467095936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.977170:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15884 00000100:00100000:3.0:1746147258.977173:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3295:x1830967467096448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.977242:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15885 00000100:00100000:1.0:1746147258.977249:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3295:x1830967467096960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.977294:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967467096448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (372us total) trans 17179874068 rc 0/0 00000100:00100000:2.0:1746147258.977294:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467095424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (450us total) trans 21474841426 rc 0/0 00000100:00100000:3.0:1746147258.977299:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15884 00000100:00100000:2.0:1746147258.977307:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15882 00000100:00100000:3.0:1746147258.977309:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15886 00000100:00100000:3.0:1746147258.977312:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967467095552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.977314:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15887 00000100:00100000:2.0:1746147258.977317:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967467095680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147258.977338:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967467096960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (380us total) trans 17179874069 rc 0/0 00000100:00100000:1.0:1746147258.977343:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15885 00000100:00100000:3.0:1746147258.977348:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15888 00000100:00100000:3.0:1746147258.977352:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967467096064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147258.977357:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15889 00000100:00100000:1.0:1746147258.977362:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967467095808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.977392:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967467095680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (379us total) trans 21474841427 rc 0/0 00000100:00100000:2.0:1746147258.977397:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15887 00000100:00100000:2.0:1746147258.977405:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15890 00000100:00100000:2.0:1746147258.977409:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967467096192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147258.977411:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:3.0:1746147258.977414:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147258.977416:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147258.977417:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00000100:00100000:2.0:1746147258.977418:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15891 00002000:00010000:3.0:1746147258.977419:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:2.0:1746147258.977421:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967467096320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.977437:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3295:x1830967467096064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (421us total) trans 21474841428 rc 0/0 00000100:00100000:3.0:1746147258.977442:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15888 00000100:00100000:1.0:1746147258.977445:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967467095808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (395us total) trans 21474841429 rc 0/0 00000100:00100000:1.0:1746147258.977450:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15889 00000100:00100000:2.0:1746147258.977497:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1830967467096320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (425us total) trans 21474841430 rc 0/0 00000100:00100000:3.0:1746147258.978225:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15892 00000100:00100000:1.0:1746147258.978247:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15893 00000100:00100000:3.0:1746147258.978263:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967467096832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.978269:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15891 00000100:00100000:2.0:1746147258.978298:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147258.978320:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467097088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.978338:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.978357:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967467096832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1267us total) trans 17179874070 rc 0/0 00000004:00080000:2.0:1746147258.978359:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a044aa00/2, rc 0, transno 17179874068 00000100:00100000:3.0:1746147258.978362:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15892 00000100:00100000:2.0:1746147258.978366:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.978372:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096576 00000004:00080000:2.0:1746147258.978373:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448e00/2, rc 0, transno 17179874069 00000100:00100000:3.0:1746147258.978375:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096576 00000100:00100000:2.0:1746147258.978375:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.978378:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467097088 00000004:00080000:2.0:1746147258.978381:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094400700/2, rc 0, transno 21474841426 00000100:00100000:0.0:1746147258.978381:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467097088 00000100:00100000:2.0:1746147258.978385:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467095424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.978392:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15894 00000004:00080000:2.0:1746147258.978392:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401f80/2, rc 0, transno 21474841428 00000100:00100000:2.0:1746147258.978395:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.978396:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967467096576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.978396:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15895 00000100:00100000:0.0:1746147258.978400:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967467097088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.978443:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967467097344:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147258.978481:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094402a00/2, rc 0, transno 21474841429 00000100:00100000:1.0:1746147258.978485:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467095808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147258.978492:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094402680/2, rc 0, transno 21474841430 00000100:00100000:1.0:1746147258.978494:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467096320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147258.978500:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448000/2, rc 0, transno 17179874070 00000100:00100000:1.0:1746147258.978503:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467096832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.978511:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147258.978517:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467097472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147258.978534:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.978536:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467096576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (238us total) trans 17179874071 rc 0/0 00000100:00100000:3.0:1746147258.978542:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15894 00000100:00100000:3.0:1746147258.978549:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467097472 00000100:00100000:3.0:1746147258.978551:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467097472 00000100:00100000:0.0:1746147258.978555:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467097088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (215us total) trans 17179874072 rc 0/0 00000100:00100000:3.0:1746147258.978563:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15896 00000100:00100000:3.0:1746147258.978566:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967467097472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.978566:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15895 00000100:00100000:3.0:1746147258.978635:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967467097472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (99us total) trans 17179874074 rc 0/0 00000100:00100000:1.0:1746147258.978635:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967467097344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (1515us total) trans 17179874073 rc 0/0 00000100:00100000:1.0:1746147258.978640:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15893 00000100:00100000:3.0:1746147258.978642:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15896 00000100:00100000:3.0:1746147258.978657:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147258.978669:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467097216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.978686:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147258.978717:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401c00/2, rc 0, transno 21474841427 00000100:00100000:3.0:1746147258.978720:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467095680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.978734:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467096704 00000100:00100000:3.0:1746147258.978736:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467096704 00000100:00100000:3.0:1746147258.978755:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467097216 00000100:00100000:3.0:1746147258.978757:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467097216 00000100:00100000:3.0:1746147258.978767:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15897 00000100:00100000:3.0:1746147258.978771:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967467096704:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147258.978804:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0449f80/2, rc 0, transno 17179874071 00000100:00100000:2.0:1746147258.978809:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467096576:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147258.978814:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d498000/2, rc 0, transno 17179874072 00000100:00100000:2.0:1746147258.978816:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467097088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.978827:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15898 00000100:00100000:2.0:1746147258.978832:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467097216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147258.978850:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467096704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (191us total) trans 17179874075 rc 0/0 00000100:00100000:3.0:1746147258.978855:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15897 00000100:00100000:2.0:1746147258.978914:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467097216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (227us total) trans 17179874076 rc 0/0 00000100:00100000:2.0:1746147258.978919:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15898 00000100:00100000:3.0:1746147258.978966:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467095936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1805us (2067us total) trans 21474841431 rc 0/0 00000100:00100000:3.0:1746147258.978971:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15883 00000004:00080000:3.0:1746147258.978991:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a044b100/2, rc 0, transno 17179874075 00000100:00100000:3.0:1746147258.978994:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467096704:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147258.979005:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b480/2, rc 0, transno 17179874076 00000100:00100000:3.0:1746147258.979007:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467097216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147258.979013:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967467096192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1603us (1978us total) trans 21474841432 rc 0/0 00000004:00080000:3.0:1746147258.979015:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401180/2, rc 0, transno 21474841432 00000100:00100000:3.0:1746147258.979017:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467096192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147258.979018:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15890 00000004:00080000:2.0:1746147258.979036:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094401880/2, rc 0, transno 21474841431 00000100:00100000:2.0:1746147258.979039:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467095936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147258.979080:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467095552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1767us (2085us total) trans 21474841433 rc 0/0 00000100:00100000:3.0:1746147258.979086:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15886 00000004:00080000:2.0:1746147258.979229:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094400e00/2, rc 0, transno 21474841433 00000100:00100000:2.0:1746147258.979232:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467095552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147258.979305:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050a300/2, rc 0, transno 17179874073 00000100:00100000:0.0:1746147258.979309:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467097344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147258.979321:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b800/2, rc 0, transno 17179874074 00000100:00100000:0.0:1746147258.979323:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467097472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147258.981480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.981528:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465873920 00000100:00100000:2.0:1746147258.981534:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465873920 00000100:00100000:2.0:1746147258.981575:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15899 00000100:00100000:2.0:1746147258.981582:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:32072:x1830967465873920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147258.981596:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147258.981611:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed23a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147258.981630:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417b7, atime: 0x681417b7, ctime: 0x681417b7, blocks: 0x821 00010000:00010000:2.0:1746147258.981644:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.981646:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147258.981653:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.981664:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147258.981673:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783c00, rc 0) 00000100:00100000:2.0:1746147258.981717:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:32072:x1830967465873920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 136us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147258.981723:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15899 00000100:00100000:0.0:1746147258.986896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147258.986961:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465874176 00000100:00100000:2.0:1746147258.986968:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465874176 00002000:00100000:2.0:1746147258.987001:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1871872->1875967) req@ffff880090509500 x1830967465874176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/0 e 0 to 0 dl 1746147269 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.987010:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509500 with x1830967465874176 ext(1871872->1875967) 00002000:00010000:2.0:1746147258.987014:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090509500 00000100:00100000:2.0:1746147258.987042:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7578 00000100:00100000:2.0:1746147258.987049:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465874176:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147258.987215:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465874176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 165us (325us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147258.987224:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7578 00002000:00100000:2.0:1746147258.987230:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x425:0x0] (1871872->1875967) req@ffff880090509500 x1830967465874176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746147269 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147258.987236:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509500 with x1830967465874176 ext(1871872->1875967) 00002000:00010000:2.0:1746147258.987239:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090509500 00000100:00100000:1.0:1746147258.989185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147258.989211:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465874432 00000100:00100000:3.0:1746147258.989330:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465874432 00000100:00100000:3.0:1746147258.989372:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4823 00000100:00100000:3.0:1746147258.989379:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32072:x1830967465874432:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147258.989595:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32072:x1830967465874432:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 216us (414us total) trans 8589945528 rc 0/0 00000100:00100000:3.0:1746147258.989602:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4823 00010000:00010000:3.0:1746147259.013232:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147259.019404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.019474:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465874688 00000100:00100000:3.0:1746147259.019487:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465874688 00000100:00100000:3.0:1746147259.019547:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11512 00000100:00100000:3.0:1746147259.019555:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32080:x1830967465874688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.019577:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.019595:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1bc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed241 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.019701:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019712:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019722:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019733:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019742:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019747:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019841:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019847:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019853:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147259.019861:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.019972:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019979:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019985:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.019990:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d43e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.019994:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020000:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020009:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147259.020013:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.020016:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020021:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d43e00/0xb4b2209fbdad1bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020616:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020623:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020628:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020632:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0e400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.020635:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020640:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020646:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9b00) 00010000:00010000:3.0:1746147259.020648:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.020651:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020655:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.020701:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1bc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.020716:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.020722:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.020724:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147259.020726:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f400, rc 0) 00000100:00100000:3.0:1746147259.020784:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32080:x1830967465874688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1230us (1389us total) trans 8589945529 rc 0/0 00000100:00100000:3.0:1746147259.020790:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11512 00000100:00100000:0.0:1746147259.026732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.026766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.026837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.026874:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465874816 00000100:00100000:0.0:1746147259.026883:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465874816 00000100:00100000:2.0:1746147259.026930:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465874944 00000100:00100000:2.0:1746147259.026934:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465874944 00000100:00100000:0.0:1746147259.026959:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875072 00000100:00100000:0.0:1746147259.026962:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875072 00000100:00100000:2.0:1746147259.026971:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15900 00000100:00100000:0.0:1746147259.026976:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15901 00000100:00100000:2.0:1746147259.026979:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967465874816:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147259.026980:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465874944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.026996:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.026996:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.027013:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed248 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.027013:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed24f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147259.027035:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417b8, atime: 0x681417b8, ctime: 0x681417b8, blocks: 0x81f 00002000:00010000:0.0:1746147259.027035:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417b9, atime: 0x681417b9, ctime: 0x681417b9, blocks: 0x81f 00010000:00010000:0.0:1746147259.027052:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.027054:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.027063:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.027063:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 27 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.027064:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.027074:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.027088:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.027088:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 27 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.027106:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782a00, rc 0) 00010000:00010000:0.0:1746147259.027106:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854e00, rc 0) 00000100:00100000:3.0:1746147259.027174:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15902 00000100:00100000:3.0:1746147259.027182:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465875072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.027188:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.027197:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed256 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147259.027208:0:17530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417ba, atime: 0x681417ba, ctime: 0x681417ba, blocks: 0x821 00010000:00010000:3.0:1746147259.027215:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.027216:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.027220:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 28 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.027228:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 28 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.027234:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ee00, rc 0) 00000100:00080000:1.0:1746147259.027296:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147259.027300:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147259.028368:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967465874816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1388us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.028368:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465874944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1384us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.028375:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15901 00000100:00100000:2.0:1746147259.028378:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15900 00000100:00100000:3.0:1746147259.028475:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465875072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1293us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.028481:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15902 00000100:00100000:1.0:1746147259.028657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.028963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.028997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.029295:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875200 00000100:00100000:3.0:1746147259.029303:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875200 00000100:00100000:3.0:1746147259.029325:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875328 00000100:00100000:3.0:1746147259.029327:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875328 00000100:00100000:3.0:1746147259.029336:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875456 00000100:00100000:3.0:1746147259.029337:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875456 00000100:00100000:3.0:1746147259.029349:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15903 00000100:00100000:3.0:1746147259.029354:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465875200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.029367:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.029379:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed25d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.029424:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467097600:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147259.029485:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db8e900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.029510:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15904 00000100:00100000:3.0:1746147259.029516:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465875328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.029522:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.029531:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed264 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147259.029548:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417ba, atime: 0x681417ba, ctime: 0x681417ba, blocks: 0x1641 00010000:00010000:3.0:1746147259.029556:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.029558:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.029564:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.029575:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.029583:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5379400, rc 0) 00000100:00100000:3.0:1746147259.029602:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967465875328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 86us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.029607:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15904 00000100:00100000:3.0:1746147259.029623:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15905 00000100:00100000:3.0:1746147259.029628:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465875456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.029634:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.029644:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed26b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147259.029657:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417ba, atime: 0x681417ba, ctime: 0x681417ba, blocks: 0x1029 00010000:00010000:3.0:1746147259.029665:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.029666:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.029670:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.029678:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.029684:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ea00, rc 0) 00000100:00100000:3.0:1746147259.029699:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465875456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 71us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.029706:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15905 00002000:00010000:3.0:1746147259.031833:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147255 -> 1746147258 00002000:00010000:3.0:1746147259.031840:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147255 -> 1746147258 00000100:00100000:3.0:1746147259.031857:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467097600:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.031887:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bf8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed25d expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.031898:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e0e400/0xb4b2209fbdad1bf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed25d expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.032409:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0e400, rc 0) 00000100:00100000:3.0:1746147259.032527:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465875200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3168us (3865us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.032544:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15903 00000100:00100000:0.0:1746147259.035011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.035251:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875584 00000100:00100000:3.0:1746147259.035258:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875584 00000100:00100000:1.0:1746147259.035609:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15906 00000100:00100000:1.0:1746147259.035617:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32076:x1830967465875584:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147259.035631:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.035654:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed272 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.035676:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.035682:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.035684:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.035686:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.035709:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.035718:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 22 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.035728:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467097728:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.036320:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.041552:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467097728:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.041613:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.041628:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56e600, rc 0) 00000100:00100000:1.0:1746147259.041672:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32076:x1830967465875584:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6055us (6666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.041679:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15906 00000100:00100000:0.0:1746147259.043650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.043750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.043790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.043838:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.043871:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875840 00000100:00100000:0.0:1746147259.043879:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875840 00002000:00100000:0.0:1746147259.043912:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012bfe2680 x1830967465875840/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.043921:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe2680 with x1830967465875840 ext(0->1048575) 00002000:00010000:0.0:1746147259.043954:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe2680 00000100:00100000:0.0:1746147259.043969:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465876224 00000100:00100000:0.0:1746147259.043971:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465876224 00002000:00100000:0.0:1746147259.043985:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012bfe1c00 x1830967465876224/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.043991:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1c00 with x1830967465876224 ext(1048576->2097151) 00002000:00010000:0.0:1746147259.043993:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe1c00 00000100:00100000:0.0:1746147259.044001:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465876480 00000100:00100000:0.0:1746147259.044017:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465876480 00002000:00100000:0.0:1746147259.044029:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012bfe3100 x1830967465876480/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.044035:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3100 with x1830967465876480 ext(1048576->2097151) 00002000:00010000:0.0:1746147259.044038:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3100 00000100:00100000:0.0:1746147259.044049:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7579 00000100:00100000:0.0:1746147259.044055:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465875840:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.044318:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465875968 00000100:00100000:1.0:1746147259.044322:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465875968 00010000:00010000:1.0:1746147259.044337:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.044355:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8122 00000100:00100000:1.0:1746147259.044359:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465875968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.044366:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.044379:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.044389:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.044409:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5379400/0xb4b2209fbdad1bff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed264 expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.044424:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.044426:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.044431:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.044438:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.044461:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.044471:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467097856:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.044525:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.044625:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7580 00000100:00100000:3.0:1746147259.044633:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465876224:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.044651:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7581 00000100:00100000:2.0:1746147259.044659:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465876480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.054091:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467097856:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147259.054120:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.054171:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465875968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9809us (10419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.054180:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8122 00000100:00100000:2.0:1746147259.055621:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465876480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10959us (11778us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.055631:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7581 00002000:00100000:2.0:1746147259.055641:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012bfe3100 x1830967465876480/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.055650:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3100 with x1830967465876480 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.055655:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3100 00000100:00100000:1.0:1746147259.057224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.057514:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465876736 00000100:00100000:2.0:1746147259.057521:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465876736 00002000:00100000:2.0:1746147259.057552:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2580480->2584575) req@ffff88012c9f3100 x1830967465876736/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.057559:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967465876736 ext(2580480->2584575) 00002000:00010000:2.0:1746147259.057564:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:2.0:1746147259.057587:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7582 00000100:00100000:2.0:1746147259.057594:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465876736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.057765:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465876736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 170us (545us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147259.057772:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7582 00002000:00100000:2.0:1746147259.057777:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2580480->2584575) req@ffff88012c9f3100 x1830967465876736/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.057789:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967465876736 ext(2580480->2584575) 00002000:00010000:2.0:1746147259.057792:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:0.0:1746147259.058691:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465876224:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14057us (14898us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147259.058699:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7580 00002000:00100000:0.0:1746147259.058705:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012bfe1c00 x1830967465876224/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.058713:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1c00 with x1830967465876224 ext(1048576->2097151) 00002000:00010000:0.0:1746147259.058716:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe1c00 00000100:00100000:2.0:1746147259.062567:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967465875840:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18503us (18957us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.062577:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7579 00002000:00100000:2.0:1746147259.062585:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88012bfe2680 x1830967465875840/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.062593:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe2680 with x1830967465875840 ext(0->1048575) 00002000:00010000:2.0:1746147259.062597:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bfe2680 00000100:00100000:0.0:1746147259.066850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.066904:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465876864 00000100:00100000:1.0:1746147259.066912:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465876864 00000100:00100000:1.0:1746147259.066984:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15907 00000100:00100000:1.0:1746147259.066991:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32076:x1830967465876864:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147259.067005:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.067019:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed279 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.067041:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 29 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.067048:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.067049:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.067053:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->2195455] (req 2097152->2195455) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.067075:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 29 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.067084:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 29 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.067101:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467097984:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.067168:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.071992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.071993:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467097984:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.072015:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->2195455] (req 2097152->2195455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 29 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.072029:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dce00, rc 0) 00000100:00100000:2.0:1746147259.072051:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465876992 00000100:00100000:2.0:1746147259.072057:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465876992 00000100:00100000:1.0:1746147259.072075:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32076:x1830967465876864:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5085us (5232us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147259.072080:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 30 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.072083:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15907 00000100:00100000:2.0:1746147259.072113:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8123 00000100:00100000:2.0:1746147259.072119:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465876992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.072129:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.072148:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 29 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.072161:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 29 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.072178:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1c06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed26b expref: 29 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.072208:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.072210:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.072215:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.072223:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.072246:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.072257:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467098112:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.072513:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.076118:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467098112:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.076137:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.076185:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465876992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4064us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.076195:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8123 00000100:00100000:0.0:1746147259.076411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.076519:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465877120 00000100:00100000:1.0:1746147259.076525:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465877120 00000100:00100000:1.0:1746147259.076564:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15908 00000100:00100000:1.0:1746147259.076570:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32080:x1830967465877120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.076584:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.076601:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed280 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.076624:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.076631:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.076633:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.076636:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.077418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147259.077507:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.077518:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 34 pid: 17548 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.077529:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467098240:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.077566:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465877376 00000100:00100000:2.0:1746147259.077570:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465877376 00000100:00100000:1.0:1746147259.077590:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00002000:00100000:2.0:1746147259.077597:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2191360->2195455) req@ffff88012bfe0700 x1830967465877376/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.077607:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe0700 with x1830967465877376 ext(2191360->2195455) 00002000:00010000:2.0:1746147259.077611:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe0700 00000100:00100000:2.0:1746147259.077801:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7583 00000100:00100000:2.0:1746147259.077809:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465877376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.078785:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465877376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 974us (1368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147259.078793:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7583 00002000:00100000:2.0:1746147259.078799:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2191360->2195455) req@ffff88012bfe0700 x1830967465877376/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.078807:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe0700 with x1830967465877376 ext(2191360->2195455) 00002000:00010000:2.0:1746147259.078810:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe0700 00000100:00100000:0.0:1746147259.079055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.079108:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465877632 00000100:00100000:3.0:1746147259.079113:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465877632 00000100:00100000:3.0:1746147259.079141:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11513 00000100:00100000:3.0:1746147259.079146:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32083:x1830967465877632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.079158:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.079171:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed287 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.079247:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079257:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079265:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079276:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079281:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079286:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079367:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079374:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079380:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147259.079387:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.079449:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079455:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079464:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079469:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0fa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.079472:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079477:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079485:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147259.079487:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.079490:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079494:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079517:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079523:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079527:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079530:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0e400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.079533:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079537:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079546:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f5daf00) 00010000:00010000:3.0:1746147259.079548:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.079550:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079554:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.079583:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.079591:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 304 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.079596:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.079598:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147259.079600:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a800, rc 0) 00000100:00100000:3.0:1746147259.079629:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32083:x1830967465877632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 483us (575us total) trans 8589945530 rc 0/0 00000100:00100000:3.0:1746147259.079634:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11513 00000100:00100000:1.0:1746147259.079876:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467098240:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.079894:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.079905:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd000, rc 0) 00000100:00100000:1.0:1746147259.079957:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32080:x1830967465877120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3365us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.079964:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15908 00000100:00100000:0.0:1746147259.081231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.081353:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878144 00000100:00100000:1.0:1746147259.081358:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878144 00000100:00100000:1.0:1746147259.081379:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878272 00000100:00100000:1.0:1746147259.081381:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878272 00000100:00100000:1.0:1746147259.081393:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15909 00000100:00100000:1.0:1746147259.081397:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465878144:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147259.081399:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15910 00010000:00010000:1.0:1746147259.081406:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147259.081408:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967465878272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.081416:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.081417:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed28e expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.081425:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed295 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.081430:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.081432:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.081437:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.081438:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 36 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.081439:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.081444:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 35 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.081449:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 36 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.081453:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 35 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.081456:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd400, rc 0) 00010000:00010000:2.0:1746147259.081460:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783800, rc 0) 00000100:00100000:2.0:1746147259.081481:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967465878272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.081481:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465878144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 83us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.081487:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15910 00000100:00100000:1.0:1746147259.081491:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15909 00000100:00100000:2.0:1746147259.081503:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878016 00000100:00100000:2.0:1746147259.081506:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878016 00000100:00100000:0.0:1746147259.081706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.081766:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878400 00000100:00100000:0.0:1746147259.081769:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878400 00000100:00100000:0.0:1746147259.081781:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878528 00000100:00100000:0.0:1746147259.081782:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878528 00000100:00100000:0.0:1746147259.081789:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878784 00000100:00100000:0.0:1746147259.081790:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878784 00000100:00100000:0.0:1746147259.081797:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878656 00000100:00100000:0.0:1746147259.081798:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878656 00000100:00100000:0.0:1746147259.081807:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15911 00000100:00100000:0.0:1746147259.081811:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465878400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.081817:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.081822:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed29c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.081831:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.081833:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.081836:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.081845:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.081851:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6a00, rc 0) 00000100:00100000:0.0:1746147259.081867:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465878400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.081872:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15911 00000100:00100000:0.0:1746147259.081882:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15912 00000100:00100000:0.0:1746147259.081888:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465878528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.081894:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.081899:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad1c5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2a3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.081930:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467098368:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.081988:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c9da180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.082005:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15913 00000100:00100000:0.0:1746147259.082009:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465878784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.082015:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.082020:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98400/0xb4b2209fbdad1c61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2b1 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.082038:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467098496:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.082055:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.082066:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15914 00000100:00100000:0.0:1746147259.082070:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465878656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.082075:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.082080:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad1c68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2aa expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.082108:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467098624:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.082126:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082600 going to sleep for 11 seconds 00002000:00100000:2.0:1746147259.082174:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1466368->1875967) req@ffff88012bfe1180 x1830967465878016/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.082182:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1180 with x1830967465878016 ext(1466368->1875967) 00010000:00010000:2.0:1746147259.082187:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 40 pid: 17548 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.082196:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 40 pid: 17548 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.082201:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bfe1180 00000100:00100000:2.0:1746147259.082212:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2597 00000100:00100000:2.0:1746147259.082216:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465878016:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147259.082582:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465877888 00000100:00100000:3.0:1746147259.082585:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465877888 00000100:00100000:3.0:1746147259.082615:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4824 00000100:00100000:3.0:1746147259.082619:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32076:x1830967465877888:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147259.082735:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32076:x1830967465877888:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 115us (1508us total) trans 8589945531 rc 0/0 00000100:00100000:3.0:1746147259.082741:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4824 00000100:00100000:1.0:1746147259.086160:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467098496:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.086190:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98400/0xb4b2209fbdad1c61 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b1 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.086203:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c98400/0xb4b2209fbdad1c61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b1 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147259.086208:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467098624:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.086219:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c98400, rc 0) 00000100:00100000:3.0:1746147259.086251:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467098368:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.086258:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465878784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4247us (4521us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.086265:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15913 00010000:00010000:3.0:1746147259.086269:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad1c5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2a3 expref: 41 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.086278:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad1c5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2a3 expref: 41 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.086286:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6800, rc 0) 00000100:00100000:3.0:1746147259.086307:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465878528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4418us (4583us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.086312:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15912 00010000:00010000:0.0:1746147259.086320:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad1c68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2aa expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.086329:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad1c68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2aa expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.086357:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73c00, rc 0) 00000100:00100000:0.0:1746147259.086388:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465878656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4316us (4633us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147259.086393:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15914 00000100:00100000:2.0:1746147259.089870:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465878016:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7645us (8592us total) trans 17179874077 rc 0/0 00000100:00100000:2.0:1746147259.089880:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2597 00002000:00100000:2.0:1746147259.089889:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1466368->1875967) req@ffff88012bfe1180 x1830967465878016/t17179874077(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.089898:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe1180 with x1830967465878016 ext(1466368->1875967) 00010000:00010000:2.0:1746147259.089907:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 38 pid: 17548 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.089920:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 38 pid: 17548 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.089931:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bfe1180 00000100:00100000:0.0:1746147259.095157:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.095193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.095219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.095250:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465878912 00000100:00100000:3.0:1746147259.095258:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465878912 00000100:00100000:0.0:1746147259.095259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.095273:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465879296 00000100:00100000:1.0:1746147259.095277:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465879296 00000100:00100000:2.0:1746147259.095280:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465879424 00000100:00100000:2.0:1746147259.095285:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465879424 00010000:00010000:3.0:1746147259.095288:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 39 pid: 17548 timeout: 746 lvb_type: 0 00002000:00100000:2.0:1746147259.095305:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a5a0c700 x1830967465879424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.095305:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800a5a0df80 x1830967465879296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.095313:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c700 with x1830967465879424 ext(1048576->2097151) 00002000:00100000:1.0:1746147259.095313:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0df80 with x1830967465879296 ext(0->1048575) 00002000:00010000:2.0:1746147259.095317:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0c700 00002000:00010000:1.0:1746147259.095317:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0df80 00000100:00100000:3.0:1746147259.095320:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8124 00000100:00100000:3.0:1746147259.095327:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465878912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147259.095329:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465879552 00000100:00100000:2.0:1746147259.095331:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465879552 00010000:00010000:3.0:1746147259.095337:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746147259.095341:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5a0f100 x1830967465879552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147259.095341:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7584 00000100:00100000:1.0:1746147259.095346:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465879424:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147259.095347:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967465879552 ext(1048576->2097151) 00000100:00100000:0.0:1746147259.095347:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7585 00002000:00010000:2.0:1746147259.095349:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:0.0:1746147259.095353:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465879296:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147259.095356:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 39 pid: 17548 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.095365:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7586 00010000:00010000:3.0:1746147259.095366:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 39 pid: 17548 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.095370:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465879552:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147259.095383:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093783c00/0xb4b2209fbdad1bb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1875967) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed23a expref: 39 pid: 17548 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.095398:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.095400:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.095406:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.095412:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.095437:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.095447:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467098752:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.095512:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.097907:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467098752:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.097927:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.097985:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465878912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2656us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.097995:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8124 00000100:00100000:0.0:1746147259.100203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.100601:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465879936 00000100:00100000:2.0:1746147259.100609:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465879936 00002000:00100000:2.0:1746147259.100642:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a5a0fb80 x1830967465879936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.100650:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0fb80 with x1830967465879936 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.100654:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0fb80 00000100:00100000:2.0:1746147259.100672:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7587 00000100:00100000:2.0:1746147259.100679:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465879936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.104884:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465879552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9505us (9615us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.104893:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7586 00002000:00100000:3.0:1746147259.104903:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5a0f100 x1830967465879552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.104911:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967465879552 ext(1048576->2097151) 00002000:00010000:3.0:1746147259.104916:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:1.0:1746147259.107999:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465879424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12644us (12770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.108009:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7584 00002000:00100000:1.0:1746147259.108018:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a5a0c700 x1830967465879424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.108026:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c700 with x1830967465879424 ext(1048576->2097151) 00002000:00010000:1.0:1746147259.108030:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0c700 00000100:00100000:2.0:1746147259.119140:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465879296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23773us (23978us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.119152:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7585 00002000:00100000:2.0:1746147259.119165:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800a5a0df80 x1830967465879296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.119174:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0df80 with x1830967465879296 ext(0->1048575) 00002000:00010000:2.0:1746147259.119181:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0df80 00000100:00100000:0.0:1746147259.120517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.122058:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880192 00000100:00100000:3.0:1746147259.122072:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880192 00000100:00100000:3.0:1746147259.122146:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11514 00000100:00100000:3.0:1746147259.122154:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32086:x1830967465880192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.122176:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.122193:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2b8 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.122272:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.122284:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.122291:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.122296:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.122320:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.122330:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.122339:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467098880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.122438:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.122448:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.122455:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467099008:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.122473:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.122872:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465879936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22187us (22669us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.122884:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7587 00002000:00100000:2.0:1746147259.122895:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a5a0fb80 x1830967465879936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.122904:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0fb80 with x1830967465879936 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.122909:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0fb80 00000100:00100000:0.0:1746147259.123772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.123838:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880320 00000100:00100000:0.0:1746147259.123838:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.123845:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880320 00010000:00010000:2.0:1746147259.123872:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 306 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.123893:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880448 00000100:00100000:2.0:1746147259.123895:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880448 00010000:00010000:2.0:1746147259.123906:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.123921:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8125 00000100:00100000:2.0:1746147259.123927:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1957:x1830967465880320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.123970:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.123977:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 306 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.123986:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 306 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.124007:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.124012:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.124019:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.124023:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.124045:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1957:x1830967465880320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.124050:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8125 00000100:00100000:2.0:1746147259.124061:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8126 00000100:00100000:2.0:1746147259.124065:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465880448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.124070:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.124073:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.124080:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.124089:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.124092:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.124110:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.124116:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.124131:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.124144:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465880448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.124149:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8126 00010000:00010000:3.0:1746147259.124301:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95a800/0xb4b2209fbdad1c37 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed287 expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.124322:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467098880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.124333:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1bd5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed241 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.124342:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467099008:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.124363:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.124370:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.124375:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147259.124390:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.124509:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1c6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.124523:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.124531:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.124534:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147259.124536:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0fa00, rc 0) 00000100:00100000:3.0:1746147259.124599:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32086:x1830967465880192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2446us (4085us total) trans 8589945532 rc 0/0 00000100:00100000:3.0:1746147259.124607:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11514 00000100:00100000:0.0:1746147259.128562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.128619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.128770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.129346:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880704 00000100:00100000:2.0:1746147259.129355:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880704 00000100:00100000:2.0:1746147259.129401:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880832 00000100:00100000:2.0:1746147259.129403:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880832 00000100:00100000:2.0:1746147259.129419:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15915 00000100:00100000:2.0:1746147259.129425:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32086:x1830967465880704:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.129444:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.129461:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2c6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.129493:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.129500:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.129501:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.129505:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2600960->2695167] (req 2600960->2695167) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.129542:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.129554:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 27 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.129566:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467099136:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.129602:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15916 00000100:00100000:0.0:1746147259.129609:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32083:x1830967465880832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.129617:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.129630:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2cd expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.129643:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.129644:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.129650:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.129655:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00010000:00010000:0.0:1746147259.129662:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.129676:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0000, rc 0) 00000100:00100000:0.0:1746147259.129699:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:32083:x1830967465880832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 91us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.129705:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15916 00000100:00100000:3.0:1746147259.129821:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880576 00000100:00100000:3.0:1746147259.129833:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880576 00000100:00100000:3.0:1746147259.129890:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11515 00000100:00100000:3.0:1746147259.129896:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32080:x1830967465880576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.129916:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.129931:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2bf expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.130062:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.130073:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.130085:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.130088:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147259.130090:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ecc00, rc 0) 00000100:00100000:3.0:1746147259.130159:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32080:x1830967465880576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 264us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.130165:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11515 00000100:00100000:2.0:1746147259.138286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.138306:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467099136:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.138330:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2600960->2695167] (req 2600960->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.138344:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0200, rc 0) 00000100:00100000:2.0:1746147259.138489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.138508:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32086:x1830967465880704:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9081us (9886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.138516:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15915 00000100:00100000:3.0:1746147259.138593:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465881088 00000100:00100000:3.0:1746147259.138599:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465881088 00000100:00100000:3.0:1746147259.138627:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11516 00000100:00100000:3.0:1746147259.138633:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:32087:x1830967465881088:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.138649:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.138662:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad1c99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2d4 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.138709:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138719:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138728:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138738:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138743:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138748:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138897:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138906:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 304 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.138912:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.138960:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 304 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.138970:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 304 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.138981:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467099264:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.139038:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.139051:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465880960 00000100:00100000:3.0:1746147259.139053:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465880960 00002000:00100000:3.0:1746147259.139194:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2195455) req@ffff88008e976a00 x1830967465880960/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.139202:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967465880960 ext(2097152->2195455) 00010000:00010000:3.0:1746147259.139208:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 28 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.139216:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 28 pid: 4444 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.139221:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e976a00 00000100:00100000:3.0:1746147259.139244:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2598 00000100:00100000:3.0:1746147259.139250:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967465880960:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147259.141631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.141952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.142010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.142054:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465881344 00000100:00100000:1.0:1746147259.142060:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465881344 00002000:00100000:1.0:1746147259.142091:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a5a0d180 x1830967465881344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.142107:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d180 with x1830967465881344 ext(1048576->2097151) 00002000:00010000:1.0:1746147259.142111:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d180 00000100:00100000:3.0:1746147259.142123:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465881728 00000100:00100000:1.0:1746147259.142124:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465881600 00000100:00100000:1.0:1746147259.142126:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465881600 00000100:00100000:3.0:1746147259.142127:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465881728 00002000:00100000:1.0:1746147259.142136:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2580479) req@ffff88009e681c00 x1830967465881600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.142141:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967465881600 ext(2097152->2580479) 00002000:00010000:1.0:1746147259.142144:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681c00 00010000:00010000:3.0:1746147259.142146:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.142152:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7588 00000100:00100000:1.0:1746147259.142157:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967465881344:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147259.142176:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8127 00000100:00100000:3.0:1746147259.142182:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1957:x1830967465881728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.142192:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.142196:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.142206:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.142220:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.142222:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142228:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142232:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142241:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.142265:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1957:x1830967465881728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.142269:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8127 00010000:00010000:3.0:1746147259.142313:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1c76 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2b8 expref: 304 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.142321:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7589 00000100:00100000:3.0:1746147259.142324:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467099264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.142329:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465881600:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147259.142338:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142342:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142345:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147259.142369:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147259.142372:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147259.142414:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142420:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142425:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142429:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142432:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142435:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0e400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.142437:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142440:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142445:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147259.142447:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.142449:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142451:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142456:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142459:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142461:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142464:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0f400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.142465:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142467:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142470:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f5daf00) 00010000:00010000:3.0:1746147259.142471:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.142472:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142474:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad1ca7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.142492:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad1c99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.142501:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.142504:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.142505:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147259.142506:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f600, rc 0) 00000100:00100000:3.0:1746147259.142523:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32087:x1830967465881088:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3890us (4035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.142528:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11516 00000100:00100000:3.0:1746147259.144612:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465880960:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5357us (6327us total) trans 21474841434 rc 0/0 00000100:00100000:3.0:1746147259.144621:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2598 00002000:00100000:3.0:1746147259.144629:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2195455) req@ffff88008e976a00 x1830967465880960/t21474841434(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.144637:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967465880960 ext(2097152->2195455) 00010000:00010000:3.0:1746147259.144645:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.144670:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.144681:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e976a00 00000100:00100000:0.0:1746147259.149434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.149460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.149481:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465881856 00000100:00100000:0.0:1746147259.149489:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465881856 00000100:00100000:0.0:1746147259.149525:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465881984 00000100:00100000:0.0:1746147259.149526:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465881984 00000100:00100000:0.0:1746147259.149540:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15917 00000100:00100000:0.0:1746147259.149547:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1956:x1830967465881856:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147259.149566:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.149583:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2db expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.149605:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.149607:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.149615:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 6 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.149629:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 6 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.149641:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0a00, rc 0) 00000100:00100000:0.0:1746147259.149682:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465881856:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 135us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.149688:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15917 00000100:00100000:0.0:1746147259.149704:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15918 00000100:00100000:0.0:1746147259.149709:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465881984:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147259.149716:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.149725:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2e2 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.149740:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.149741:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.149745:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 7 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.149753:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 7 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.149760:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0e00, rc 0) 00000100:00100000:0.0:1746147259.149773:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465881984:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 64us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.149778:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15918 00000100:00100000:0.0:1746147259.149858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.149876:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465882112 00000100:00100000:0.0:1746147259.149879:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465882112 00000100:00100000:0.0:1746147259.149892:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15919 00000100:00100000:0.0:1746147259.149897:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465882112:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147259.149903:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.149909:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2e9 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.149919:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.149920:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.149924:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.149954:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.149962:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0200, rc 0) 00000100:00100000:0.0:1746147259.149977:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465882112:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 79us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.149981:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15919 00000100:00100000:0.0:1746147259.150025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.150036:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465882240 00000100:00100000:0.0:1746147259.150038:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465882240 00000100:00100000:0.0:1746147259.150052:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15920 00000100:00100000:0.0:1746147259.150056:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465882240:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147259.150062:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.150068:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2f0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.150078:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.150079:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.150083:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 7 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.150090:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 7 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.150111:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e1a00, rc 0) 00000100:00100000:0.0:1746147259.150127:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465882240:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 70us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.150132:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15920 00000100:00100000:1.0:1746147259.150369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.150408:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465881600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8079us (8469us total) trans 0 rc 483328/483328 00000100:00100000:2.0:1746147259.150417:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7589 00000100:00100000:0.0:1746147259.150423:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465882368 00002000:00100000:2.0:1746147259.150426:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2580479) req@ffff88009e681c00 x1830967465881600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147259.150426:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465882368 00002000:00100000:2.0:1746147259.150434:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967465881600 ext(2097152->2580479) 00002000:00010000:2.0:1746147259.150438:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681c00 00000100:00100000:0.0:1746147259.150440:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15921 00000100:00100000:0.0:1746147259.150444:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465882368:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147259.150449:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.150456:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1cd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2f7 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.150490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.150493:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467099392:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.150506:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465882496 00000100:00100000:1.0:1746147259.150512:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465882496 00000100:00100000:3.0:1746147259.150538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.150541:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15922 00000100:00100000:0.0:1746147259.150546:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.150548:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465882496:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147259.150564:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.150579:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f65e00/0xb4b2209fbdad1cd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed2fe expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.150612:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465882624 00000100:00100000:2.0:1746147259.150616:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465882624 00000100:00100000:1.0:1746147259.150621:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467099520:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.150633:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.150664:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8128 00000100:00100000:1.0:1746147259.150668:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.150669:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465882624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.150677:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.150697:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.150707:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.150786:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.150788:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.150794:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.150801:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.150822:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.150830:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467099648:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.150876:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.153472:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967465881344:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11307us (11838us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.153483:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7588 00002000:00100000:1.0:1746147259.153494:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a5a0d180 x1830967465881344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.153503:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d180 with x1830967465881344 ext(1048576->2097151) 00002000:00010000:1.0:1746147259.153508:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d180 00010000:00010000:1.0:1746147259.154980:0:6881:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88012c9f1880 x1830967467099520) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.154996:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467099648:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.154996:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012db2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467099392:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.155012:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1c14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed279 expref: 30 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.155018:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147259.155031:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1cd1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f7 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147259.155038:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467099520:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.155045:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1600/0xb4b2209fbdad1cd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f7 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.155051:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967465882624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4380us (4511us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147259.155058:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e1600, rc 0) 00010000:00010000:1.0:1746147259.155059:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f65e00/0xb4b2209fbdad1cd8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2fe expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.155060:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8128 00010000:00010000:1.0:1746147259.155068:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f65e00/0xb4b2209fbdad1cd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2fe expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.155083:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65e00, rc 0) 00000100:00100000:2.0:1746147259.155090:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465882368:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4644us (4727us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.155106:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15921 00000100:00100000:1.0:1746147259.155112:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465882496:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4564us (4622us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.155118:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15922 00000100:00100000:0.0:1746147259.155744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.155813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.155875:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465882880 00000100:00100000:1.0:1746147259.155882:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465882880 00002000:00100000:1.0:1746147259.155912:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2600960->2605055) req@ffff88012db2ce00 x1830967465882880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.155921:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ce00 with x1830967465882880 ext(2600960->2605055) 00002000:00010000:1.0:1746147259.155926:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db2ce00 00000100:00100000:1.0:1746147259.155960:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7590 00000100:00100000:1.0:1746147259.155966:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465882880:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147259.155995:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465883008 00000100:00100000:2.0:1746147259.155998:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465883008 00000100:00100000:2.0:1746147259.156021:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15923 00000100:00100000:2.0:1746147259.156026:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32080:x1830967465883008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.156034:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.156046:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed305 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.156067:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.156198:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.156200:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.156204:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.156236:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.156252:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.156262:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467099776:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.156521:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.156559:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465882880:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 592us (815us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147259.156565:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7590 00002000:00100000:1.0:1746147259.156571:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2600960->2605055) req@ffff88012db2ce00 x1830967465882880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.156578:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ce00 with x1830967465882880 ext(2600960->2605055) 00010000:00010000:1.0:1746147259.156583:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.156593:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.156599:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012db2ce00 00000100:00100000:0.0:1746147259.159804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.159959:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465883136 00000100:00100000:0.0:1746147259.159966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.159967:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465883136 00000100:00100000:2.0:1746147259.160001:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467099776:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.160026:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.160028:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15924 00000100:00100000:3.0:1746147259.160036:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:32083:x1830967465883136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.160041:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891800, rc 0) 00010000:00010000:3.0:1746147259.160050:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.160065:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed30c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.160086:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32080:x1830967465883008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4059us (4272us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147259.160091:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.160111:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.160113:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.160117:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 39 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.160141:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.160152:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 21 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.160163:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467099904:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.160327:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15923 00000100:00100000:0.0:1746147259.160650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.160701:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.160718:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465883392 00000100:00100000:3.0:1746147259.160721:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465883392 00000100:00100000:3.0:1746147259.160753:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11517 00000100:00100000:3.0:1746147259.160759:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32087:x1830967465883392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.160769:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.160785:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad1ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed313 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.160880:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.160891:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.160897:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.160914:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.160921:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 8 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.160929:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467100032:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.161109:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465883648 00000100:00100000:1.0:1746147259.161114:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465883648 00002000:00100000:1.0:1746147259.161140:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2691072->2695167) req@ffff88009f733480 x1830967465883648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147259.161214:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.161268:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467099904:192.168.203.36@tcp:104: 00002000:00100000:1.0:1746147259.161291:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733480 with x1830967465883648 ext(2691072->2695167) 00010000:00010000:1.0:1746147259.161298:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.161308:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.161314:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f733480 00010000:00010000:2.0:1746147259.161360:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 39 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.161369:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e600, rc 0) 00000100:00100000:2.0:1746147259.161400:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:32083:x1830967465883136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1365us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.161405:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15924 00000100:00100000:1.0:1746147259.161489:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2599 00000100:00100000:1.0:1746147259.161495:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465883648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.161695:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465883648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 199us (1044us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147259.161701:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2599 00002000:00100000:1.0:1746147259.161706:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2691072->2695167) req@ffff88009f733480 x1830967465883648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.161713:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733480 with x1830967465883648 ext(2691072->2695167) 00010000:00010000:1.0:1746147259.161717:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.161725:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.161731:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f733480 00000100:00100000:0.0:1746147259.162083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.162234:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465883776 00000100:00100000:1.0:1746147259.162238:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465883776 00002000:00100000:1.0:1746147259.162251:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2580480->3145727) req@ffff88009f732680 x1830967465883776/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.162256:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830967465883776 ext(2580480->3145727) 00010000:00010000:1.0:1746147259.162260:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.162266:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 22 pid: 4444 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.162270:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f732680 00000100:00100000:1.0:1746147259.162286:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2600 00000100:00100000:1.0:1746147259.162290:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465883776:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147259.162575:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467100032:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.162590:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147259.163834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.164455:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465883904 00000100:00100000:3.0:1746147259.164462:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465883904 00010000:00010000:3.0:1746147259.164493:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.164527:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8129 00000100:00100000:3.0:1746147259.164535:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465883904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.164548:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.164554:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.164568:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.164589:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1cae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2d4 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.164607:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.164611:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.164623:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.164630:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.164649:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.164717:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465883904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 183us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.164725:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8129 00010000:00010000:3.0:1746147259.164845:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.164852:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147259.164870:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.165024:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad1ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.165036:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.165043:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.165045:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147259.165047:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678200, rc 0) 00000100:00100000:3.0:1746147259.165206:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465883392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4446us (5239us total) trans 8589945533 rc 0/0 00000100:00100000:3.0:1746147259.165213:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11517 00000100:00100000:0.0:1746147259.166419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.166461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.166645:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465884288 00000100:00100000:3.0:1746147259.166653:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465884288 00000100:00100000:3.0:1746147259.166687:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4825 00000100:00100000:3.0:1746147259.166694:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32086:x1830967465884288:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147259.167181:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32086:x1830967465884288:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 485us (716us total) trans 8589945534 rc 0/0 00000100:00100000:3.0:1746147259.167188:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4825 00000100:00100000:3.0:1746147259.167210:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465884416 00000100:00100000:3.0:1746147259.167213:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465884416 00002000:00100000:3.0:1746147259.167237:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2600960->2695167) req@ffff88009f733100 x1830967465884416/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.167247:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967465884416 ext(2600960->2695167) 00010000:00010000:3.0:1746147259.167255:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.167268:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 37 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.167275:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f733100 00000100:00100000:3.0:1746147259.167303:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2601 00000100:00100000:3.0:1746147259.167309:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465884416:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147259.169899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.170148:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465883776:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7854us (8063us total) trans 17179874078 rc 0/0 00000100:00100000:2.0:1746147259.170161:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2600 00002000:00100000:2.0:1746147259.170170:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2580480->3145727) req@ffff88009f732680 x1830967465883776/t17179874078(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.170178:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830967465883776 ext(2580480->3145727) 00000100:00100000:3.0:1746147259.170372:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465884416:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3058us (3953us total) trans 21474841435 rc 0/0 00000100:00100000:3.0:1746147259.170380:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2601 00002000:00100000:3.0:1746147259.170387:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2600960->2695167) req@ffff88009f733100 x1830967465884416/t21474841435(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.170393:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967465884416 ext(2600960->2695167) 00010000:00010000:3.0:1746147259.170401:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.170410:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.170419:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f733100 00000100:00100000:3.0:1746147259.170446:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465884544 00000100:00100000:3.0:1746147259.170450:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465884544 00000100:00100000:3.0:1746147259.170498:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11518 00000100:00100000:3.0:1746147259.170505:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465884544:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.170525:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.170543:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad1d02 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed31a expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.170622:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.170636:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.170643:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.170678:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.170687:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.170697:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467100160:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.170712:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 24 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.170723:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 24 pid: 4444 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.170730:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f732680 00000100:00100000:3.0:1746147259.170765:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.174315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.174381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.174470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.174478:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467100160:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.174531:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:3.0:1746147259.174990:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465884672 00000100:00100000:1.0:1746147259.174990:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465884800 00000100:00100000:2.0:1746147259.174991:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465884928 00000100:00100000:3.0:1746147259.174997:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465884672 00000100:00100000:2.0:1746147259.174997:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465884928 00000100:00100000:1.0:1746147259.174997:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465884800 00010000:00010000:2.0:1746147259.175025:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 24 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.175027:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.175027:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.175050:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8130 00000100:00100000:3.0:1746147259.175056:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8131 00000100:00100000:2.0:1746147259.175057:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465884928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147259.175063:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465884672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.175067:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147259.175071:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8132 00010000:00010000:3.0:1746147259.175073:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147259.175077:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465884800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.175085:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.175087:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 24 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.175101:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.175104:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.175112:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.175113:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.175115:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 24 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.175134:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1c0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed272 expref: 24 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.175134:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1cf4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed313 expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.175135:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1c84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2600960->2695167) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2c6 expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.175150:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.175151:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.175151:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.175153:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.175153:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.175156:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.175159:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.175160:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.175164:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.175166:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.175168:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.175171:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.175184:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.175193:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.175193:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.175203:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467100288:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.175204:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467100416:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.175226:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465884800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 149us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.175232:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8132 00000100:00100000:3.0:1746147259.175257:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.175260:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147259.175276:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.175281:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147259.175311:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:2.0:1746147259.175314:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147259.175326:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.175351:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad1d02 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed31a expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.175362:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed31a expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.175368:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.175370:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147259.175373:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ec600, rc 0) 00000100:00100000:2.0:1746147259.175408:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465884544:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4903us (5516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.175414:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11518 00000100:00100000:0.0:1746147259.180758:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467100288:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147259.180783:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.180785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.180817:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465885184 00000100:00100000:2.0:1746147259.180825:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465885184 00000100:00100000:0.0:1746147259.180859:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465884928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5800us (6387us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147259.180865:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e974000 x1830967465885184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.180874:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974000 with x1830967465885184 ext(2097152->3145727) 00000100:00100000:0.0:1746147259.180874:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8130 00002000:00010000:2.0:1746147259.180879:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974000 00000100:00100000:2.0:1746147259.180902:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7591 00000100:00100000:2.0:1746147259.180908:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465885184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.181146:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467100416:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.181166:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.181202:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967465884672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6139us (6897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.181209:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8131 00000100:00100000:1.0:1746147259.181494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.181527:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465885440 00000100:00100000:0.0:1746147259.181532:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465885440 00000100:00100000:1.0:1746147259.181547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:0.0:1746147259.181560:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f1880 x1830967465885440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.181567:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967465885440 ext(2097152->3145727) 00002000:00010000:0.0:1746147259.181571:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f1880 00000100:00100000:1.0:1746147259.181575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.181585:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7592 00000100:00100000:0.0:1746147259.181590:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465885440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.181857:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465885568 00000100:00100000:3.0:1746147259.181863:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465885568 00000100:00100000:3.0:1746147259.181892:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465885696 00000100:00100000:3.0:1746147259.181894:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465885696 00000100:00100000:3.0:1746147259.181913:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15925 00000100:00100000:3.0:1746147259.181918:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465885568:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.181927:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147259.181933:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15926 00000100:00100000:1.0:1746147259.181956:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465885696:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.181959:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed321 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.181966:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.181974:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.181976:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.181979:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed328 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.181983:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.181993:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.181995:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.181996:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.182002:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.182004:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ea00, rc 0) 00010000:00010000:1.0:1746147259.182014:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.182022:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0c00, rc 0) 00000100:00100000:3.0:1746147259.182033:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465885568:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.182041:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15925 00000100:00100000:1.0:1746147259.182043:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465885696:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 88us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.182048:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15926 00000100:00100000:0.0:1746147259.183339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.183630:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465885952 00000100:00100000:3.0:1746147259.183637:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465885952 00000100:00100000:3.0:1746147259.183672:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11519 00000100:00100000:3.0:1746147259.183679:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465885952:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.183695:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.183709:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1d1e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed32f expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.183798:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.183810:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.183819:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147259.183830:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.183956:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad1d1e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.183990:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.183997:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.184000:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147259.184002:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f600, rc 0) 00000100:00100000:3.0:1746147259.184027:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32087:x1830967465885952:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 349us (692us total) trans 8589945535 rc 0/0 00000100:00100000:3.0:1746147259.184034:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11519 00000100:00100000:0.0:1746147259.187808:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465885440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6202us (6300us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147259.187822:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7592 00002000:00100000:0.0:1746147259.187837:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f1880 x1830967465885440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.187847:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967465885440 ext(2097152->3145727) 00002000:00010000:0.0:1746147259.187853:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f1880 00000100:00100000:0.0:1746147259.190835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.190921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.191104:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886080 00000100:00100000:1.0:1746147259.191116:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886080 00000100:00100000:1.0:1746147259.191162:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886208 00000100:00100000:1.0:1746147259.191164:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886208 00000100:00100000:1.0:1746147259.191182:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15927 00000100:00100000:3.0:1746147259.191189:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15928 00000100:00100000:1.0:1746147259.191189:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465886080:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:3.0:1746147259.191197:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465886208:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147259.191230:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.191230:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.191247:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.191247:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.191255:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.191255:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.191261:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 40 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.191262:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 37 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.191267:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.191269:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.191271:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.191271:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.191272:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.191274:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.191300:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 37 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.191300:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 39 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.191312:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 37 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.191312:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 39 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.191324:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467100544:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.191325:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467100672:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.191341:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465885184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10431us (10560us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.191350:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7591 00002000:00100000:2.0:1746147259.191361:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e974000 x1830967465885184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.191370:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974000 with x1830967465885184 ext(2097152->3145727) 00002000:00010000:2.0:1746147259.191374:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974000 00010000:00010000:1.0:1746147259.191384:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 8 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.191392:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 8 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.191399:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467100800:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.191417:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.191420:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.191425:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 9 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.191427:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 22 pid: 17548 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.191432:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467100928:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.191439:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467101056:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.191451:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147259.191455:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.191462:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 29 pid: 6881 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.191469:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467101184:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.191487:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c9da540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.192367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.192398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.192439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.192476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.192532:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886336 00000100:00100000:3.0:1746147259.192536:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886336 00000100:00100000:3.0:1746147259.192558:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886464 00000100:00100000:3.0:1746147259.192560:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886464 00000100:00100000:3.0:1746147259.192570:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886592 00000100:00100000:3.0:1746147259.192572:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886592 00000100:00100000:3.0:1746147259.192583:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886720 00000100:00100000:3.0:1746147259.192585:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886720 00000100:00100000:3.0:1746147259.192598:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15929 00000100:00100000:3.0:1746147259.192604:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465886336:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147259.192638:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192653:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 29 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192660:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192667:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192673:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.192675:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.192678:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192701:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192710:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.192715:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15930 00000100:00100000:3.0:1746147259.192720:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467101312:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.192732:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465886464:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147259.192775:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192783:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.192791:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192796:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 11 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.192798:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.192803:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467101440:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.192806:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.192811:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.192813:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.192815:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192831:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 29 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192838:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 29 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.192843:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.192846:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467101568:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.192853:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 38 pid: 4445 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.192862:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.192864:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467101696:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.192881:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15931 00000100:00100000:3.0:1746147259.192887:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465886592:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147259.192904:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192914:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192920:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192925:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.192926:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.192928:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 5/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.192967:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.192976:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.192984:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467101824:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.193028:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 38 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.193037:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 38 pid: 4445 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.193039:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15932 00000100:00100000:3.0:1746147259.193045:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467101952:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.193048:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465886720:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:3.0:1746147259.193060:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db8e3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147259.193066:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.193076:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.193084:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.193090:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.193091:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.193104:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.193121:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.193129:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 11 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.193137:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467102080:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.193146:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.193160:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.193168:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.193170:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467102208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.193176:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 29 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.193184:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467102336:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.193215:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.193223:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 22 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.193231:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467102464:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.193630:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.193649:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.195120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.195194:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886848 00000100:00100000:2.0:1746147259.195206:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886848 00000100:00100000:2.0:1746147259.195266:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15933 00000100:00100000:0.0:1746147259.195290:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467100544:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.195298:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32080:x1830967465886848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.195319:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.195337:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed336 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.195355:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467100800:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.195361:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.195365:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.195371:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.195375:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.195385:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467101056:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.195393:0:8480:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.195408:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.195412:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467100672:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.195417:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.195418:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890000, rc 0) 00000100:00100000:3.0:1746147259.195422:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467100928:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.195429:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467101184:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.195451:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.195452:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32080:x1830967465886848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 180us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.195458:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15933 00000100:00100000:0.0:1746147259.196041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.196132:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887360 00000100:00100000:3.0:1746147259.196137:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887360 00010000:00010000:3.0:1746147259.196157:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 38 pid: 17548 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.196175:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8133 00000100:00100000:3.0:1746147259.196180:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967465887360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.196189:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.196209:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 38 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.196218:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 38 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.196235:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093783800/0xb4b2209fbdad1c4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed295 expref: 38 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.196251:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.196285:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465887360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.196291:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8133 00000100:00100000:2.0:1746147259.196675:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467101312:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.197979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.198029:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467101696:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.198107:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467101440:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.198116:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887744 00000100:00100000:2.0:1746147259.198117:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467101568:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.198122:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887744 00010000:00010000:1.0:1746147259.198145:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.198148:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.198186:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8134 00000100:00100000:1.0:1746147259.198192:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465887744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.198205:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.198222:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.198232:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.198232:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467102208:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.198249:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6a00/0xb4b2209fbdad1c53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed29c expref: 37 pid: 6881 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.198264:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.198276:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467102464:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.198290:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967465887744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.198296:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8134 00010000:00010000:0.0:1746147259.198297:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.198459:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467102080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.198467:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467102336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.198480:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.198500:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467101824:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.198507:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467101952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.198526:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.200294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.200591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.200620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.200642:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887104 00000100:00100000:0.0:1746147259.200650:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887104 00000100:00100000:3.0:1746147259.200661:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887488 00000100:00100000:3.0:1746147259.200666:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887488 00010000:00010000:0.0:1746147259.200681:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 12 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.200684:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 24 pid: 17548 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.200833:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887872 00000100:00100000:0.0:1746147259.200836:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887872 00000100:00100000:2.0:1746147259.200843:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8135 00010000:00010000:0.0:1746147259.200847:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 30 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.200851:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8136 00000100:00100000:2.0:1746147259.200852:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465887104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147259.200858:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465887488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147259.200862:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8137 00010000:00010000:2.0:1746147259.200866:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147259.200866:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465887872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.200870:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.200872:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.200886:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 24 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.200886:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 12 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.200886:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 30 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.200896:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 12 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.200896:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 30 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.200897:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 24 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.200916:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093782a00/0xb4b2209fbdad1be3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed248 expref: 24 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.200916:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0e00/0xb4b2209fbdad1cbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e2 expref: 12 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.200916:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad1bf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed256 expref: 30 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.200934:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147259.200934:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.200952:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.200987:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465887104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.200989:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465887872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 122us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.200991:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465887488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 133us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.200993:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8135 00000100:00100000:0.0:1746147259.200995:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8137 00000100:00100000:3.0:1746147259.200998:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8136 00000100:00100000:0.0:1746147259.201026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.201059:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888256 00000100:00100000:3.0:1746147259.201063:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888256 00010000:00010000:3.0:1746147259.201074:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 11 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.201078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.201643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.202066:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888512 00000100:00100000:2.0:1746147259.202069:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465886976 00000100:00100000:3.0:1746147259.202070:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888512 00000100:00100000:2.0:1746147259.202073:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465886976 00000100:00100000:0.0:1746147259.202077:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8138 00000100:00100000:0.0:1746147259.202084:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465888256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.202086:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 12 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.202087:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.202091:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147259.202109:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8139 00000100:00100000:2.0:1746147259.202114:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465886976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.202115:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 12 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.202118:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8140 00010000:00010000:2.0:1746147259.202120:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.202123:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 12 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.202124:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465888512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.202128:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202131:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.202135:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.202135:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1d17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed328 expref: 12 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202142:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 11 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.202146:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800912e0a00/0xb4b2209fbdad1cb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2db expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.202146:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.202150:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 11 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.202155:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.202162:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0200/0xb4b2209fbdad1cc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2e9 expref: 11 pid: 4445 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.202167:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465886976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.202167:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465888256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (1141us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147259.202171:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147259.202172:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8139 00010000:00010000:3.0:1746147259.202173:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147259.202175:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8138 00010000:00010000:3.0:1746147259.202177:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.202228:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887232 00000100:00100000:0.0:1746147259.202235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.202238:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887232 00010000:00010000:3.0:1746147259.202241:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.202247:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888128 00000100:00100000:2.0:1746147259.202250:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888128 00010000:00010000:2.0:1746147259.202260:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 40 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.202268:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.202279:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8141 00000100:00100000:3.0:1746147259.202284:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465888512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 160us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.202284:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465888128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.202289:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 40 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.202290:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8140 00010000:00010000:2.0:1746147259.202291:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.202299:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 40 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.202307:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 40 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.202322:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800912e0000/0xb4b2209fbdad1c8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2cd expref: 40 pid: 4445 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.202331:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8142 00010000:00010000:2.0:1746147259.202331:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.202338:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465887232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147259.202345:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465888128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 61us (109us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147259.202348:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147259.202351:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8141 00010000:00010000:3.0:1746147259.202357:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 38 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202365:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 38 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.202369:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202376:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.202377:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1c45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed28e expref: 38 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202385:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.202386:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.202389:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.202396:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202396:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202403:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202410:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.202411:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147259.202417:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129dcde00 already unused, calling callback (ffffffffa07dcd70) 00000100:00100000:0.0:1746147259.202418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147259.202420:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.202422:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.202428:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202432:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.202442:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202442:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.202448:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202448:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129dcde00/0xb4b2209fbdad1d41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.202452:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465887616 00010000:00010000:3.0:1746147259.202453:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.202456:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465887616 00010000:00010000:3.0:1746147259.202463:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d63ae00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147259.202465:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.202471:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.202473:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 29 pid: 6881 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.202477:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888640 00010000:00010000:3.0:1746147259.202479:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202480:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888640 00010000:00010000:3.0:1746147259.202484:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d63ae00/0xb4b2209fbdad1d33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202491:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 30 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.202493:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888000 00000100:00100000:2.0:1746147259.202494:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465886336:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 9891us (10130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.202495:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888000 00000100:00100000:2.0:1746147259.202501:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15929 00000100:00100000:0.0:1746147259.202502:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888384 00000100:00100000:0.0:1746147259.202503:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888384 00010000:00010000:0.0:1746147259.202510:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.202518:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465886080:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 11330us (11696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.202519:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8143 00000100:00100000:2.0:1746147259.202522:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8144 00000100:00100000:0.0:1746147259.202523:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465887616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147259.202524:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15927 00000100:00100000:2.0:1746147259.202526:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465888640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.202529:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.202531:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.202536:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 30 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.202537:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 30 pid: 6881 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.202544:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 30 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.202544:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 30 pid: 6881 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.202550:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465887232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 213us (340us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147259.202553:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f891800/0xb4b2209fbdad1cdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed305 expref: 30 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.202553:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093854e00/0xb4b2209fbdad1bea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed24f expref: 30 pid: 6881 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.202555:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8142 00010000:00010000:2.0:1746147259.202560:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.202560:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.202560:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.202561:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.202561:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.202564:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202564:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202569:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202570:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202581:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147259.202587:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.202594:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.202594:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465888640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.202597:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465887616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.202599:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8145 00010000:00010000:3.0:1746147259.202601:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.202604:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8144 00000100:00100000:1.0:1746147259.202607:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465888384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147259.202607:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8143 00010000:00010000:3.0:1746147259.202614:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.202615:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8146 00010000:00010000:1.0:1746147259.202618:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.202620:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.202620:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465888000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.202626:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202626:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.202631:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0e400 already unused, calling callback (ffffffffa07dcd70) 00000100:00100000:0.0:1746147259.202632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.202634:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202634:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.202637:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202640:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202640:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888768 00000100:00100000:0.0:1746147259.202642:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888768 00010000:00010000:2.0:1746147259.202643:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.202646:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202648:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202651:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 23 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.202652:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e0ea00/0xb4b2209fbdad1d10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed321 expref: 10 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.202653:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad1d3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202661:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8147 00010000:00010000:2.0:1746147259.202663:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147259.202663:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1a00/0xb4b2209fbdad1cca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2f0 expref: 9 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.202665:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465888768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.202671:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147259.202674:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465888000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (221us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147259.202678:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.202679:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8146 00010000:00010000:0.0:1746147259.202679:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 23 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.202686:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465886208:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 11491us (11765us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147259.202687:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 23 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.202692:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15928 00010000:00010000:2.0:1746147259.202694:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202700:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202701:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1c1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed280 expref: 23 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.202708:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.202710:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.202711:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202712:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.202716:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465888384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (246us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147259.202717:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202718:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202722:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.202725:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8145 00010000:00010000:2.0:1746147259.202726:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f890800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147259.202729:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202729:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147259.202734:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202741:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.202746:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1d56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.202776:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465886720:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 9730us (10299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.202781:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15932 00000100:00100000:0.0:1746147259.202793:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967465888768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.202797:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8147 00010000:00010000:0.0:1746147259.202810:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202816:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202826:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202831:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202840:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202845:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800912e1800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147259.202847:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202851:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202858:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.202863:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800912e1800/0xb4b2209fbdad1d48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.202893:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465886464:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10169us (10494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.202897:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15930 00000100:00100000:1.0:1746147259.203073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.203102:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465888896 00000100:00100000:0.0:1746147259.203105:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465888896 00000100:00100000:0.0:1746147259.203131:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15934 00000100:00100000:0.0:1746147259.203136:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32083:x1830967465888896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.203149:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.203159:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed33d expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.203170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147259.203170:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417ba, atime: 0x681417ba, ctime: 0x681417ba, blocks: 0x1029 00010000:00010000:0.0:1746147259.203181:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.203182:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.203187:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.203197:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.203204:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0400, rc 0) 00000100:00100000:0.0:1746147259.203222:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32083:x1830967465888896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.203227:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15934 00000100:00100000:0.0:1746147259.203242:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465889024 00000100:00100000:0.0:1746147259.203244:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465889024 00010000:00010000:0.0:1746147259.203253:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 37 pid: 4445 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.203280:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8148 00000100:00100000:0.0:1746147259.203284:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465889024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.203290:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.203296:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 37 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.203305:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 37 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.203315:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491e600/0xb4b2209fbdad1ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed30c expref: 37 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.203322:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.203324:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.203326:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.203332:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.203343:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.203361:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967465889024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.203366:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8148 00010000:00010000:3.0:1746147259.203568:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203576:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203590:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203596:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203602:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203607:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e037400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147259.203610:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203615:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203622:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.203623:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.203627:0:8478:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203634:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.203658:0:8478:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.203674:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094400a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467102592:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.203733:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db8ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.208668:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094400a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467102592:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.208703:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.208714:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e037400/0xb4b2209fbdad1d4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.208810:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1959:x1830967465886592:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15921us (16368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.208821:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15931 00000100:00100000:0.0:1746147259.209193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.209407:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465889536 00000100:00100000:2.0:1746147259.209417:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465889536 00000100:00100000:0.0:1746147259.209423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147259.209454:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f31c00 x1830967465889536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.209463:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31c00 with x1830967465889536 ext(3145728->4194303) 00002000:00010000:2.0:1746147259.209468:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f31c00 00000100:00100000:2.0:1746147259.209546:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465889280 00000100:00100000:2.0:1746147259.209548:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465889280 00000100:00100000:1.0:1746147259.209553:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7593 00002000:00100000:2.0:1746147259.209561:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134f31880 x1830967465889280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147259.209561:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465889536:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147259.209568:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31880 with x1830967465889280 ext(2097152->3145727) 00002000:00010000:2.0:1746147259.209571:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f31880 00000100:00100000:2.0:1746147259.209581:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7594 00000100:00100000:2.0:1746147259.209585:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465889280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.211658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.211681:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465889792 00000100:00100000:0.0:1746147259.211688:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465889792 00000100:00100000:0.0:1746147259.211734:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11520 00000100:00100000:0.0:1746147259.211741:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32087:x1830967465889792:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:0.0:1746147259.211779:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.211798:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad1d09 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed31a expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.211817:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.211820:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147259.211842:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147259.211852:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 304 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.211859:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.211865:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147259.211886:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.211897:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.211907:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467102720:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.211999:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 304 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.212006:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 304 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.212013:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467102848:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.212030:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.218818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.218849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.218910:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465889920 00000100:00100000:3.0:1746147259.218918:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465889920 00000100:00100000:1.0:1746147259.218958:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467102720:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.218963:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.218975:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467102848:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.218988:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890048 00000100:00100000:3.0:1746147259.218990:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890048 00010000:00010000:3.0:1746147259.219000:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.219002:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147259.219031:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8149 00000100:00100000:3.0:1746147259.219038:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1956:x1830967465889920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.219049:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.219055:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.219064:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.219081:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1000/0xb4b2209fbdad1b8f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed22c expref: 305 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.219114:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.219119:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.219126:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.219164:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967465889920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.219994:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8150 00000100:00100000:1.0:1746147259.220005:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465890048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.220019:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.220026:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.220037:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.220054:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad1c92 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed2bf expref: 10 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.220060:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8149 00010000:00010000:1.0:1746147259.220074:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.220078:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.220090:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.220108:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.220127:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147259.220135:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.220143:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147259.220163:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465890048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 161us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.220170:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8150 00000100:00100000:1.0:1746147259.220548:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967465889536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10987us (11361us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.220557:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7593 00002000:00100000:1.0:1746147259.220565:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f31c00 x1830967465889536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.220574:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31c00 with x1830967465889536 ext(3145728->4194303) 00002000:00010000:1.0:1746147259.220578:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f31c00 00000040:00080000:2.0:1746147259.220695:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3441, 88 off288304 00000004:00080000:2.0:1746147259.220702:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207764918ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220749:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3435, 88 off287776 00000004:00080000:2.0:1746147259.220754:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207817081ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220767:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3436, 88 off287864 00000004:00080000:2.0:1746147259.220769:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207832353ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220777:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3442, 88 off288392 00000004:00080000:2.0:1746147259.220779:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207842336ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220785:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3443, 88 off288480 00000004:00080000:2.0:1746147259.220788:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207850533ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220794:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3437, 88 off287952 00000004:00080000:2.0:1746147259.220796:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207858638ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220802:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3438, 88 off288040 00000004:00080000:2.0:1746147259.220804:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207866674ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220809:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3439, 88 off288128 00000004:00080000:2.0:1746147259.220811:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207874176ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220817:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3444, 88 off288568 00000004:00080000:2.0:1746147259.220819:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207882061ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220824:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3440, 88 off288216 00000004:00080000:2.0:1746147259.220827:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207889661ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220833:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3445, 88 off288656 00000004:00080000:2.0:1746147259.220835:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207898004ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220842:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3441, 88 off288304 00000004:00080000:2.0:1746147259.220844:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207907038ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147259.220850:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3446, 88 off288744 00000004:00080000:2.0:1746147259.220853:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207915708ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220860:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3447, 88 off288832 00000004:00080000:2.0:1746147259.220862:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207925038ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220868:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3448, 88 off288920 00000004:00080000:2.0:1746147259.220871:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207933816ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220882:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3449, 88 off289008 00000004:00080000:2.0:1746147259.220885:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646207948306ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147259.220893:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3442, 88 off288392 00000004:00080000:2.0:1746147259.220895:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646207958106ns, next at 607576201812ns, rc = 0 00000100:00100000:2.0:1746147259.224651:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465889280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15059us (15222us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.224661:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7594 00002000:00100000:2.0:1746147259.224672:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134f31880 x1830967465889280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.224680:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31880 with x1830967465889280 ext(2097152->3145727) 00002000:00010000:2.0:1746147259.224685:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f31880 00000100:00100000:2.0:1746147259.225749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.225793:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890176 00000100:00100000:0.0:1746147259.225799:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890176 00000100:00100000:0.0:1746147259.225837:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15935 00000100:00100000:0.0:1746147259.225843:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32080:x1830967465890176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.225854:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.225865:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed344 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.225883:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.225884:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.225890:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.225902:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.225910:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0c00, rc 0) 00000100:00100000:0.0:1746147259.225933:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32080:x1830967465890176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 90us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.225957:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15935 00000100:00100000:0.0:1746147259.227761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.227777:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890304 00000100:00100000:0.0:1746147259.227782:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890304 00000100:00100000:0.0:1746147259.227803:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11521 00000100:00100000:0.0:1746147259.227808:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32080:x1830967465890304:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.227819:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.227830:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed34b expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.227866:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147259.227873:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.227886:0:23726:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147259.227894:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.227903:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.227906:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147259.227909:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.227914:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e0600, rc 0) 00000100:00100000:0.0:1746147259.227962:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32080:x1830967465890304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 128us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.227967:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11521 00000100:00100000:0.0:1746147259.229014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.229157:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890432 00000100:00100000:1.0:1746147259.229161:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890432 00000100:00100000:1.0:1746147259.229178:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15936 00000100:00100000:1.0:1746147259.229182:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32083:x1830967465890432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.229189:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.229197:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed352 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.229208:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.229209:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.229214:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.229221:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.229226:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc800, rc 0) 00000100:00100000:1.0:1746147259.229243:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32083:x1830967465890432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.229246:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15936 00000100:00100000:0.0:1746147259.231795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.231814:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890560 00000100:00100000:0.0:1746147259.231819:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890560 00000100:00100000:0.0:1746147259.231841:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11522 00000100:00100000:0.0:1746147259.231846:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32083:x1830967465890560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.231860:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.231871:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed359 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.231907:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.231916:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.231924:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.231926:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147259.231929:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.231934:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e1e00, rc 0) 00000100:00100000:0.0:1746147259.231974:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32083:x1830967465890560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 127us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.231978:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11522 00000001:00080000:1.0:1746147259.240006:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945527 is committed 00000001:00080000:1.0:1746147259.240018:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945536 is committed 00000004:00080000:1.0:1746147259.240022:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2568 committed 00000004:00080000:1.0:1746147259.240028:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2571 committed 00000004:00080000:1.0:1746147259.240032:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2570 committed 00000004:00080000:1.0:1746147259.240034:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2569 committed 00000004:00080000:1.0:1746147259.240035:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2568 committed 00000004:00080000:1.0:1746147259.240036:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2567 committed 00000004:00080000:1.0:1746147259.240038:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2567 committed 00000004:00080000:1.0:1746147259.240039:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2566 committed 00000004:00080000:1.0:1746147259.240041:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2566 committed 00000004:00080000:1.0:1746147259.240042:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2565 committed 00000004:00080000:1.0:1746147259.240043:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2564 committed 00000004:00080000:1.0:1746147259.240045:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2563 committed 00000004:00080000:1.0:1746147259.240046:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2565 committed 00000004:00080000:1.0:1746147259.240047:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2564 committed 00000004:00080000:1.0:1746147259.240048:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2562 committed 00000004:00080000:1.0:1746147259.240050:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2561 committed 00000004:00080000:1.0:1746147259.240051:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2563 committed 00000001:00080000:1.0:1746147259.240056:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945534 is committed 00000001:00080000:1.0:1746147259.240063:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945531 is committed 00000004:00010000:2.0:1746147259.240125:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880134f31500 reply state ffff88012e954800 transno 8589945536 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147259.240136:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746147259.240209:0:14125:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147259.240221:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465889792:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 28478us (28564us total) trans 8589945536 rc 0/0 00000100:00100000:2.0:1746147259.240228:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11520 00010000:00010000:2.0:1746147259.240252:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.240257:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.240264:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.240268:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800912e1200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.240271:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.240276:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.240285:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.240288:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147259.240291:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 6 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.240299:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 6 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.240305:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 6 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.240311:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 300 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.240316:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 300 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.240321:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 300 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.240347:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 300 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.240357:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830967467102976:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.240397:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 6 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.240403:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830967467103104:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.240415:0:3280:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.240639:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467103488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.240670:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.240689:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467103488 00000100:00100000:0.0:1746147259.240690:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147259.240695:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467103488 00000100:00100000:0.0:1746147259.240703:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.240712:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.240716:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104000 00000100:00100000:1.0:1746147259.240718:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104000 00000100:00100000:0.0:1746147259.240724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.240728:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104512 00000100:00100000:1.0:1746147259.240730:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104512 00000100:00100000:0.0:1746147259.240733:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467105024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.240741:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15937 00000100:00100000:1.0:1746147259.240746:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967467103488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.240747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.240757:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746147259.240761:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467103360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.240772:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.240781:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467103872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.240792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.240801:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.240814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.240824:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.240836:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.240849:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467105024 00000100:00100000:0.0:1746147259.240852:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467105024 00000100:00100000:0.0:1746147259.240862:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467103360 00000100:00100000:0.0:1746147259.240864:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467103360 00000100:00100000:0.0:1746147259.240869:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467103872 00000100:00100000:0.0:1746147259.240871:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467103872 00000100:00100000:0.0:1746147259.240876:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104384 00000100:00100000:0.0:1746147259.240877:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104384 00000100:00100000:0.0:1746147259.240882:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104896 00000100:00100000:0.0:1746147259.240883:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104896 00000100:00100000:0.0:1746147259.240890:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15938 00000100:00100000:0.0:1746147259.240893:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967467104000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.241024:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467103232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.241031:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967467104000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (326us total) trans 21474841436 rc 0/0 00000100:00100000:0.0:1746147259.241036:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15938 00000100:00100000:2.0:1746147259.241047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.241048:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15939 00000100:00100000:0.0:1746147259.241052:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967467104512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.241057:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467103744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.241069:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.241076:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.241088:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.241108:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.241120:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.241129:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746147259.241132:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467103616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.241140:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.241144:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104128:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147259.241149:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00000100:00100000:2.0:1746147259.241151:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147259.241152:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00000100:00100000:2.0:1746147259.241154:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104640:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147259.241154:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:0.0:1746147259.241155:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147258 -> 1746147258 00002000:00010000:0.0:1746147259.241157:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00002000:00010000:1.0:1746147259.241158:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147259.241160:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00000100:00100000:2.0:1746147259.241162:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147259.241162:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.241163:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.241165:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746147259.241167:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467105152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.241175:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3294:x1830967467104512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (449us total) trans 17179874079 rc 0/0 00000100:00100000:2.0:1746147259.241177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.241181:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967467103488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 436us (511us total) trans 21474841437 rc 0/0 00000100:00100000:0.0:1746147259.241181:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15939 00000100:00100000:1.0:1746147259.241185:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15937 00000100:00100000:0.0:1746147259.241189:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467103232 00000100:00100000:2.0:1746147259.241191:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467103744 00000100:00100000:1.0:1746147259.241191:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104256 00000100:00100000:0.0:1746147259.241191:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467103232 00000100:00100000:2.0:1746147259.241193:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467103744 00000100:00100000:1.0:1746147259.241193:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104256 00000100:00100000:1.0:1746147259.241198:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104768 00000100:00100000:0.0:1746147259.241199:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467103616 00000100:00100000:1.0:1746147259.241200:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104768 00000100:00100000:0.0:1746147259.241200:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467103616 00000100:00100000:2.0:1746147259.241202:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104128 00000100:00100000:2.0:1746147259.241203:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104128 00000100:00100000:1.0:1746147259.241205:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467104640 00000100:00100000:0.0:1746147259.241206:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467105152 00000100:00100000:1.0:1746147259.241207:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467104640 00000100:00100000:0.0:1746147259.241207:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467105152 00000100:00100000:2.0:1746147259.241209:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15940 00000100:00100000:2.0:1746147259.241212:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3294:x1830967467105024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.241214:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15941 00000100:00100000:0.0:1746147259.241217:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967467103360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.241299:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3294:x1830967467105024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (549us total) trans 17179874080 rc 0/0 00000100:00100000:1.0:1746147259.241569:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15942 00000100:00100000:1.0:1746147259.241575:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967467103872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.241613:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15940 00000100:00100000:2.0:1746147259.241623:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15943 00000100:00100000:2.0:1746147259.241627:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3294:x1830967467104384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147259.241638:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:1.0:1746147259.241640:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147259.241642:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147259.241643:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147259.241646:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:1.0:1746147259.241665:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967467103872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (871us total) trans 21474841438 rc 0/0 00000100:00100000:1.0:1746147259.241669:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15942 00000100:00100000:1.0:1746147259.241680:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15944 00000100:00100000:1.0:1746147259.241684:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3294:x1830967467104896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.241691:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3294:x1830967467104384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (876us total) trans 17179874081 rc 0/0 00000100:00100000:2.0:1746147259.241694:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15943 00000100:00100000:2.0:1746147259.241701:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15945 00000100:00100000:2.0:1746147259.241704:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830967467103232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147259.241757:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3294:x1830967467104896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (918us total) trans 17179874082 rc 0/0 00000100:00100000:1.0:1746147259.241761:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15944 00000100:00100000:1.0:1746147259.241771:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15946 00000100:00100000:1.0:1746147259.241774:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967467104256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.242072:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3294:x1830967467103360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 853us (1297us total) trans 21474841440 rc 0/0 00000100:00100000:0.0:1746147259.242077:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15941 00000100:00100000:0.0:1746147259.242086:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15947 00000100:00100000:0.0:1746147259.242090:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3296:x1830967467103744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.242218:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967467103232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 511us (1169us total) trans 21474841439 rc 0/0 00000100:00100000:2.0:1746147259.242222:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15945 00000100:00100000:2.0:1746147259.242232:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15948 00000100:00100000:2.0:1746147259.242236:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467104768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.242549:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967467104256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 773us (1459us total) trans 17179874083 rc 0/0 00000100:00100000:1.0:1746147259.242554:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15946 00000100:00100000:2.0:1746147259.242560:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467104768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 324us (1438us total) trans 17179874084 rc 0/0 00000100:00100000:0.0:1746147259.242560:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3296:x1830967467103744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 470us (1489us total) trans 21474841441 rc 0/0 00000100:00100000:0.0:1746147259.242564:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15947 00000004:00080000:3.0:1746147259.242565:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f30a80/2, rc 0, transno 21474841439 00000100:00100000:2.0:1746147259.242567:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15948 00000100:00100000:3.0:1746147259.242570:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467103232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147259.242570:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15949 00000100:00100000:0.0:1746147259.242573:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15950 00000100:00100000:1.0:1746147259.242575:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3296:x1830967467103616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.242576:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3296:x1830967467104128:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.242577:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f32680/2, rc 0, transno 21474841441 00000100:00100000:2.0:1746147259.242577:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15951 00000100:00100000:3.0:1746147259.242580:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467103744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147259.242581:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967467104640:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.242586:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509c00/2, rc 0, transno 17179874083 00000100:00100000:3.0:1746147259.242593:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.242599:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e681180/2, rc 0, transno 17179874084 00000100:00100000:3.0:1746147259.242602:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.242608:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15952 00000100:00100000:0.0:1746147259.242613:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967467105152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.242632:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147259.242638:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467105280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.242652:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967467104640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1488us total) trans 17179874085 rc 0/0 00000100:00100000:2.0:1746147259.242657:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15951 00000100:00100000:3.0:1746147259.242658:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.242664:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3296:x1830967467103616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1521us total) trans 21474841442 rc 0/0 00000100:00100000:2.0:1746147259.242665:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467105280 00000100:00100000:2.0:1746147259.242668:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467105280 00000100:00100000:1.0:1746147259.242668:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15949 00000004:00080000:3.0:1746147259.242678:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f30700/2, rc 0, transno 21474841442 00000100:00100000:1.0:1746147259.242679:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15953 00000100:00100000:3.0:1746147259.242681:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467103616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147259.242683:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467105280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.242684:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967467105152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1506us total) trans 17179874086 rc 0/0 00000004:00080000:3.0:1746147259.242687:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e682a00/2, rc 0, transno 17179874085 00000100:00100000:0.0:1746147259.242688:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15952 00000100:00100000:3.0:1746147259.242690:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.242695:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3480/2, rc 0, transno 17179874086 00000100:00100000:3.0:1746147259.242698:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467105152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147259.242712:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f30e00/2, rc 0, transno 21474841440 00000100:00100000:0.0:1746147259.242716:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467103360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147259.242724:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f32300/2, rc 0, transno 21474841438 00000100:00100000:0.0:1746147259.242726:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467103872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147259.242732:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e680e00/2, rc 0, transno 17179874081 00000100:00100000:0.0:1746147259.242735:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147259.242740:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f1c00/2, rc 0, transno 17179874082 00000100:00100000:0.0:1746147259.242742:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147259.242748:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f33b80/2, rc 0, transno 21474841437 00000100:00100000:1.0:1746147259.242749:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467105280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (90us total) trans 17179874087 rc 0/0 00000100:00100000:0.0:1746147259.242751:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467103488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147259.242754:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15953 00000004:00080000:0.0:1746147259.242757:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050ad80/2, rc 0, transno 21474841436 00000004:00080000:3.0:1746147259.242758:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094400a80/2, rc 0, transno 17179874087 00000100:00100000:0.0:1746147259.242759:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.242761:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467105280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147259.242765:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e681880/2, rc 0, transno 17179874079 00000100:00100000:0.0:1746147259.242768:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467104512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147259.242773:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f0000/2, rc 0, transno 17179874080 00000100:00100000:0.0:1746147259.242775:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467105024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.242831:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3296:x1830967467104128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 253us (1677us total) trans 21474841443 rc 0/0 00000004:00080000:3.0:1746147259.242833:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050aa00/2, rc 0, transno 21474841443 00000100:00100000:3.0:1746147259.242835:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467104128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147259.242836:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15950 00000100:00100000:0.0:1746147259.244326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.244403:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890688 00000100:00100000:2.0:1746147259.244409:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890688 00000100:00100000:2.0:1746147259.244433:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11523 00000100:00100000:2.0:1746147259.244439:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465890688:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.244463:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.244477:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed360 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.244515:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.244525:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.244537:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.244540:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147259.244542:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0400, rc 0) 00000100:00100000:2.0:1746147259.244581:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465890688:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 143us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.244589:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11523 00000100:00100000:1.0:1746147259.245575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.245590:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830967467102976:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.245599:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830967467103104:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.245614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147259.245615:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.245621:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1200/0xb4b2209fbdad1d6b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147259.245644:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890816 00000100:00100000:0.0:1746147259.245648:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890816 00000100:00100000:0.0:1746147259.245667:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465890944 00000100:00100000:0.0:1746147259.245669:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465890944 00000100:00100000:0.0:1746147259.245681:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4826 00000100:00100000:0.0:1746147259.245686:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32080:x1830967465890816:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147259.245740:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32080:x1830967465890816:12345-192.168.203.36@tcp:49:cat.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.245744:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4827 00000100:00100000:0.0:1746147259.245747:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4826 00000100:00100000:3.0:1746147259.245751:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32083:x1830967465890944:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:3.0:1746147259.245791:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32083:x1830967465890944:12345-192.168.203.36@tcp:49:cat.0 Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.245797:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4827 00000100:00100000:0.0:1746147259.247782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.247863:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891072 00000100:00100000:2.0:1746147259.247868:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891072 00000100:00100000:2.0:1746147259.247895:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11524 00000100:00100000:2.0:1746147259.247900:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465891072:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.247911:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.247925:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdad1d95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed367 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.248125:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1d9c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.248137:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.248146:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147259.248170:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:2.0:1746147259.248173:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147259.248183:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.248200:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdad1d95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed367 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.248211:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1d9c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed367 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.248217:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.248220:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147259.248223:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ec00, rc 0) 00000100:00100000:2.0:1746147259.248258:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465891072:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 356us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.248263:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11524 00000100:00100000:0.0:1746147259.250041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.250071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.250087:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891200 00000100:00100000:0.0:1746147259.250087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.250091:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891200 00000100:00100000:0.0:1746147259.250124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.250134:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891328 00000100:00100000:2.0:1746147259.250136:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891328 00000100:00100000:2.0:1746147259.250143:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891584 00000100:00100000:2.0:1746147259.250144:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891584 00000100:00100000:2.0:1746147259.250153:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15954 00000100:00100000:2.0:1746147259.250157:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1956:x1830967465891200:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:0.0:1746147259.250158:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15955 00010000:00010000:2.0:1746147259.250165:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147259.250165:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465891328:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147259.250173:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.250175:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed36e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.250182:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed375 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147259.250189:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417b8, atime: 0x681417b8, ctime: 0x681417b8, blocks: 0x81f 00002000:00010000:0.0:1746147259.250196:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417b9, atime: 0x681417b9, ctime: 0x681417b9, blocks: 0x81f 00010000:00010000:2.0:1746147259.250197:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.250198:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.250204:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 6 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.250204:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.250206:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.250210:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.250211:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 6 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.250216:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0c00, rc 0) 00010000:00010000:0.0:1746147259.250220:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.250228:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56fa00, rc 0) 00000100:00100000:2.0:1746147259.250237:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1956:x1830967465891200:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.250240:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15954 00000100:00100000:0.0:1746147259.250243:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465891328:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 79us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.250248:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15955 00000100:00100000:2.0:1746147259.250257:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15956 00000100:00100000:2.0:1746147259.250260:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465891584:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.250264:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.250268:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed37c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147259.250274:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417ba, atime: 0x681417ba, ctime: 0x681417ba, blocks: 0x821 00010000:00010000:2.0:1746147259.250280:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.250281:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.250283:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.250288:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.250292:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e600, rc 0) 00000100:00100000:2.0:1746147259.250301:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465891584:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 41us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.250305:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15956 00000100:00100000:2.0:1746147259.250315:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891712 00000100:00100000:2.0:1746147259.250316:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891712 00002000:00100000:2.0:1746147259.250328:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b6bbb80 x1830967465891712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.250333:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967465891712 ext(3145728->4194303) 00002000:00010000:2.0:1746147259.250336:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00000100:00100000:2.0:1746147259.250342:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7595 00000100:00100000:2.0:1746147259.250345:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465891712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.250643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.250668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.250678:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891840 00000100:00100000:1.0:1746147259.250682:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891840 00000100:00100000:0.0:1746147259.250685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.250705:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465891968 00000100:00100000:1.0:1746147259.250710:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465891968 00000100:00100000:1.0:1746147259.250720:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465892096 00000100:00100000:1.0:1746147259.250722:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465892096 00000100:00100000:1.0:1746147259.250732:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15957 00000100:00100000:1.0:1746147259.250737:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465891840:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147259.250742:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.250750:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed383 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147259.250761:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417ba, atime: 0x681417b7, ctime: 0x681417ba, blocks: 0x821 00010000:00010000:1.0:1746147259.250769:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.250770:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.250774:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.250783:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.250790:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dce00, rc 0) 00000100:00100000:1.0:1746147259.250808:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465891840:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.250813:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15957 00000100:00100000:1.0:1746147259.250824:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15958 00000100:00100000:1.0:1746147259.250828:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465891968:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147259.250834:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.250839:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed38a expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.250848:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.250850:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.250853:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.250862:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.250868:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc400, rc 0) 00000100:00100000:1.0:1746147259.250881:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465891968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 53us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.250885:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15958 00000100:00100000:1.0:1746147259.250893:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15959 00000100:00100000:1.0:1746147259.250898:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465892096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147259.250902:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.250908:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed391 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.250915:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.250916:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.250920:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.250926:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.250933:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd400, rc 0) 00000100:00100000:1.0:1746147259.250967:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465892096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.250972:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15959 00000100:00100000:0.0:1746147259.259155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.259953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.260696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.261426:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465892864 00000100:00100000:3.0:1746147259.261435:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465892864 00000100:00100000:3.0:1746147259.261479:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465892480 00000100:00100000:3.0:1746147259.261481:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465892480 00002000:00100000:3.0:1746147259.261495:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fe680 x1830967465892480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.261505:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe680 with x1830967465892480 ext(3145728->4194303) 00002000:00010000:3.0:1746147259.261509:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fe680 00000100:00100000:3.0:1746147259.261521:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7596 00000100:00100000:3.0:1746147259.261528:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465892864:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147259.261565:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.261577:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.261578:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.261583:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.261593:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.261888:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465892608 00000100:00100000:2.0:1746147259.261893:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465892608 00002000:00100000:2.0:1746147259.261910:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9fed80 x1830967465892608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.261918:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fed80 with x1830967465892608 ext(3145728->4194303) 00002000:00010000:2.0:1746147259.261921:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fed80 00000100:00100000:2.0:1746147259.261946:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7597 00000100:00100000:2.0:1746147259.261951:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465892480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.262621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.262643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.262658:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465893120 00000100:00100000:1.0:1746147259.262662:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465893120 00000100:00100000:0.0:1746147259.262671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.262685:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465893376 00000100:00100000:1.0:1746147259.262687:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465893376 00000100:00100000:0.0:1746147259.262696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.262697:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465893632 00000100:00100000:1.0:1746147259.262699:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465893632 00000100:00100000:1.0:1746147259.262707:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465893888 00000100:00100000:1.0:1746147259.262709:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465893888 00000100:00100000:0.0:1746147259.262715:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7598 00000100:00100000:0.0:1746147259.262728:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465892608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.262731:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7599 00000100:00100000:1.0:1746147259.262737:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465893120:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:3.0:1746147259.262741:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7600 00000100:00100000:3.0:1746147259.262748:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465893376:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147259.262753:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.262762:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.262762:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.262763:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.262766:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.262769:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.262770:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.262773:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.262774:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.262780:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.263027:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7601 00000100:00100000:1.0:1746147259.263033:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465893632:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147259.263047:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.263054:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.263055:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.263057:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.263064:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.263712:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7602 00000100:00100000:0.0:1746147259.263718:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465893888:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147259.263732:0:21472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.263744:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.263746:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.263749:0:21472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.263757:0:21472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.264209:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465891712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13861us (14082us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.264219:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7595 00002000:00100000:3.0:1746147259.264225:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b6bbb80 x1830967465891712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.264233:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967465891712 ext(3145728->4194303) 00002000:00010000:3.0:1746147259.264237:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00000100:00100000:1.0:1746147259.265591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.265625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.265658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.265804:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465894144 00000100:00100000:1.0:1746147259.265804:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465894400 00000100:00100000:3.0:1746147259.265809:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465894144 00000100:00100000:1.0:1746147259.265809:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465894400 00000100:00100000:3.0:1746147259.265841:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465894656 00000100:00100000:3.0:1746147259.265843:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465894656 00000100:00100000:1.0:1746147259.265846:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7603 00000100:00100000:1.0:1746147259.265852:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465894144:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:3.0:1746147259.265856:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7604 00000100:00100000:3.0:1746147259.265861:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1958:x1830967465894400:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147259.265873:0:26114:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.265875:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.265883:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.265883:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.265884:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.265885:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.265888:0:26114:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.265889:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.265898:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.265898:0:26114:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.266880:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7605 00000100:00100000:1.0:1746147259.266887:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1958:x1830967465894656:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147259.266904:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.266912:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.266913:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.266917:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.266924:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.269523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.269557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.269568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.269598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.269637:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465894912 00000100:00100000:1.0:1746147259.269644:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465894912 00000100:00100000:1.0:1746147259.269679:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465895168 00000100:00100000:1.0:1746147259.269681:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465895168 00000100:00100000:0.0:1746147259.269686:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465894784 00000100:00100000:0.0:1746147259.269690:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465894784 00000100:00100000:1.0:1746147259.269693:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465895040 00000100:00100000:1.0:1746147259.269694:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465895040 00000100:00100000:0.0:1746147259.269709:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15960 00000100:00100000:0.0:1746147259.269720:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465894912:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147259.269728:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15961 00000100:00100000:1.0:1746147259.269733:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967465895168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.269733:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.269741:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.269746:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed39f expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.269750:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3ad expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.269763:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.269763:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.269764:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.269764:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.269770:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.269770:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.269781:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.269782:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.269789:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c52200, rc 0) 00010000:00010000:0.0:1746147259.269793:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56ec00, rc 0) 00000100:00100000:1.0:1746147259.269813:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465895168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.269816:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465894912:12345-192.168.203.36@tcp:101:cat.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.269818:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15961 00000100:00100000:0.0:1746147259.269822:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15960 00000100:00100000:0.0:1746147259.269833:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15962 00000100:00100000:1.0:1746147259.269837:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15963 00000100:00100000:0.0:1746147259.269838:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967465894784:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147259.269841:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465895040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.269843:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.269846:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.269850:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed398 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.269852:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3a6 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.269858:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.269860:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.269860:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.269861:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.269863:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 24 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.269865:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.269872:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.269872:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 24 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.269878:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56e600, rc 0) 00010000:00010000:1.0:1746147259.269879:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c52400, rc 0) 00000100:00100000:0.0:1746147259.269890:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465894784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.269892:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465895040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 51us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.269894:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15962 00000100:00100000:1.0:1746147259.269900:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15963 00010000:00010000:3.0:1746147259.273908:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.273918:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.273927:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.273931:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f891200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147259.273933:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.273965:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.273979:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.273984:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad1dcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.274066:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465892864:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 12533us (14913us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.274075:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7596 00000100:00100000:2.0:1746147259.277387:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465892608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14659us (16684us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.277397:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7598 00002000:00100000:2.0:1746147259.277406:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9fed80 x1830967465892608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.277415:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fed80 with x1830967465892608 ext(3145728->4194303) 00002000:00010000:2.0:1746147259.277421:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fed80 00000100:00100000:0.0:1746147259.280245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.280389:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465895424 00000100:00100000:3.0:1746147259.280397:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465895424 00002000:00100000:3.0:1746147259.280430:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012df7a680 x1830967465895424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.280439:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7a680 with x1830967465895424 ext(4194304->4976639) 00002000:00010000:3.0:1746147259.280443:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7a680 00000100:00100000:3.0:1746147259.280465:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7606 00000100:00100000:3.0:1746147259.280471:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465895424:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147259.282505:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.282519:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.282527:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.282532:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f890e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147259.282536:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.282543:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.282559:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.282566:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890e00/0xb4b2209fbdad1ddb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.282897:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1958:x1830967465893376:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 20145us (20247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.282905:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7600 00010000:00010000:1.0:1746147259.287467:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.287479:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.287486:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.287491:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147259.287494:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.287500:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.287515:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.287520:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094683a00/0xb4b2209fbdad1de2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.287592:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967465893632:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 24555us (24915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.287600:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7601 00000100:00100000:3.0:1746147259.289422:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465892480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27465us (29481us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.289433:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7597 00002000:00100000:3.0:1746147259.289442:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fe680 x1830967465892480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.289450:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe680 with x1830967465892480 ext(3145728->4194303) 00002000:00010000:3.0:1746147259.289455:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fe680 00010000:00010000:0.0:1746147259.291628:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.291650:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.291657:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.291664:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147259.291668:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.291676:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.291694:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.291700:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094683800/0xb4b2209fbdad1dd4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.292409:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1958:x1830967465893120:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 29667us (29784us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147259.292420:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7599 00000100:00100000:0.0:1746147259.296494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147259.296776:0:26114:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.296786:0:26114:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.296793:0:26114:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.296799:0:26114:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094683000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147259.296803:0:26114:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.296810:0:26114:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.296825:0:26114:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.296831:0:26114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094683000/0xb4b2209fbdad1df0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.296902:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465894144:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 31047us (31312us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.296910:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7603 00000100:00100000:2.0:1746147259.296993:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465895680 00000100:00100000:2.0:1746147259.296999:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465895680 00000100:00100000:2.0:1746147259.297033:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11525 00000100:00100000:2.0:1746147259.297038:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32090:x1830967465895680:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.297052:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.297063:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783e00/0xb4b2209fbdad1e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3b4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.297151:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297161:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297169:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297178:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297183:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297188:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297270:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297278:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.297288:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.297310:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.297319:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 8 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.297329:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467105408:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.297380:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.297688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.297712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.297723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.297749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.297764:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465895936 00000100:00100000:1.0:1746147259.297768:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465895936 00000100:00100000:1.0:1746147259.297793:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465896192 00000100:00100000:1.0:1746147259.297795:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465896192 00000100:00100000:1.0:1746147259.297805:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465895808 00000100:00100000:1.0:1746147259.297807:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465895808 00000100:00100000:3.0:1746147259.297808:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465896064 00000100:00100000:3.0:1746147259.297810:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465896064 00000100:00100000:1.0:1746147259.297818:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15964 00000100:00100000:1.0:1746147259.297823:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465895936:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147259.297828:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15965 00010000:00010000:1.0:1746147259.297831:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147259.297832:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465896192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.297837:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.297839:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3c2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.297844:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3d0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.297851:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.297851:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.297852:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.297853:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.297858:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.297858:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.297868:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.297868:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.297876:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891a00, rc 0) 00010000:00010000:1.0:1746147259.297876:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7ca00, rc 0) 00000100:00100000:1.0:1746147259.297894:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465895936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.297899:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15964 00000100:00100000:0.0:1746147259.297909:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15966 00000100:00100000:1.0:1746147259.297912:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15967 00000100:00100000:0.0:1746147259.297914:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465895808:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147259.297916:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465896064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.297919:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.297920:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.297925:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3c9 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.297926:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3bb expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.297934:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.297934:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.297935:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.297954:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.297958:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.297967:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.297975:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7c800, rc 0) 00000100:00100000:3.0:1746147259.298036:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465896192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 202us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.298042:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15965 00010000:00010000:0.0:1746147259.298142:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 39 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.298152:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 39 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147259.298159:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3ddc00, rc 0) 00000100:00100000:0.0:1746147259.298173:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465895808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 259us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.298177:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15966 00000100:00100000:1.0:1746147259.298406:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465896064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 488us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.298412:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15967 00010000:00010000:1.0:1746147259.299403:0:21472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.299526:0:21472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.299536:0:21472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.299541:0:21472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f56e000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147259.299544:0:21472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.299550:0:21472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.299561:0:21472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.299570:0:21472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1de9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.299620:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465893888:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 35901us (36921us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.299627:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7602 00000100:00100000:3.0:1746147259.300741:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467105408:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.300760:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147259.301619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.302809:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465896320 00000100:00100000:1.0:1746147259.302816:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465896320 00010000:00010000:1.0:1746147259.302844:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.302874:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8151 00000100:00100000:1.0:1746147259.302879:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465896320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.302890:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.302894:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.302903:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.302918:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f600/0xb4b2209fbdad1d25 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed32f expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.302929:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.302934:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.302960:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.302965:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.302980:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.302998:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.303007:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.303009:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465896320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 129us (1392us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147259.303013:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.303014:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8151 00010000:00010000:3.0:1746147259.303019:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f890200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147259.303022:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.303029:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.303040:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.303045:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f890200/0xb4b2209fbdad1df7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.303079:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465894400:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 37217us (37453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.303085:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7604 00010000:00010000:3.0:1746147259.303113:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303119:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147259.303130:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.303245:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303251:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303256:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303260:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093782e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.303263:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303267:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303274:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.303276:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147259.303278:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303282:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782e00/0xb4b2209fbdad1e36 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303294:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303297:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303301:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303305:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093783c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.303306:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303310:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303315:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147259.303317:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.303319:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303323:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783c00/0xb4b2209fbdad1e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303330:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303334:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303339:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303343:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093782a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.303346:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303350:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303358:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76500) 00010000:00010000:3.0:1746147259.303360:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.303362:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303365:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782a00/0xb4b2209fbdad1e2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.303399:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093783e00/0xb4b2209fbdad1e21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3b4 expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.303406:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093783e00/0xb4b2209fbdad1e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3b4 expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.303412:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093783e00, rc 0) 00000100:00100000:3.0:1746147259.303445:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32090:x1830967465895680:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6406us (6957us total) trans 8589945537 rc 301/301 00000100:00100000:3.0:1746147259.303451:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11525 00010000:00010000:1.0:1746147259.306230:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.306242:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.306248:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.306252:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c0200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147259.306255:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.306261:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.306272:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.306281:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad1dfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.306335:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465894656:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 39445us (40673us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.306343:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7605 00000100:00100000:0.0:1746147259.307146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.307367:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465896576 00000100:00100000:1.0:1746147259.307374:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465896576 00002000:00100000:1.0:1746147259.307403:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012df78e00 x1830967465896576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.307411:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78e00 with x1830967465896576 ext(4194304->4976639) 00002000:00010000:1.0:1746147259.307414:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df78e00 00000100:00100000:1.0:1746147259.307440:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7607 00000100:00100000:1.0:1746147259.307445:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465896576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.311877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.311955:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465896832 00000100:00100000:3.0:1746147259.311963:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465896832 00000100:00100000:3.0:1746147259.312012:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11526 00000100:00100000:3.0:1746147259.312019:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32092:x1830967465896832:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.312034:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.312048:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3d7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.312141:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312155:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312163:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312174:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312179:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312184:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147259.312229:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465895424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 31757us (31990us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147259.312237:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7606 00002000:00100000:2.0:1746147259.312244:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012df7a680 x1830967465895424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.312252:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7a680 with x1830967465895424 ext(4194304->4976639) 00002000:00010000:2.0:1746147259.312255:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7a680 00010000:00010000:3.0:1746147259.312262:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312269:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312273:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147259.312279:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147259.312333:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312338:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312343:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312350:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf1a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.312353:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312358:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312365:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.312367:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147259.312370:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312374:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad1e75 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312383:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312387:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312391:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312394:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f891e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.312396:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312399:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312403:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147259.312405:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.312407:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312411:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891e00/0xb4b2209fbdad1e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312415:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312419:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312422:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312426:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f891600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.312427:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.312431:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147259.312432:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465896576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 4986us (5291us total) trans 0 rc 782336/782336 00010000:00010000:3.0:1746147259.312435:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473200) 00010000:00010000:3.0:1746147259.312436:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.312438:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147259.312438:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7607 00010000:00010000:3.0:1746147259.312441:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891600/0xb4b2209fbdad1e6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00002000:00100000:1.0:1746147259.312443:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012df78e00 x1830967465896576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.312450:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78e00 with x1830967465896576 ext(4194304->4976639) 00002000:00010000:1.0:1746147259.312453:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df78e00 00010000:00010000:3.0:1746147259.312463:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1e60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d7 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.312469:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890800/0xb4b2209fbdad1e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d7 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.312475:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890800, rc 0) 00000100:00100000:3.0:1746147259.313799:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32092:x1830967465896832:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1776us (1925us total) trans 8589945538 rc 301/301 00000100:00100000:3.0:1746147259.313805:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11526 00000100:00100000:0.0:1746147259.313840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.313870:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465897088 00000100:00100000:3.0:1746147259.313874:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465897088 00000100:00100000:3.0:1746147259.313902:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11527 00000100:00100000:3.0:1746147259.313908:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465897088:12345-192.168.203.36@tcp:36:lfs.0 00000100:00100000:0.0:1746147259.313925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.313932:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147259.313934:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465897344 00000100:00100000:0.0:1746147259.313957:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465897344 00010000:00010000:3.0:1746147259.313967:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491ec00/0xb4b2209fbdad1d9c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed367 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.313975:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11528 00010000:00010000:3.0:1746147259.313977:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00000100:00100000:0.0:1746147259.313980:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32090:x1830967465897344:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.313981:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147259.313989:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.313991:0:23726:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147259.314000:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad1d87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed359 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.314011:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.314014:0:23726:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147259.314019:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1e83 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3de expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.314047:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.314055:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.314061:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.314066:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.314084:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.314105:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 7 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.314114:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467105536:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.314977:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147259.315024:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.315037:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 7 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.315046:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467105664:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.315111:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082000 going to sleep for 11 seconds 00010000:00010000:3.0:1746147259.315723:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.315731:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.315742:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.315751:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147259.316365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.316428:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465897472 00000100:00100000:2.0:1746147259.316433:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465897472 00000100:00100000:2.0:1746147259.316465:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11529 00000100:00100000:2.0:1746147259.316470:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32083:x1830967465897472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.316481:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.316490:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3e5 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.316633:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.316641:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.316650:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.316652:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147259.316654:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.316659:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782c00, rc 0) 00000100:00100000:2.0:1746147259.317074:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32083:x1830967465897472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 602us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.317082:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11529 00000100:00100000:0.0:1746147259.317260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.317325:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465897728 00000100:00100000:2.0:1746147259.317328:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465897728 00000100:00100000:2.0:1746147259.317354:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4828 00000100:00100000:2.0:1746147259.317359:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32080:x1830967465897728:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147259.317807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.317822:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465897856 00000100:00100000:0.0:1746147259.317825:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465897856 00010000:00010000:0.0:1746147259.317840:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 8 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.317854:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8152 00000100:00100000:0.0:1746147259.317859:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465897856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.317865:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.317869:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 8 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.317877:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 8 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.317891:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.317894:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.317899:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.317903:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.317921:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465897856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.317927:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8152 00000100:00100000:0.0:1746147259.318055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.318064:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465897984 00000100:00100000:0.0:1746147259.318067:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465897984 00010000:00010000:0.0:1746147259.318077:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.318110:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8153 00000100:00100000:0.0:1746147259.318115:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465897984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.318121:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.318124:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.318132:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.318142:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.318145:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.318151:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.318156:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.318161:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147259.318167:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.318177:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.318191:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465897984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.318197:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8153 00000100:00100000:0.0:1746147259.318227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.318264:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465898112 00000100:00100000:3.0:1746147259.318267:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465898112 00000100:00100000:3.0:1746147259.318285:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11530 00000100:00100000:3.0:1746147259.318290:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32092:x1830967465898112:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.318297:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.318305:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3ec expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.318326:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.318334:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.318340:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.318342:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147259.318344:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.318349:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85ade00, rc 0) 00000100:00100000:3.0:1746147259.318366:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32092:x1830967465898112:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.318371:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11530 00000100:00100000:2.0:1746147259.318432:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32080:x1830967465897728:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1071us (1170us total) trans 8589945539 rc 0/0 00000100:00100000:2.0:1746147259.318438:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4828 00010000:00010000:1.0:1746147259.318538:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad1d8e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed360 expref: 7 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.318552:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467105536:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.318559:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800912e0600/0xb4b2209fbdad1d79 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed34b expref: 9 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.318567:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467105664:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.318578:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.318585:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.318589:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00000040:00080000:1.0:1746147259.319120:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3450, 88 off289096 00000004:00080000:1.0:1746147259.319125:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306187522ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319217:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3443, 88 off288480 00000004:00080000:1.0:1746147259.319221:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306283589ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319237:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3444, 88 off288568 00000004:00080000:1.0:1746147259.319240:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306302574ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319249:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3451, 88 off289184 00000004:00080000:1.0:1746147259.319251:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306313682ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319258:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3452, 88 off289272 00000004:00080000:1.0:1746147259.319260:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306323314ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319268:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3445, 88 off288656 00000004:00080000:1.0:1746147259.319270:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306332769ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319278:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3446, 88 off288744 00000004:00080000:1.0:1746147259.319280:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306343191ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319286:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3447, 88 off288832 00000004:00080000:1.0:1746147259.319288:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306351074ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319296:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3453, 88 off289360 00000004:00080000:1.0:1746147259.319298:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306360957ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319319:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3448, 88 off288920 00000004:00080000:1.0:1746147259.319322:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306384445ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319330:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3454, 88 off289448 00000004:00080000:1.0:1746147259.319332:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306394602ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319337:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3449, 88 off289008 00000004:00080000:1.0:1746147259.319339:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306402236ns, next at 607576201812ns, rc = 0 00000040:00080000:1.0:1746147259.319345:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3455, 88 off289536 00000004:00080000:1.0:1746147259.319348:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306410364ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319353:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3456, 88 off289624 00000004:00080000:1.0:1746147259.319355:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306418102ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319360:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3457, 88 off289712 00000004:00080000:1.0:1746147259.319362:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306425171ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319368:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3458, 88 off289800 00000004:00080000:1.0:1746147259.319370:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 646306433047ns, next at 592568729900ns, rc = 0 00000040:00080000:1.0:1746147259.319376:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3450, 88 off289096 00000004:00080000:1.0:1746147259.319379:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 646306441695ns, next at 607576201812ns, rc = 0 00000001:00080000:0.0:1746147259.344019:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945540 is committed 00000004:00080000:0.0:1746147259.344027:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746147259.344033:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2580 committed 00000004:00080000:0.0:1746147259.344048:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2579 committed 00000004:00080000:0.0:1746147259.344050:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2578 committed 00000004:00080000:0.0:1746147259.344051:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2577 committed 00000004:00080000:0.0:1746147259.344052:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2575 committed 00000004:00080000:0.0:1746147259.344055:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746147259.344056:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2574 committed 00000004:00080000:0.0:1746147259.344058:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2575 committed 00000004:00080000:0.0:1746147259.344059:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2573 committed 00000004:00080000:0.0:1746147259.344060:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2572 committed 00000004:00080000:0.0:1746147259.344061:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2571 committed 00000004:00080000:0.0:1746147259.344063:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2574 committed 00000004:00080000:0.0:1746147259.344064:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2573 committed 00000004:00080000:0.0:1746147259.344065:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2570 committed 00000004:00080000:0.0:1746147259.344067:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2569 committed 00000004:00080000:0.0:1746147259.344068:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2572 committed 00000001:00080000:0.0:1746147259.344101:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945539 is committed 00000100:00100000:0.0:1746147259.344137:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147259.344152:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467105792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.344211:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467106304:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147259.344211:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 303 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.344221:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.344224:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147259.344227:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.344234:0:23726:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.344238:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.344243:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.344249:0:23726:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.344254:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.344259:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 6 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.344265:0:23726:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 6 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.344270:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 6 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.344274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147259.344290:0:23726:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 6 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.344298:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467106816:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.344306:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147259.344311:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467105920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.344324:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147259.344345:0:23726:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.344347:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467106432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.344352:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467106944:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.344365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.344371:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.344380:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106048:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147259.344389:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147259.344393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147259.344395:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147259.344402:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.344412:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.344421:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147259.344424:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.344438:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.344448:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.344460:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.344491:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467106304 00000100:00100000:3.0:1746147259.344496:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467106304 00000100:00100000:3.0:1746147259.344524:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467105920 00000100:00100000:3.0:1746147259.344526:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467105920 00000100:00100000:3.0:1746147259.344535:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467106432 00000100:00100000:3.0:1746147259.344536:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467106432 00000100:00100000:3.0:1746147259.344545:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467106048 00000100:00100000:3.0:1746147259.344547:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467106048 00000100:00100000:3.0:1746147259.344555:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467106560 00000100:00100000:3.0:1746147259.344557:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467106560 00000100:00100000:3.0:1746147259.344563:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467106176 00000100:00100000:3.0:1746147259.344565:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467106176 00000100:00100000:3.0:1746147259.344571:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467106688 00000100:00100000:3.0:1746147259.344572:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467106688 00000100:00100000:3.0:1746147259.344580:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15968 00000100:00100000:3.0:1746147259.344586:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3293:x1830967467106304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.345128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147259.345242:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467105792 00000100:00100000:0.0:1746147259.345249:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467105792 00000100:00100000:0.0:1746147259.345263:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15969 00000100:00100000:0.0:1746147259.345267:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3293:x1830967467105920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.345374:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3293:x1830967467106304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 787us (1099us total) trans 17179874088 rc 0/0 00000100:00100000:3.0:1746147259.345381:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15968 00000100:00100000:3.0:1746147259.345396:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15970 00000100:00100000:3.0:1746147259.345402:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3293:x1830967467106432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.345410:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15971 00000100:00100000:1.0:1746147259.345416:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830967467106048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.345474:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967467106432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1107us total) trans 17179874089 rc 0/0 00000100:00100000:3.0:1746147259.345479:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15970 00002000:00010000:1.0:1746147259.345482:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:1.0:1746147259.345485:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.345487:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00000100:00100000:3.0:1746147259.345488:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15972 00002000:00010000:1.0:1746147259.345489:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.345491:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:3.0:1746147259.345492:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467106560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.345509:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467106048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1115us total) trans 17179874090 rc 0/0 00000100:00100000:1.0:1746147259.345514:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15971 00000100:00100000:1.0:1746147259.345522:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15973 00000100:00100000:1.0:1746147259.345526:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830967467106176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.345568:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467106560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1154us total) trans 17179874091 rc 0/0 00000100:00100000:3.0:1746147259.345572:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15972 00000100:00100000:3.0:1746147259.345581:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15974 00000100:00100000:3.0:1746147259.345586:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467106688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.345589:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467106176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1150us total) trans 17179874092 rc 0/0 00000100:00100000:1.0:1746147259.345593:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15973 00000100:00100000:1.0:1746147259.345600:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15975 00000100:00100000:3.0:1746147259.345662:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467106688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1200us total) trans 17179874093 rc 0/0 00000100:00100000:3.0:1746147259.345666:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15974 00000100:00100000:3.0:1746147259.345688:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.345706:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.345718:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.345729:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147259.345748:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2a00/2, rc 0, transno 17179874092 00000100:00100000:1.0:1746147259.345754:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467105792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.345755:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.345762:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1f80/2, rc 0, transno 17179874093 00000100:00100000:3.0:1746147259.345765:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.345771:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1500/2, rc 0, transno 17179874090 00000100:00100000:3.0:1746147259.345774:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.345779:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c3800/2, rc 0, transno 17179874091 00000100:00100000:3.0:1746147259.345782:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467106560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147259.345788:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147259.345791:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.345806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.345817:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107968:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147259.345820:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147259.345822:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147256 -> 1746147256 00002000:00010000:1.0:1746147259.345824:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147256 -> 1746147256 00002000:00010000:1.0:1746147259.345826:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147256 -> 1746147256 00000100:00100000:3.0:1746147259.345828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147259.345828:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147259.345843:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107328 00000100:00100000:1.0:1746147259.345843:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830967467105792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (716us total) trans 17179874094 rc 0/0 00000100:00100000:3.0:1746147259.345845:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107328 00000100:00100000:1.0:1746147259.345850:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15975 00000100:00100000:3.0:1746147259.345856:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107840 00000100:00100000:3.0:1746147259.345858:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107840 00000100:00100000:1.0:1746147259.345858:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107456 00000100:00100000:1.0:1746147259.345859:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107456 00000100:00100000:3.0:1746147259.345862:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107968 00000100:00100000:3.0:1746147259.345864:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107968 00000100:00100000:1.0:1746147259.345867:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15976 00000100:00100000:1.0:1746147259.345870:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467107328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.345871:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15977 00000100:00100000:3.0:1746147259.345875:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467107840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.345896:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15978 00000100:00100000:3.0:1746147259.345900:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467107456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147259.345969:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147259.345971:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.345973:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.345975:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147258 -> 1746147258 00002000:00010000:1.0:1746147259.345976:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147259.345989:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467107456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (182us total) trans 21474841445 rc 0/0 00000100:00100000:1.0:1746147259.345989:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467107328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (283us total) trans 21474841444 rc 0/0 00000100:00100000:1.0:1746147259.345994:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15976 00000100:00100000:3.0:1746147259.345996:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15978 00000100:00100000:1.0:1746147259.346002:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15979 00000100:00100000:1.0:1746147259.346006:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467107968:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746147259.346064:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012df79f80 reply state ffff88009aa08000 transno 8589945541 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147259.346069:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467107840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (338us total) trans 21474841446 rc 0/0 00000100:00100000:2.0:1746147259.346071:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147259.346073:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467107968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (243us total) trans 21474841447 rc 0/0 00000100:00100000:3.0:1746147259.346074:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15977 00000100:00100000:1.0:1746147259.346076:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15979 00000100:00100000:3.0:1746147259.346117:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.346132:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.346142:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.346151:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.346158:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467108096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.346164:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107072 00000100:00100000:1.0:1746147259.346167:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107072 00000100:00100000:3.0:1746147259.346170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.346177:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107584 00000100:00100000:1.0:1746147259.346179:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107584 00000004:00080000:3.0:1746147259.346184:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2300/2, rc 0, transno 17179874089 00000100:00100000:1.0:1746147259.346186:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467108096 00000100:00100000:3.0:1746147259.346187:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467106432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.346187:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467108096 00000004:00080000:3.0:1746147259.346194:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1880/2, rc 0, transno 17179874088 00000100:00100000:1.0:1746147259.346194:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15980 00000100:00100000:3.0:1746147259.346196:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467106304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147259.346198:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3293:x1830967467107072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.346201:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147259.346205:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.346218:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.346226:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.346236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.346260:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107200 00000100:00100000:3.0:1746147259.346263:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107200 00002000:00010000:1.0:1746147259.346263:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147259.346265:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147257 -> 1746147257 00002000:00010000:1.0:1746147259.346267:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147257 -> 1746147257 00002000:00010000:1.0:1746147259.346268:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147257 -> 1746147257 00002000:00010000:1.0:1746147259.346270:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147259.346271:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15981 00002000:00010000:0.0:1746147259.346274:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746147259.346275:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967467107584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147259.346277:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00002000:00010000:0.0:1746147259.346279:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147255 -> 1746147255 00002000:00010000:0.0:1746147259.346281:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147258 -> 1746147258 00002000:00010000:0.0:1746147259.346283:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147259.346289:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967467107072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (156us total) trans 21474841448 rc 0/0 00000100:00100000:1.0:1746147259.346293:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15980 00000100:00100000:1.0:1746147259.346301:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467107712 00000100:00100000:1.0:1746147259.346303:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467107712 00000100:00100000:1.0:1746147259.346311:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15982 00000100:00100000:0.0:1746147259.346311:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967467105920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1042us (1985us total) trans 17179874095 rc 0/0 00000100:00100000:2.0:1746147259.346312:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465897088:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 32402us (32471us total) trans 8589945541 rc 0/0 00000100:00100000:1.0:1746147259.346314:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967467108096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147259.346317:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15969 00000100:00100000:2.0:1746147259.346318:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11527 00000100:00100000:2.0:1746147259.346338:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15983 00000100:00100000:2.0:1746147259.346344:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967467107200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147259.346350:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967467107584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (197us total) trans 21474841449 rc 0/0 00000100:00100000:3.0:1746147259.346355:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15981 00000100:00100000:3.0:1746147259.346365:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15984 00000100:00100000:3.0:1746147259.346370:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967467107712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147259.346377:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967467108096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (206us total) trans 17179874096 rc 0/0 00000100:00100000:1.0:1746147259.346381:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15982 00002000:00010000:2.0:1746147259.346419:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147259.346422:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00002000:00010000:2.0:1746147259.346424:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:2.0:1746147259.346425:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147258 -> 1746147258 00002000:00010000:2.0:1746147259.346427:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147259.346445:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967467107200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (226us total) trans 21474841450 rc 0/0 00000100:00100000:2.0:1746147259.346450:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15983 00000004:00080000:0.0:1746147259.346485:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094402d80/2, rc 0, transno 17179874094 00000100:00100000:0.0:1746147259.346489:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467105792:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147259.346529:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:3.0:1746147259.346532:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147259.346533:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147259.346535:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147259.346536:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:3.0:1746147259.346553:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3293:x1830967467107712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (316us total) trans 21474841451 rc 0/0 00000100:00100000:3.0:1746147259.346558:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15984 00000004:00080000:3.0:1746147259.346576:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f730a80/2, rc 0, transno 21474841445 00000100:00100000:3.0:1746147259.346579:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346584:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 21474841447 00000100:00100000:3.0:1746147259.346586:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346590:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f731f80/2, rc 0, transno 21474841444 00000100:00100000:3.0:1746147259.346593:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346598:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044000/2, rc 0, transno 21474841446 00000100:00100000:3.0:1746147259.346600:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467107840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346610:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f733b80/2, rc 0, transno 21474841450 00000100:00100000:3.0:1746147259.346612:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107200:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346616:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047800/2, rc 0, transno 21474841451 00000100:00100000:3.0:1746147259.346618:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346623:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4fae680/2, rc 0, transno 21474841448 00000100:00100000:3.0:1746147259.346625:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346630:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046680/2, rc 0, transno 21474841449 00000100:00100000:3.0:1746147259.346632:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467107584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147259.346636:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bfe3480/2, rc 0, transno 17179874096 00000100:00100000:3.0:1746147259.346637:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467108096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147259.346640:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c0a80/2, rc 0, transno 17179874095 00000100:00100000:3.0:1746147259.346642:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467105920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147259.348107:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467106816:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.348744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.348760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.348785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.348822:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.348830:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.348834:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.348839:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf1e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147259.348842:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.348850:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.348863:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.348865:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147259.348868:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147259.348873:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad1e91 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147259.348932:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465898368 00000100:00100000:2.0:1746147259.348951:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465898368 00000100:00100000:3.0:1746147259.348969:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465898496 00000100:00100000:3.0:1746147259.348972:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465898496 00000100:00100000:2.0:1746147259.349051:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4829 00000100:00100000:2.0:1746147259.349058:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32083:x1830967465898368:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:3.0:1746147259.349120:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4830 00000100:00100000:3.0:1746147259.349126:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32092:x1830967465898496:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:2.0:1746147259.349201:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32083:x1830967465898368:12345-192.168.203.36@tcp:49:cat.0 Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.349208:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4829 00000100:00100000:2.0:1746147259.349235:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467106944:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.349255:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32092:x1830967465898496:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 128us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.349261:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4830 00010000:00010000:2.0:1746147259.349265:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1e83 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 303 pid: 23726 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147259.349279:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 302 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.349397:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd600, rc 0) 00000100:00100000:2.0:1746147259.349417:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32090:x1830967465897344:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 35437us (35492us total) trans 8589945540 rc 0/0 00000100:00100000:2.0:1746147259.349423:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11528 00000100:00100000:2.0:1746147259.349442:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465898240 00000100:00100000:2.0:1746147259.349445:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465898240 00000100:00100000:2.0:1746147259.349470:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11531 00000100:00100000:2.0:1746147259.349475:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32087:x1830967465898240:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.349484:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.349494:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7c200/0xb4b2209fbdad1ea6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3f3 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.349525:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7c200/0xb4b2209fbdad1ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3f3 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.349533:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7c200/0xb4b2209fbdad1ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3f3 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.349542:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.349544:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147259.349545:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7c200, rc 0) 00000100:00100000:2.0:1746147259.349560:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465898240:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 85us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.349564:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11531 00000100:00100000:0.0:1746147259.358999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.359031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.359124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.359309:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465898880 00000100:00100000:2.0:1746147259.359316:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465898880 00000100:00100000:1.0:1746147259.359326:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465898752 00000100:00100000:1.0:1746147259.359330:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465898752 00000100:00100000:2.0:1746147259.359345:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899008 00000100:00100000:2.0:1746147259.359346:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899008 00000100:00100000:3.0:1746147259.359353:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15985 00002000:00100000:1.0:1746147259.359358:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff88012df79880 x1830967465898752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147259.359363:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:32090:x1830967465898880:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147259.359364:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15986 00002000:00100000:1.0:1746147259.359367:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79880 with x1830967465898752 ext(4972544->4976639) 00000100:00100000:2.0:1746147259.359368:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465899008:12345-192.168.203.36@tcp:101:lfs.0 00002000:00010000:1.0:1746147259.359371:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79880 00010000:00010000:2.0:1746147259.359375:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.359376:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.359387:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed3fa expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.359387:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed401 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.359405:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.359406:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.359412:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 39 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.359413:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 40 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.359420:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 29 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.359422:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.359425:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.359426:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.359427:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.359428:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.359429:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1482752->1724415] (req 1482752->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 40 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.359430:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 6/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 9 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.359449:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 29 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.359449:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.359458:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 23 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.359462:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 29 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.359466:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467108352:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.359470:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467108224:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.360017:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 40 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.360019:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 39 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.360025:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 40 pid: 8478 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.360027:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 39 pid: 17548 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.360032:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467108480:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.360035:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467108608:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.360054:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.360060:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.360061:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 8 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.360067:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467108736:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.360072:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 9 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.360079:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.360079:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467108864:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.360101:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.360512:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7608 00000100:00100000:0.0:1746147259.360746:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465898752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.360874:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465898752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 131us (1883us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147259.360880:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7608 00002000:00100000:0.0:1746147259.360885:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff88012df79880 x1830967465898752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.360892:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79880 with x1830967465898752 ext(4972544->4976639) 00002000:00010000:0.0:1746147259.360895:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79880 00000100:00100000:0.0:1746147259.360969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.361405:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899136 00000100:00100000:3.0:1746147259.361410:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899136 00000100:00100000:3.0:1746147259.361528:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15987 00000100:00100000:3.0:1746147259.361535:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32092:x1830967465899136:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.361546:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.361556:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed408 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.361574:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.361582:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.361588:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.361593:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.361594:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.361597:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [4186112->4194303] (req 4186112->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.361618:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.361626:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.361635:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467108992:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.362291:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.362305:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 9 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.362313:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467109120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.362360:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.362367:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 25 pid: 8480 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.362375:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467109248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.362391:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.367778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.367840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.367860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.367882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.367904:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899264 00000100:00100000:2.0:1746147259.367910:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899264 00000100:00100000:0.0:1746147259.367918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.367934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147259.367958:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 26 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.367971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.367977:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899392 00000100:00100000:2.0:1746147259.367979:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899392 00000100:00100000:1.0:1746147259.367980:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899520 00000100:00100000:0.0:1746147259.367980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.367984:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899520 00010000:00010000:2.0:1746147259.367990:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 30 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.367998:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899648 00010000:00010000:1.0:1746147259.367999:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 39 pid: 17548 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.368000:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899648 00010000:00010000:2.0:1746147259.368008:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 9 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.368011:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899904 00000100:00100000:0.0:1746147259.368011:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465899776 00000100:00100000:1.0:1746147259.368013:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899904 00000100:00100000:0.0:1746147259.368013:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465899776 00000100:00100000:2.0:1746147259.368016:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465900032 00000100:00100000:2.0:1746147259.368017:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465900032 00010000:00010000:1.0:1746147259.368022:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 11 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.368023:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 11 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.368025:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 41 pid: 8478 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.368031:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465900160 00000100:00100000:1.0:1746147259.368032:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465900160 00010000:00010000:1.0:1746147259.368040:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 40 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.368080:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8154 00000100:00100000:2.0:1746147259.368086:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8155 00000100:00100000:0.0:1746147259.368087:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465899264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147259.368105:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8156 00000100:00100000:2.0:1746147259.368105:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465899392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.368107:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147259.368109:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8157 00000100:00100000:3.0:1746147259.368111:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465899520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.368112:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147259.368114:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465899648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.368118:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.368119:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.368125:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 40 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.368125:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 30 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.368125:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 26 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.368127:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 9 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.368134:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 30 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.368135:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 26 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.368141:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 9 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.368142:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 40 pid: 17548 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.368160:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.368161:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147259.368161:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147259.368161:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.368190:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465899648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.368190:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465899264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.368191:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465899520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.368191:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1958:x1830967465899392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.368196:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8154 00000100:00100000:1.0:1746147259.368198:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8157 00000100:00100000:2.0:1746147259.368201:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8155 00000100:00100000:3.0:1746147259.368203:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8156 00000100:00100000:0.0:1746147259.368209:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8158 00000100:00100000:1.0:1746147259.368211:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8159 00000100:00100000:0.0:1746147259.368213:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465899904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147259.368215:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465899776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.368218:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.368219:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.368225:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 11 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.368225:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 11 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.368232:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 11 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.368233:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 11 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.368241:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.368241:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147259.368243:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.368248:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.368252:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465899904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (334us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147259.368255:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.368280:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.368289:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467109376:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.368323:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0406c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.368381:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8160 00000100:00100000:2.0:1746147259.368386:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8161 00000100:00100000:3.0:1746147259.368388:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967465900032:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147259.368391:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465900160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.368394:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.368395:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.368402:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 41 pid: 8478 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.368402:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 39 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.368409:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 39 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.368410:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 41 pid: 8478 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.368419:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.368419:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.368420:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.368423:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 41 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.368429:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 41 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.368431:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465900160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.368436:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8161 00010000:00010000:3.0:1746147259.368445:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 41 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.368453:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467109504:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.368465:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e600/0xb4b2209fbdad1e13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed398 expref: 25 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.368470:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.368482:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467108352:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.368486:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed352 expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.368490:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3ddc00/0xb4b2209fbdad1e52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3bb expref: 38 pid: 17548 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.368497:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467108608:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.368501:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467108992:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.368504:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdad1da3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed36e expref: 11 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.368508:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1dbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed38a expref: 11 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.368510:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467108864:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.368514:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467109120:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.368520:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467109248:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.368532:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4186112->4194303] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.368532:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 9 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.368540:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65e00, rc 0) 00010000:00010000:2.0:1746147259.368540:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7d000, rc 0) 00000100:00100000:3.0:1746147259.368551:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32092:x1830967465899136:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7018us (7583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.368552:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465899008:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9184us (9428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.368557:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15987 00000100:00100000:2.0:1746147259.368559:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15986 00010000:00010000:3.0:1746147259.368581:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129c52400/0xb4b2209fbdad1e1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3a6 expref: 29 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.368589:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467108224:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.368595:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad1e4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c9 expref: 41 pid: 8478 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.368601:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467108480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.368607:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491e600/0xb4b2209fbdad1db1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed37c expref: 8 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.368614:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467108736:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.368628:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 40 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.368634:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1514c00, rc 0) 00000100:00100000:3.0:1746147259.368644:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:32090:x1830967465898880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9284us (9612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.368649:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15985 00000100:00100000:0.0:1746147259.369999:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8158 00000100:00100000:0.0:1746147259.370113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.370184:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465900288 00000100:00100000:0.0:1746147259.370187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.370191:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465900288 00010000:00010000:2.0:1746147259.370212:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 24 pid: 8480 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.370233:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8162 00000100:00100000:2.0:1746147259.370238:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967465900288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.370255:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.370271:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 24 pid: 8480 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.370281:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 24 pid: 8480 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.370296:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f890000/0xb4b2209fbdad1d5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed336 expref: 24 pid: 8480 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.370313:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.370315:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.370320:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.370327:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.370347:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.370356:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467109632:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.370375:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465900544 00000100:00100000:3.0:1746147259.370379:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465900544 00000100:00100000:3.0:1746147259.370402:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4831 00000100:00100000:2.0:1746147259.370402:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.370407:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32083:x1830967465900544:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147259.370621:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32083:x1830967465900544:12345-192.168.203.36@tcp:35:cat.0 Request processed in 213us (433us total) trans 8589945542 rc 0/0 00000100:00100000:3.0:1746147259.370627:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4831 00000100:00100000:0.0:1746147259.373439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.373498:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467109376:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147259.373524:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.373576:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465899776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5358us (5639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.373585:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8159 00000100:00100000:2.0:1746147259.373672:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467109504:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.373692:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.373706:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465900032:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5319us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.373712:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8160 00000100:00100000:3.0:1746147259.374796:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465900672 00000100:00100000:3.0:1746147259.374803:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465900672 00000100:00100000:2.0:1746147259.375312:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467109632:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.375325:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.375342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.375352:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967465900288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5114us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.375359:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8162 00000100:00100000:0.0:1746147259.375388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.375407:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15988 00000100:00100000:2.0:1746147259.375413:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465900672:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.375427:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.375440:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed40f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.375460:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.375467:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.375474:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 28 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.375480:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.375481:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.375484:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.375507:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 28 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.375518:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 28 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.375527:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467109760:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.375558:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465900928 00000100:00100000:0.0:1746147259.375564:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465900928 00010000:00010000:2.0:1746147259.375579:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.375587:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 38 pid: 8478 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.375595:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467109888:192.168.203.36@tcp:104: 00002000:00100000:0.0:1746147259.375600:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4186112->4190207) req@ffff880094400000 x1830967465900928/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.375608:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400000 with x1830967465900928 ext(4186112->4190207) 00002000:00010000:0.0:1746147259.375613:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094400000 00010000:00010000:2.0:1746147259.375615:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.375622:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.375629:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467110016:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.375635:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901184 00000100:00100000:0.0:1746147259.375637:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901184 00000100:00100000:2.0:1746147259.375642:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00002000:00100000:0.0:1746147259.375651:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1482752->1486847) req@ffff88009b6baa00 x1830967465901184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.375657:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6baa00 with x1830967465901184 ext(1482752->1486847) 00002000:00010000:0.0:1746147259.375661:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6baa00 00000100:00100000:0.0:1746147259.375671:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7609 00000100:00100000:0.0:1746147259.375677:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465900928:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147259.375769:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7610 00000100:00100000:3.0:1746147259.375777:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967465901184:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147259.375847:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465900928:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 168us (508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147259.375853:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7609 00002000:00100000:0.0:1746147259.375858:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4186112->4190207) req@ffff880094400000 x1830967465900928/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.375865:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400000 with x1830967465900928 ext(4186112->4190207) 00002000:00010000:0.0:1746147259.375867:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094400000 00000100:00100000:3.0:1746147259.375885:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967465901184:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 108us (495us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147259.375890:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7610 00002000:00100000:3.0:1746147259.375896:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1482752->1486847) req@ffff88009b6baa00 x1830967465901184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.375904:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6baa00 with x1830967465901184 ext(1482752->1486847) 00002000:00010000:3.0:1746147259.375908:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6baa00 00000100:00100000:0.0:1746147259.377315:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.377362:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901312 00000100:00100000:3.0:1746147259.377370:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901312 00000100:00100000:3.0:1746147259.377405:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15989 00000100:00100000:3.0:1746147259.377409:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32092:x1830967465901312:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.377419:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.377429:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed416 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.377446:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.377451:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.377455:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.377458:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.377459:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.377460:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3166207] (req 3145728->3166207) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.377478:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.377487:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 30 pid: 8478 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.377493:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.377555:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.377560:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.377564:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110272:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.377577:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.377581:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.377586:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110400:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.377593:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.378157:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467109760:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.378166:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467109888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.378173:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467110016:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.378193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.378200:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.378207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.378209:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dde00, rc 0) 00000100:00100000:0.0:1746147259.378230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.378251:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465900672:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2837us (4821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.378257:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15988 00000100:00100000:2.0:1746147259.378465:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901568 00000100:00100000:2.0:1746147259.378469:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901568 00010000:00010000:2.0:1746147259.378487:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 39 pid: 8478 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.378931:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901440 00000100:00100000:2.0:1746147259.378934:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901440 00010000:00010000:2.0:1746147259.378966:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 31 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.379049:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901696 00000100:00100000:1.0:1746147259.379052:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901696 00010000:00010000:1.0:1746147259.379066:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.379080:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8163 00000100:00100000:1.0:1746147259.379085:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465901568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.379102:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.379120:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 39 pid: 8478 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.379128:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 39 pid: 8478 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.379143:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad1e3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3c2 expref: 39 pid: 8478 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.379152:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.379237:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8164 00000100:00100000:2.0:1746147259.379243:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465901440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.379249:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.379257:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 31 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.379264:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 31 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.379274:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad1e05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed39f expref: 31 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.379282:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.379319:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8165 00000100:00100000:3.0:1746147259.379325:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465901696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.379332:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.379339:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.379345:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.379355:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1daa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed375 expref: 9 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.379361:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.379362:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.379367:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.379374:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.379396:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.379404:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467110528:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.379676:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465901568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 588us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.379682:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8163 00000100:00100000:2.0:1746147259.379729:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465901440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 485us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.379734:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8164 00000100:00100000:3.0:1746147259.379971:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.379996:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.380004:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110272:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.380010:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.380031:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3166207] (req 3145728->3166207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.380039:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678200, rc 0) 00000100:00100000:3.0:1746147259.380057:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32092:x1830967465901312:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2647us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.380062:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15989 00000100:00100000:2.0:1746147259.380416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.380431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.380443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.380454:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901824 00000100:00100000:2.0:1746147259.380458:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901824 00010000:00010000:2.0:1746147259.380470:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.380483:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465902080 00000100:00100000:2.0:1746147259.380485:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465902080 00010000:00010000:2.0:1746147259.380492:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.380501:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465901952 00000100:00100000:2.0:1746147259.380503:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465901952 00010000:00010000:2.0:1746147259.380509:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 29 pid: 8478 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.380517:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8166 00000100:00100000:2.0:1746147259.380522:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465901824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.380529:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.380542:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.380549:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.380560:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1dc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed391 expref: 9 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.380568:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.380586:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465901824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.380592:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8166 00000100:00100000:2.0:1746147259.380601:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8167 00000100:00100000:2.0:1746147259.380605:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465902080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.380610:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.380616:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.380623:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.380632:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0400/0xb4b2209fbdad1d64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed33d expref: 38 pid: 4444 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.380639:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.380651:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465902080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.380656:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8167 00000100:00100000:2.0:1746147259.380664:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8168 00000100:00100000:2.0:1746147259.380668:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465901952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.380673:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.380679:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 29 pid: 8478 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.380686:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 29 pid: 8478 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.380695:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e0c00/0xb4b2209fbdad1d72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed344 expref: 29 pid: 8478 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.380702:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.380703:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.380707:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.380713:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.380730:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.380738:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467110656:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.380761:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.380822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.380897:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465902336 00000100:00100000:1.0:1746147259.380901:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465902336 00002000:00100000:1.0:1746147259.380920:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1720320->1724415) req@ffff8800a5a0e300 x1830967465902336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.380928:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e300 with x1830967465902336 ext(1720320->1724415) 00002000:00010000:1.0:1746147259.380931:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0e300 00000100:00100000:1.0:1746147259.380960:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7611 00000100:00100000:1.0:1746147259.380966:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465902336:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147259.381076:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465902336:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 110us (254us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147259.381081:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7611 00002000:00100000:1.0:1746147259.381086:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1720320->1724415) req@ffff8800a5a0e300 x1830967465902336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.381104:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e300 with x1830967465902336 ext(1720320->1724415) 00002000:00010000:1.0:1746147259.381107:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0e300 00000100:00100000:3.0:1746147259.382371:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467110528:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.382384:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.382463:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467110656:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.382471:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.382818:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465901696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3492us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.382875:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465901952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2206us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.382881:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8168 00000100:00100000:3.0:1746147259.382913:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8165 00000100:00100000:0.0:1746147259.383169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.383262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.383390:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465902720 00000100:00100000:2.0:1746147259.383395:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465902720 00002000:00100000:2.0:1746147259.383418:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3162112->3166207) req@ffff88009f047b80 x1830967465902720/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.383431:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830967465902720 ext(3162112->3166207) 00002000:00010000:2.0:1746147259.383435:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047b80 00000100:00100000:2.0:1746147259.383460:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7612 00000100:00100000:2.0:1746147259.383466:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465902720:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147259.383588:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465902720:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 122us (326us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147259.383594:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7612 00002000:00100000:2.0:1746147259.383598:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3162112->3166207) req@ffff88009f047b80 x1830967465902720/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.383604:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830967465902720 ext(3162112->3166207) 00002000:00010000:2.0:1746147259.383607:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047b80 00000100:00100000:2.0:1746147259.383624:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465902464 00000100:00100000:2.0:1746147259.383627:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465902464 00000100:00100000:2.0:1746147259.383653:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15990 00000100:00100000:2.0:1746147259.383659:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32087:x1830967465902464:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.383666:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.383678:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed41d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.383696:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.383702:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.383704:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.383707:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.383727:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.383743:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 36 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.383752:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110784:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.383799:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.386785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.387594:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467110784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.387615:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.387629:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd800, rc 0) 00000100:00100000:2.0:1746147259.387667:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465902464:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4009us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.387674:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15990 00000100:00100000:3.0:1746147259.387751:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465902976 00000100:00100000:3.0:1746147259.387757:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465902976 00000100:00100000:3.0:1746147259.387786:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4832 00000100:00100000:3.0:1746147259.387793:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32090:x1830967465902976:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147259.387925:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32090:x1830967465902976:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 133us (1147us total) trans 8589945543 rc 0/0 00000100:00100000:3.0:1746147259.387931:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4832 00000100:00100000:0.0:1746147259.388008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.388110:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465903360 00000100:00100000:2.0:1746147259.388113:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465903360 00000100:00100000:2.0:1746147259.388131:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4833 00000100:00100000:2.0:1746147259.388135:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32092:x1830967465903360:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147259.388215:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32092:x1830967465903360:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 78us (211us total) trans 8589945544 rc 0/0 00000100:00100000:2.0:1746147259.388221:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4833 00000100:00100000:0.0:1746147259.389027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.389051:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465903104 00000100:00100000:1.0:1746147259.389056:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465903104 00002000:00100000:1.0:1746147259.389083:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1482752->1724415) req@ffff88008f9fe300 x1830967465903104/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.389101:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe300 with x1830967465903104 ext(1482752->1724415) 00010000:00010000:1.0:1746147259.389108:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 37 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.389120:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 37 pid: 17530 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.389126:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fe300 00000100:00100000:1.0:1746147259.389151:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2602 00000100:00100000:1.0:1746147259.389157:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465903104:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147259.394334:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465903104:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 5168us (5300us total) trans 21474841452 rc 0/0 00000100:00100000:1.0:1746147259.394344:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2602 00002000:00100000:1.0:1746147259.394353:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1482752->1724415) req@ffff88008f9fe300 x1830967465903104/t21474841452(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.394361:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe300 with x1830967465903104 ext(1482752->1724415) 00010000:00010000:1.0:1746147259.394371:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 39 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.394383:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 39 pid: 17530 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.394389:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fe300 00000100:00100000:0.0:1746147259.396226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.396271:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465903488 00000100:00100000:3.0:1746147259.396279:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465903488 00010000:00010000:3.0:1746147259.396303:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 39 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.396335:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8169 00000100:00100000:3.0:1746147259.396846:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465903488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.396859:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147259.396874:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147258 -> 1746147259 00002000:00010000:3.0:1746147259.396877:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147258 -> 1746147259 00010000:00010000:3.0:1746147259.396881:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 39 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.396891:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 39 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.396911:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1eb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3fa expref: 39 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.396933:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.396951:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.396958:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.396965:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.396993:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.397001:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467110912:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.397068:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.400411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.401076:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467110912:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.401103:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.402160:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465903616 00000100:00100000:2.0:1746147259.402168:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465903616 00000100:00100000:3.0:1746147259.402190:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465903488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4804us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.402202:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8169 00000100:00100000:2.0:1746147259.402208:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15991 00000100:00100000:2.0:1746147259.402214:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32087:x1830967465903616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147259.402228:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.402243:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed424 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.402265:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.402273:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 36 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.402279:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.402284:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.402285:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.402289:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.402311:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.402321:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 22 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.402335:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111040:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.402415:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 36 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.402422:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 36 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.402431:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111168:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.402458:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.402465:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.402472:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111296:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.402486:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.404653:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111040:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.404665:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111168:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.404672:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111296:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.404699:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.404717:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dca00, rc 0) 00000100:00100000:2.0:1746147259.404761:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465903616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2547us (4357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.404768:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15991 00000100:00100000:0.0:1746147259.408229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.408262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.408297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.408362:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904000 00000100:00100000:2.0:1746147259.408369:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904000 00010000:00010000:2.0:1746147259.408399:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.408421:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465903872 00000100:00100000:2.0:1746147259.408423:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465903872 00010000:00010000:2.0:1746147259.408433:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 37 pid: 8481 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.408445:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465903744 00000100:00100000:2.0:1746147259.408447:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465903744 00010000:00010000:2.0:1746147259.408454:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.408465:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8170 00000100:00100000:2.0:1746147259.408471:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465904000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.408482:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.408501:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408510:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408528:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1db8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed383 expref: 8 pid: 4444 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408543:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.408574:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465904000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.408580:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8170 00000100:00100000:2.0:1746147259.408592:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8171 00000100:00100000:2.0:1746147259.408596:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967465903872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.408602:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.408609:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 37 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408616:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 37 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408626:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad1e44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3d0 expref: 37 pid: 8481 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408633:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.408646:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967465903872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.408650:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8171 00000100:00100000:2.0:1746147259.408659:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8172 00000100:00100000:2.0:1746147259.408663:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967465903744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.408670:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.408676:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408684:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408694:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c52200/0xb4b2209fbdad1e0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ad expref: 23 pid: 21080 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.408702:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.408704:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.408709:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 6 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.408715:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 6 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.408740:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 6 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.408750:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467111424:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.408795:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.412013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.412191:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467111424:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.412206:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.412249:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904128 00000100:00100000:3.0:1746147259.412254:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904128 00000100:00100000:3.0:1746147259.412294:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15992 00000100:00100000:3.0:1746147259.412299:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32087:x1830967465904128:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.412311:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147259.415240:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967465903744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6567us (6933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.415252:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8172 00010000:00010000:3.0:1746147259.415341:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed42b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.415367:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.415374:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.415376:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.415379:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.415407:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.415418:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 21 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.415429:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111552:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.415482:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.416779:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467111552:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.416797:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.416808:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd400, rc 0) 00000100:00100000:3.0:1746147259.416842:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465904128:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4543us (4834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.416849:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15992 00000100:00100000:0.0:1746147259.417451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.417496:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904256 00000100:00100000:1.0:1746147259.417502:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904256 00002000:00100000:1.0:1746147259.417531:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4186112->4194303) req@ffff88012b0c0e00 x1830967465904256/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 8680/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.417539:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0e00 with x1830967465904256 ext(4186112->4194303) 00010000:00010000:1.0:1746147259.417545:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 22 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.417556:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 22 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.417562:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b0c0e00 00000100:00100000:1.0:1746147259.417588:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2603 00000100:00100000:1.0:1746147259.417595:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465904256:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147259.417908:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967465904256:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 312us (457us total) trans 17179874097 rc 0/0 00000100:00100000:1.0:1746147259.417914:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2603 00002000:00100000:1.0:1746147259.417919:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4186112->4194303) req@ffff88012b0c0e00 x1830967465904256/t17179874097(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 8680/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.417925:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0e00 with x1830967465904256 ext(4186112->4194303) 00010000:00010000:1.0:1746147259.417929:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.417952:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746147259.417957:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b0c0e00 00000100:00100000:0.0:1746147259.419627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.421383:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904384 00000100:00100000:2.0:1746147259.421392:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904384 00010000:00010000:2.0:1746147259.421425:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.422033:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8173 00000100:00100000:2.0:1746147259.422040:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465904384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.422052:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147259.422068:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147258 -> 1746147259 00002000:00010000:2.0:1746147259.422071:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147258 -> 1746147259 00010000:00010000:2.0:1746147259.422076:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.422087:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.422115:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1ebb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed408 expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.422131:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.422133:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.422138:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.422145:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.422172:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.422183:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467111680:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.423062:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.428909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.428999:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904512 00000100:00100000:3.0:1746147259.429009:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904512 00000100:00100000:3.0:1746147259.429062:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15993 00000100:00100000:3.0:1746147259.429068:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465904512:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147259.429083:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147259.429084:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467111680:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.429107:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed432 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.429116:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147259.429134:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.429141:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.429142:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.429145:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.429169:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.429174:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465904384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7133us (9550us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147259.429179:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 27 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.429189:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467111808:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.429192:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8173 00000100:00100000:3.0:1746147259.429460:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.434748:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467111808:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.434785:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.434804:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65600, rc 0) 00000100:00100000:3.0:1746147259.434852:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465904512:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5783us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.434861:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15993 00000100:00100000:0.0:1746147259.435648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.435739:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904640 00000100:00100000:2.0:1746147259.435747:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904640 00002000:00100000:2.0:1746147259.435781:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3166207) req@ffff8800a4673800 x1830967465904640/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.435791:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673800 with x1830967465904640 ext(3145728->3166207) 00010000:00010000:2.0:1746147259.435798:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 28 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.435815:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 28 pid: 17530 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.435821:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673800 00000100:00100000:2.0:1746147259.435915:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2604 00000100:00100000:2.0:1746147259.435923:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465904640:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147259.437398:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465904640:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 1470us (1746us total) trans 21474841453 rc 0/0 00000100:00100000:2.0:1746147259.437406:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2604 00002000:00100000:2.0:1746147259.437413:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3166207) req@ffff8800a4673800 x1830967465904640/t21474841453(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.437421:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673800 with x1830967465904640 ext(3145728->3166207) 00010000:00010000:2.0:1746147259.437428:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.437439:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.437445:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673800 00000100:00100000:0.0:1746147259.443665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.444388:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904768 00000100:00100000:2.0:1746147259.444399:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904768 00010000:00010000:2.0:1746147259.444434:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.444477:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8174 00000100:00100000:2.0:1746147259.444484:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465904768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.444496:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147259.444515:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147258 -> 1746147259 00002000:00010000:2.0:1746147259.444518:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147258 -> 1746147259 00010000:00010000:2.0:1746147259.444523:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.444537:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.444556:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad1ec9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed416 expref: 30 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.444581:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.444582:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.444588:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.444595:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.444747:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.444758:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467111936:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.444836:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.447084:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467111936:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147259.447113:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.447189:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465904768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2679us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.447200:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8174 00000100:00100000:0.0:1746147259.447901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.447965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.447998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.448022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.448037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.448055:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465905280 00000100:00100000:2.0:1746147259.448057:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465905024 00000100:00100000:0.0:1746147259.448061:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465905280 00000100:00100000:2.0:1746147259.448068:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465905024 00000100:00100000:0.0:1746147259.448104:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465905536 00000100:00100000:0.0:1746147259.448106:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465905536 00000100:00100000:2.0:1746147259.448113:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465904896 00000100:00100000:2.0:1746147259.448115:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465904896 00000100:00100000:0.0:1746147259.448122:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465905152 00000100:00100000:0.0:1746147259.448125:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465905152 00000100:00100000:2.0:1746147259.448138:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15994 00000100:00100000:2.0:1746147259.448144:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465905280:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:2.0:1746147259.448323:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147259.448326:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147258 -> 1746147258 00002000:00010000:2.0:1746147259.448328:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147255 -> 1746147258 00002000:00010000:2.0:1746147259.448330:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147258 -> 1746147259 00002000:00010000:2.0:1746147259.448331:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147259.448370:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465905280:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 226us (434us total) trans 17179874098 rc 0/0 00000100:00100000:0.0:1746147259.448527:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15995 00000100:00100000:0.0:1746147259.448537:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465905024:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:3.0:1746147259.448664:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15996 00000100:00100000:3.0:1746147259.448674:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465905536:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147259.448925:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147259.448929:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147257 -> 1746147258 00002000:00010000:0.0:1746147259.448931:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147257 -> 1746147258 00002000:00010000:0.0:1746147259.448932:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147257 -> 1746147259 00002000:00010000:0.0:1746147259.448934:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147259.448984:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465905024:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 449us (1084us total) trans 21474841455 rc 0/0 00000100:00100000:0.0:1746147259.448990:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15995 00000100:00100000:0.0:1746147259.449005:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15997 00000100:00100000:0.0:1746147259.449010:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465904896:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147259.449082:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147259.449084:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147256 -> 1746147258 00002000:00010000:0.0:1746147259.449086:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147256 -> 1746147258 00002000:00010000:0.0:1746147259.449088:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147256 -> 1746147259 00002000:00010000:0.0:1746147259.449090:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147259.449117:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465904896:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 107us (1094us total) trans 17179874099 rc 0/0 00000100:00100000:0.0:1746147259.449121:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15997 00000100:00100000:0.0:1746147259.449130:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15998 00000100:00100000:0.0:1746147259.449134:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465905152:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:2.0:1746147259.449357:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15994 00002000:00010000:3.0:1746147259.449406:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147259.449409:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147259 -> 1746147258 00002000:00010000:3.0:1746147259.449410:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:3.0:1746147259.449412:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147259 -> 1746147259 00002000:00010000:3.0:1746147259.449413:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746147259.449419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.449436:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465905536:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 764us (1437us total) trans 21474841454 rc 0/0 00000100:00100000:3.0:1746147259.449442:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15996 00000100:00100000:2.0:1746147259.449443:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465905408 00000100:00100000:2.0:1746147259.449447:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465905408 00000100:00100000:3.0:1746147259.449459:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15999 00000100:00100000:3.0:1746147259.449466:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465905408:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147259.449527:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:3.0:1746147259.449529:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147259 -> 1746147258 00002000:00010000:3.0:1746147259.449530:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:3.0:1746147259.449532:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147259 -> 1746147259 00002000:00010000:3.0:1746147259.449533:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:3.0:1746147259.449550:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465905408:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 85us (131us total) trans 17179874100 rc 0/0 00000100:00100000:3.0:1746147259.449555:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15999 00002000:00010000:0.0:1746147259.449618:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147259.449620:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147259 -> 1746147258 00002000:00010000:0.0:1746147259.449622:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147258 -> 1746147258 00002000:00010000:0.0:1746147259.449624:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147259 -> 1746147259 00002000:00010000:0.0:1746147259.449626:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147259.449642:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465905152:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 508us (1604us total) trans 21474841456 rc 0/0 00000100:00100000:0.0:1746147259.449647:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15998 00000100:00100000:0.0:1746147259.453865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.453973:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465905792 00000100:00100000:1.0:1746147259.453986:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465905792 00000100:00100000:1.0:1746147259.454037:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4834 00000100:00100000:1.0:1746147259.454043:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32087:x1830967465905792:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147259.454489:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465905792:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 444us (627us total) trans 8589945545 rc 0/0 00000100:00100000:1.0:1746147259.454495:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4834 00000100:00100000:0.0:1746147259.457221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.457608:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465906048 00000100:00100000:1.0:1746147259.457620:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465906048 00000100:00100000:1.0:1746147259.457668:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4835 00000100:00100000:1.0:1746147259.457676:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32087:x1830967465906048:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147259.457907:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32087:x1830967465906048:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 231us (694us total) trans 8589945546 rc 0/0 00000100:00100000:1.0:1746147259.457914:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4835 00000100:00100000:0.0:1746147259.506227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.506300:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465906304 00000100:00100000:2.0:1746147259.506310:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465906304 00000100:00100000:2.0:1746147259.506364:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11532 00000100:00100000:2.0:1746147259.506372:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136953850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32099:x1830967465906304:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.506396:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.506413:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad1eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed439 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.506512:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506525:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506536:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506548:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506554:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506560:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506667:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506674:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506681:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147259.506689:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147259.506779:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506785:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506790:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506796:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3dd400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.506800:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506806:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506816:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147259.506819:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.506822:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506831:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1ef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506911:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506917:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506922:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506926:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3dc200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.506928:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506933:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506969:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76500) 00010000:00010000:2.0:1746147259.506971:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.506974:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.506978:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc200/0xb4b2209fbdad1efa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.507013:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc000/0xb4b2209fbdad1eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 307 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.507024:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.507034:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.507036:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147259.507038:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd000, rc 0) 00000100:00100000:2.0:1746147259.507109:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136953850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32099:x1830967465906304:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 737us (891us total) trans 8589945547 rc 0/0 00000100:00100000:2.0:1746147259.507115:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11532 00000100:00100000:0.0:1746147259.547151:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.547252:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465906560 00000100:00100000:2.0:1746147259.547260:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465906560 00000100:00100000:2.0:1746147259.547298:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11533 00000100:00100000:2.0:1746147259.547304:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32102:x1830967465906560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.547322:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.547336:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed440 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.547422:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547434:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547442:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547452:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547456:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547464:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547544:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547551:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547556:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147259.547562:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147259.547624:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547629:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547634:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547638:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3dc400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.547641:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547646:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547655:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147259.547657:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.547660:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547668:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc400/0xb4b2209fbdad1f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547692:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547696:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547700:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547704:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3dd200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.547706:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547710:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547715:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76600) 00010000:00010000:2.0:1746147259.547716:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.547718:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547722:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147259.547752:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.547760:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.547770:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.547772:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147259.547774:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc800, rc 0) 00000100:00100000:2.0:1746147259.547810:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32102:x1830967465906560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 506us (668us total) trans 8589945548 rc 0/0 00000100:00100000:2.0:1746147259.547816:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11533 00000100:00100000:0.0:1746147259.550877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.550994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.551019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.551049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.551067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.551220:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465906688 00000100:00100000:1.0:1746147259.551231:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465906688 00000100:00100000:1.0:1746147259.551273:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465906944 00000100:00100000:1.0:1746147259.551276:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465906944 00000100:00100000:1.0:1746147259.551289:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465906816 00000100:00100000:1.0:1746147259.551291:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465906816 00000100:00100000:1.0:1746147259.551299:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907072 00000100:00100000:1.0:1746147259.551301:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907072 00000100:00100000:1.0:1746147259.551310:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907200 00000100:00100000:1.0:1746147259.551311:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907200 00000100:00100000:1.0:1746147259.551325:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16000 00000100:00100000:1.0:1746147259.551332:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967465906688:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147259.551343:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16001 00010000:00010000:1.0:1746147259.551351:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147259.551352:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465906944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.551359:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.551367:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1f32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed447 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.551369:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad1f39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed455 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.551413:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467112064:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.551414:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467112192:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.551440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.551481:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907328 00000100:00100000:1.0:1746147259.551484:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907328 00000100:00100000:1.0:1746147259.551499:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16002 00000100:00100000:3.0:1746147259.551502:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.551504:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465906816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.551510:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.551518:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d73400/0xb4b2209fbdad1f40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed44e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.551520:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.551541:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467112320:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147259.551544:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16003 00000100:00100000:3.0:1746147259.551549:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465907072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.551556:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147259.551561:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147259.551564:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd800/0xb4b2209fbdad1f47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed45c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.551577:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16004 00000100:00100000:1.0:1746147259.551582:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465907200:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147259.551584:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467112448:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.551587:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.551593:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73200/0xb4b2209fbdad1f4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed463 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.551605:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.551614:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467112576:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147259.551625:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16005 00000100:00100000:3.0:1746147259.551630:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465907328:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147259.551632:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147259.551636:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.551642:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdad1f55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed46a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.551663:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467112704:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147259.551695:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.552993:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467112192:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.553019:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1f32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed447 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147259.553030:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467112448:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.553036:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56fa00/0xb4b2209fbdad1f32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed447 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.553048:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd800/0xb4b2209fbdad1f47 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed45c expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.553050:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56fa00, rc 0) 00010000:00010000:2.0:1746147259.553057:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd800/0xb4b2209fbdad1f47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed45c expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147259.553058:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467112704:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.553070:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd800, rc 0) 00000100:00100000:3.0:1746147259.553080:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465906688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1749us (2214us total) trans 0 rc 301/301 00010000:00010000:0.0:1746147259.553085:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdad1f55 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed46a expref: 34 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.553087:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16000 00000100:00100000:2.0:1746147259.553104:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967465907072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1541us (2040us total) trans 0 rc 301/301 00010000:00010000:0.0:1746147259.553109:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdad1f55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed46a expref: 34 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147259.553110:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16003 00010000:00010000:0.0:1746147259.553121:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1515e00, rc 0) 00000100:00100000:1.0:1746147259.553128:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467112576:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.553137:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465907328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1507us (1698us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147259.553142:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16005 00010000:00010000:1.0:1746147259.553145:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73200/0xb4b2209fbdad1f4e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed463 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.553154:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73200/0xb4b2209fbdad1f4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed463 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.553160:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467112064:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.553164:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73200, rc 0) 00010000:00010000:3.0:1746147259.553174:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad1f39 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed455 expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147259.553175:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467112320:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.553179:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967465907200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1597us (2115us total) trans 0 rc 301/301 00010000:00010000:3.0:1746147259.553183:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd800/0xb4b2209fbdad1f39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed455 expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147259.553184:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16004 00010000:00010000:2.0:1746147259.553188:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d73400/0xb4b2209fbdad1f40 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed44e expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.553190:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd800, rc 0) 00010000:00010000:2.0:1746147259.553203:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d73400/0xb4b2209fbdad1f40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed44e expref: 31 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.553207:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465906944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1857us (2213us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.553212:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16001 00010000:00010000:2.0:1746147259.553215:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73400, rc 0) 00000100:00100000:2.0:1746147259.553234:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465906816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1729us (2214us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.553239:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16002 00000100:00100000:0.0:1746147259.555233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.555423:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907456 00000100:00100000:2.0:1746147259.555431:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907456 00000100:00100000:2.0:1746147259.555475:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16006 00000100:00100000:2.0:1746147259.555483:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32102:x1830967465907456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.555501:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.555516:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed471 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.555545:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.555553:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.555555:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.555558:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.555587:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.555598:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 10 pid: 4445 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.555615:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467112832:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.555701:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.557421:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467112832:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.557447:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.557461:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc600, rc 0) 00000100:00100000:2.0:1746147259.557515:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32102:x1830967465907456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2032us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.557522:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16006 00000100:00100000:0.0:1746147259.558354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.558397:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907584 00000100:00100000:2.0:1746147259.558403:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907584 00010000:00010000:2.0:1746147259.558425:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.558453:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8175 00000100:00100000:2.0:1746147259.558458:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465907584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.558469:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.558486:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.558494:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.558517:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1ead lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed401 expref: 11 pid: 4445 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.558527:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.558529:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.558535:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.558543:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.558566:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.558576:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467112960:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.558862:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.560474:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467112960:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.560488:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.560538:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465907584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2078us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.560546:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8175 00000100:00100000:0.0:1746147259.562760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.562851:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907840 00000100:00100000:2.0:1746147259.562859:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907840 00002000:00100000:2.0:1746147259.562895:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880094d7ad80 x1830967465907840/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.562909:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ad80 with x1830967465907840 ext(0->1048575) 00002000:00010000:2.0:1746147259.562913:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7ad80 00000100:00100000:2.0:1746147259.562958:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7613 00000100:00100000:2.0:1746147259.562964:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465907840:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.570134:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465907840:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7161us (7372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.570143:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7613 00002000:00100000:2.0:1746147259.570152:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880094d7ad80 x1830967465907840/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.570160:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ad80 with x1830967465907840 ext(0->1048575) 00002000:00010000:2.0:1746147259.570165:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7ad80 00000100:00100000:0.0:1746147259.574769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.574809:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465907968 00000100:00100000:2.0:1746147259.574817:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465907968 00000100:00100000:2.0:1746147259.574860:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16007 00000100:00100000:2.0:1746147259.574866:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32102:x1830967465907968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.574878:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.574889:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed478 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.574911:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.574916:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.574917:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.574919:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.574966:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.574976:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 11 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.574985:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467113088:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.576056:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.579758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.579815:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465908096 00000100:00100000:3.0:1746147259.579821:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465908096 00010000:00010000:3.0:1746147259.579848:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 12 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.579858:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467113088:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.579876:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8176 00010000:00010000:2.0:1746147259.579877:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.579881:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465908096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.579889:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.579889:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dce00, rc 0) 00010000:00010000:3.0:1746147259.579903:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 12 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.579910:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 12 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.579923:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ec2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed40f expref: 12 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.579923:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32102:x1830967465907968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5056us (5159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.579929:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16007 00010000:00010000:3.0:1746147259.579932:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.579934:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.579959:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.579966:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.579995:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.580008:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467113216:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.580065:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.583465:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467113216:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147259.583466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147259.583487:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.583551:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465908096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3668us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.583560:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465908352 00000100:00100000:3.0:1746147259.583561:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8176 00000100:00100000:2.0:1746147259.583566:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465908352 00002000:00100000:2.0:1746147259.583600:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880094d7aa00 x1830967465908352/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.583607:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7aa00 with x1830967465908352 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.583611:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7aa00 00000100:00100000:2.0:1746147259.583638:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7614 00000100:00100000:2.0:1746147259.583645:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465908352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.589321:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465908352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5668us (5852us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.589331:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7614 00002000:00100000:2.0:1746147259.589340:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880094d7aa00 x1830967465908352/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.589348:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7aa00 with x1830967465908352 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.589353:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7aa00 00000100:00100000:0.0:1746147259.590841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.590955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.591010:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465908736 00000100:00100000:3.0:1746147259.591017:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465908736 00000100:00100000:3.0:1746147259.591064:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16008 00000100:00100000:3.0:1746147259.591072:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:32099:x1830967465908736:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.591085:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.591248:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed486 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.591259:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465908608 00000100:00100000:1.0:1746147259.591263:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465908608 00010000:00010000:3.0:1746147259.591274:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.591282:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.591283:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147259.591296:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11534 00000100:00100000:1.0:1746147259.591301:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32105:x1830967465908608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.591312:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.591322:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad1f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed47f expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.591327:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [983040->1048575] (req 983040->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 37 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.591354:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.591364:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 23 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.591375:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467113344:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.591386:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.591396:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.591404:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147259.591412:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000100:00100000:3.0:1746147259.591422:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147259.591666:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad1f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 309 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.591853:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.591861:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.591864:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147259.591866:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6eb800, rc 0) 00000100:00100000:1.0:1746147259.591898:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32105:x1830967465908608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 596us (1062us total) trans 8589945549 rc 0/0 00000100:00100000:1.0:1746147259.591904:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11534 00000100:00100000:0.0:1746147259.593747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.593778:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467113344:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.593801:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [983040->1048575] (req 983040->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 37 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.593813:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f65e00, rc 0) 00000100:00100000:3.0:1746147259.593843:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32099:x1830967465908736:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2772us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.593850:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16008 00000100:00100000:3.0:1746147259.593866:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465908864 00000100:00100000:3.0:1746147259.593870:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465908864 00000100:00100000:1.0:1746147259.593934:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16009 00000100:00100000:1.0:1746147259.593958:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32102:x1830967465908864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.593969:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.593980:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed48d expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.594001:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.594008:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.594009:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.594012:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.594032:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.594041:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.594051:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467113472:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.594184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.594225:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465908992 00000100:00100000:2.0:1746147259.594228:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465908992 00000100:00100000:2.0:1746147259.594254:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16010 00000100:00100000:2.0:1746147259.594259:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465908992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.594266:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.594274:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed494 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.594285:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.594290:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed494 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.594299:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dd200/0xb4b2209fbdad1f8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed494 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.594309:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd200, rc 0) 00000100:00100000:2.0:1746147259.594323:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465908992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (141us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.594329:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16010 00000100:00100000:2.0:1746147259.594395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.594405:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909120 00000100:00100000:2.0:1746147259.594408:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909120 00000100:00100000:2.0:1746147259.594421:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16011 00000100:00100000:2.0:1746147259.594426:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465909120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.594431:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.594437:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed49b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.594447:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.594448:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.594453:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.594462:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.594469:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dde00, rc 0) 00000100:00100000:2.0:1746147259.594481:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465909120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.594485:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16011 00000100:00100000:1.0:1746147259.594527:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.595016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.595737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.595764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.595794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.595809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.595914:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909248 00000100:00100000:2.0:1746147259.595918:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909248 00000100:00100000:2.0:1746147259.595964:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909376 00000100:00100000:2.0:1746147259.595967:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909376 00000100:00100000:2.0:1746147259.595979:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909504 00000100:00100000:2.0:1746147259.595981:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909504 00000100:00100000:2.0:1746147259.595989:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909632 00000100:00100000:2.0:1746147259.595991:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909632 00000100:00100000:2.0:1746147259.596001:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16012 00000100:00100000:2.0:1746147259.596006:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465909248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.596016:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.596027:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1f9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4a2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.596059:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467113600:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.596117:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.596132:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16013 00000100:00100000:2.0:1746147259.596137:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465909376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.596144:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.596152:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1fa2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4a9 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.596173:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467113728:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.596192:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.596206:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16014 00000100:00100000:2.0:1746147259.596211:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465909504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.596216:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.596223:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1fa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4b0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.596241:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467113856:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.596258:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.596309:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16015 00000100:00100000:2.0:1746147259.596314:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967465909632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.596320:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.596326:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad1fb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4b7 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.596344:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467113984:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.596363:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.596455:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909760 00000100:00100000:3.0:1746147259.596459:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909760 00010000:00010000:3.0:1746147259.596475:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 24 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.596493:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8177 00000100:00100000:3.0:1746147259.596498:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967465909760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.596505:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.596522:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 24 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.596530:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 24 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.596544:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1f5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed471 expref: 24 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.596557:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.596559:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.596564:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.596571:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.596586:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467113472:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.596590:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.596597:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467114112:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147259.596603:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.596611:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6eb400, rc 0) 00000100:00100000:3.0:1746147259.596618:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.596628:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32102:x1830967465908864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2672us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.596633:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16009 00000100:00100000:1.0:1746147259.597102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.597175:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465909888 00000100:00100000:3.0:1746147259.597178:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465909888 00010000:00010000:3.0:1746147259.597191:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 11 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.597600:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8178 00000100:00100000:3.0:1746147259.597607:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465909888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.597614:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.597627:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 11 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.597635:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 11 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.597646:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.597648:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.597652:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 30 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.597658:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 30 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.597673:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 30 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.597680:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467114240:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.597719:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00010000:00010000:2.0:1746147259.598702:0:21080:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a5a0c380 x1830967467113600) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 11 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.598720:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd800/0xb4b2209fbdad1ed0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed41d expref: 11 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.598730:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467113600:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.598753:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1f9b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4a2 expref: 42 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.598761:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dd400/0xb4b2209fbdad1f9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4a2 expref: 42 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.598766:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dd400, rc 0) 00000100:00100000:2.0:1746147259.598807:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967465909248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2800us (3791us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.598816:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16012 00000100:00100000:3.0:1746147259.599011:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467113728:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.599026:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1fa2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4a9 expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.599035:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514c00/0xb4b2209fbdad1fa2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4a9 expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.599042:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1514c00, rc 0) 00000100:00100000:3.0:1746147259.599061:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465909376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2924us (3326us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.599065:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16013 00000100:00100000:1.0:1746147259.599303:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467113984:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.599317:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad1fb0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4b7 expref: 40 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.599325:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad1fb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4b7 expref: 40 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.599334:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7c000, rc 0) 00000100:00100000:1.0:1746147259.599349:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465909632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3035us (3555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.599355:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16015 00000100:00100000:1.0:1746147259.599384:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467114240:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147259.599392:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.599405:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465909888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1800us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.599410:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8178 00000100:00100000:2.0:1746147259.599563:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467113856:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.599575:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1fa9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4b0 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.599583:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7d000/0xb4b2209fbdad1fa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4b0 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.599589:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7d000, rc 0) 00000100:00100000:2.0:1746147259.599606:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967465909504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3395us (3842us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.599611:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16014 00000100:00100000:3.0:1746147259.599663:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467114112:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.599670:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.599683:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967465909760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3185us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.599689:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8177 00000100:00100000:1.0:1746147259.601595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.601641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.601832:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465910144 00000100:00100000:2.0:1746147259.601840:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465910144 00002000:00100000:2.0:1746147259.601871:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (983040->987135) req@ffff88009f046d80 x1830967465910144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.601880:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830967465910144 ext(983040->987135) 00002000:00010000:2.0:1746147259.601885:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046d80 00000100:00100000:2.0:1746147259.601907:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465910400 00000100:00100000:2.0:1746147259.601910:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465910400 00002000:00100000:2.0:1746147259.601921:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f045500 x1830967465910400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.601928:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045500 with x1830967465910400 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.601930:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045500 00000100:00100000:3.0:1746147259.601931:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7615 00000100:00100000:3.0:1746147259.601956:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465910144:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147259.602103:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465910144:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 153us (501us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147259.602109:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7615 00002000:00100000:3.0:1746147259.602291:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (983040->987135) req@ffff88009f046d80 x1830967465910144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.602299:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830967465910144 ext(983040->987135) 00002000:00010000:3.0:1746147259.602302:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046d80 00000100:00100000:3.0:1746147259.602317:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7616 00000100:00100000:3.0:1746147259.602323:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465910400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.603263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.603295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.603329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.603335:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465910528 00000100:00100000:1.0:1746147259.603340:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465910528 00000100:00100000:1.0:1746147259.603362:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465910784 00000100:00100000:1.0:1746147259.603364:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465910784 00000100:00100000:1.0:1746147259.603373:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465910656 00000100:00100000:1.0:1746147259.603374:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465910656 00000100:00100000:1.0:1746147259.603383:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16016 00000100:00100000:2.0:1746147259.603389:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16017 00000100:00100000:1.0:1746147259.603389:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465910528:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147259.603396:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967465910784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.603397:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.603403:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.603410:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4be expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.603412:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093782e00/0xb4b2209fbdad1fbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4cc expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.603425:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.603427:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.603434:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 40 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147259.603445:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467114368:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.603446:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 40 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.603455:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0c00, rc 0) 00000100:00100000:0.0:1746147259.603501:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16018 00000100:00100000:0.0:1746147259.603507:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465910656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.603513:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.603519:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad1fc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4c5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.603538:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467114496:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.603555:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465910528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 165us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.603561:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16016 00000100:00100000:0.0:1746147259.603566:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.603692:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.605363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.606058:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465910912 00000100:00100000:2.0:1746147259.606065:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465910912 00000100:00100000:2.0:1746147259.606860:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16019 00000100:00100000:2.0:1746147259.606869:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967465910912:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.606881:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.606893:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1fcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4d3 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.606931:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467114624:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.607010:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.607229:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467114368:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.607249:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093782e00/0xb4b2209fbdad1fbe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4cc expref: 40 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.607259:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093782e00/0xb4b2209fbdad1fbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4cc expref: 40 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.607269:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093782e00, rc 0) 00000100:00100000:3.0:1746147259.607291:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465910784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3895us (3994us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.607296:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16017 00000100:00100000:2.0:1746147259.607659:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467114496:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.607673:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad1fc5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4c5 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.607681:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73400/0xb4b2209fbdad1fc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4c5 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.607687:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73400, rc 0) 00000100:00100000:2.0:1746147259.607797:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967465910656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4290us (4466us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.607802:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16018 00000100:00100000:0.0:1746147259.608549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.608653:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911040 00000100:00100000:2.0:1746147259.608658:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911040 00000100:00100000:2.0:1746147259.608681:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16020 00000100:00100000:2.0:1746147259.608685:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32099:x1830967465911040:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.608693:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.608702:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4da expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.608719:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.608725:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 43 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.608730:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.608732:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.608735:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->1748991] (req 1048576->1748991) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.608754:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 43 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.608764:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 43 pid: 4445 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.608772:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467114752:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.608827:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.608835:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 32 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.608843:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467114880:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.608859:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.608888:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467114624:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.608905:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1fcc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4d3 expref: 43 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.608913:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc600/0xb4b2209fbdad1fcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4d3 expref: 43 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.608919:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc600, rc 0) 00000100:00100000:2.0:1746147259.608951:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967465910912:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2068us (3575us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.608957:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16019 00000100:00100000:3.0:1746147259.609903:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465910400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7577us (8258us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.609911:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7616 00002000:00100000:3.0:1746147259.609919:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f045500 x1830967465910400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.609926:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045500 with x1830967465910400 ext(1048576->2097151) 00002000:00010000:3.0:1746147259.609931:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045500 00000100:00100000:1.0:1746147259.613187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.613211:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911296 00000100:00100000:0.0:1746147259.613219:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911296 00000100:00100000:0.0:1746147259.613262:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11535 00000100:00100000:0.0:1746147259.613269:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32107:x1830967465911296:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:3.0:1746147259.613279:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467114752:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.613286:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.613300:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad1fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4e1 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.613374:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.613387:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 307 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.613397:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.613402:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.613427:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.613436:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 11 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.613446:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467115008:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.613572:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 307 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.613579:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 307 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.613585:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df74380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467115136:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.613604:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.613924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.614046:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911424 00000100:00100000:0.0:1746147259.614050:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911424 00010000:00010000:0.0:1746147259.614066:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 42 pid: 4445 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.614141:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8179 00000100:00100000:0.0:1746147259.614147:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465911424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.614156:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147259.614157:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467114880:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.614176:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 42 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.614177:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [1048576->1748991] (req 1048576->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.614186:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 42 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.614203:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1f94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed49b expref: 42 pid: 4445 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746147259.614205:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dcc00, rc 0) 00010000:00010000:0.0:1746147259.614215:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.614237:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:32099:x1830967465911040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5550us (5689us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.614242:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465911424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.614243:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16020 00000100:00100000:0.0:1746147259.614248:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8179 00000100:00100000:1.0:1746147259.614341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.614384:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911552 00000100:00100000:1.0:1746147259.614387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.614388:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911552 00000100:00100000:3.0:1746147259.614420:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16021 00000100:00100000:3.0:1746147259.614425:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32102:x1830967465911552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.614432:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.614441:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4e8 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.614444:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467115008:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.614454:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911680 00000100:00100000:0.0:1746147259.614457:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911680 00010000:00010000:0.0:1746147259.614468:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 31 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.614481:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8180 00000100:00100000:0.0:1746147259.614485:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465911680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147259.614512:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df74380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467115136:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.614524:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.614533:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.614536:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.614540:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.614541:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.614544:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.614544:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 31 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.614551:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 31 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.614562:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dce00/0xb4b2209fbdad1f63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed478 expref: 31 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.614568:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.614569:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147259.614574:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.614580:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.614594:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.614601:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467115264:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.614632:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.614640:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 9 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.614646:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.614648:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467115392:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.614668:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.615435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.615585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.615741:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911936 00000100:00100000:1.0:1746147259.615745:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911936 00010000:00010000:1.0:1746147259.615760:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 308 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.615783:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465911808 00000100:00100000:1.0:1746147259.615785:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465911808 00010000:00010000:1.0:1746147259.615792:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 12 pid: 14125 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.615803:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8181 00000100:00100000:1.0:1746147259.615808:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1958:x1830967465911936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.615816:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.615819:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 308 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.615826:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 308 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.615839:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd000/0xb4b2209fbdad1f01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed439 expref: 308 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.615854:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.615857:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.615863:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.615867:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.615893:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1958:x1830967465911936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.615898:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8181 00000100:00100000:1.0:1746147259.615914:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8182 00000100:00100000:1.0:1746147259.615918:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465911808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.615925:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.615928:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 12 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.615957:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 12 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.615966:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad1f24 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed440 expref: 12 pid: 14125 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.615973:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.615976:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.615981:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.615986:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147259.615998:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.616010:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465911808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.616015:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8182 00010000:00010000:0.0:1746147259.616268:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.616275:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147259.616290:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147259.616392:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73c00/0xb4b2209fbdad1fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.616404:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.616409:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.616411:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147259.616413:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73600, rc 0) 00000100:00100000:0.0:1746147259.616434:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32107:x1830967465911296:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3166us (3253us total) trans 8589945550 rc 0/0 00000100:00100000:0.0:1746147259.616441:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11535 00000100:00100000:2.0:1746147259.616629:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467115264:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.616640:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.616668:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465911680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2181us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.616673:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8180 00000100:00100000:2.0:1746147259.616957:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467115392:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.616972:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.616983:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56e000, rc 0) 00000100:00100000:2.0:1746147259.617006:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32102:x1830967465911552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2580us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.617012:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16021 00000100:00100000:0.0:1746147259.618338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.618405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.618607:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465912320 00000100:00100000:3.0:1746147259.618614:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465912320 00002000:00100000:3.0:1746147259.618644:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (0->983039) req@ffff88012df77b80 x1830967465912320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.618652:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77b80 with x1830967465912320 ext(0->983039) 00002000:00010000:3.0:1746147259.618656:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df77b80 00000100:00100000:3.0:1746147259.618690:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7617 00000100:00100000:3.0:1746147259.618697:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465912320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.619713:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465912064 00000100:00100000:2.0:1746147259.619719:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465912064 00010000:00010000:2.0:1746147259.619738:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.619760:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8183 00000100:00100000:2.0:1746147259.619766:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465912064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.619775:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.619788:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.619799:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.619815:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3dca00/0xb4b2209fbdad1ed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed424 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.619826:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.619829:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.619834:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.619842:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.619864:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.619874:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467115520:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.619919:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.622520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.622573:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465912576 00000100:00100000:1.0:1746147259.622583:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465912576 00002000:00100000:1.0:1746147259.622616:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1744896->1748991) req@ffff88012df76300 x1830967465912576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.622625:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76300 with x1830967465912576 ext(1744896->1748991) 00002000:00010000:1.0:1746147259.622628:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76300 00000100:00100000:1.0:1746147259.622657:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7618 00000100:00100000:1.0:1746147259.622663:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465912576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.622819:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465912576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 155us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147259.622824:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7618 00002000:00100000:1.0:1746147259.622829:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1744896->1748991) req@ffff88012df76300 x1830967465912576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.622836:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76300 with x1830967465912576 ext(1744896->1748991) 00002000:00010000:1.0:1746147259.622838:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76300 00000100:00100000:2.0:1746147259.625302:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467115520:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.625331:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.625393:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465912064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5626us (7058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.625404:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8183 00000100:00100000:0.0:1746147259.626618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.626718:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465912832 00000100:00100000:2.0:1746147259.626725:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465912832 00002000:00100000:2.0:1746147259.626766:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df74000 x1830967465912832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.626775:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74000 with x1830967465912832 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.626780:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df74000 00000100:00100000:2.0:1746147259.626808:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7619 00000100:00100000:2.0:1746147259.626816:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967465912832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.627407:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967465912320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8710us (9002us total) trans 0 rc 983040/983040 00000100:00100000:3.0:1746147259.627415:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7617 00002000:00100000:3.0:1746147259.627421:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (0->983039) req@ffff88012df77b80 x1830967465912320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.627428:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77b80 with x1830967465912320 ext(0->983039) 00002000:00010000:3.0:1746147259.627432:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df77b80 00000100:00100000:0.0:1746147259.628343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.628389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.628452:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465913088 00000100:00100000:3.0:1746147259.628456:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465913088 00000100:00100000:3.0:1746147259.628493:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4836 00000100:00100000:3.0:1746147259.628499:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+307:32099:x1830967465913088:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147259.629198:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465913216 00000100:00100000:2.0:1746147259.629203:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465913216 00000100:00100000:2.0:1746147259.629231:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16022 00000100:00100000:2.0:1746147259.629237:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32107:x1830967465913216:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.629247:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.629264:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4ef expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.629288:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.629295:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.629297:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.629301:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3096576->3145727] (req 3096576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.629330:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 8 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.629343:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 8 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.629354:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467115648:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.630596:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32099:x1830967465913088:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 2091us (2248us total) trans 8589945551 rc 0/0 00000100:00100000:2.0:1746147259.630605:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.630606:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4836 00000100:00100000:1.0:1746147259.635606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.635635:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467115648:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.635636:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465913344 00000100:00100000:1.0:1746147259.635638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.635644:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465913344 00010000:00010000:2.0:1746147259.635669:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3096576->3145727] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.635677:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 9 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.635690:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1514600, rc 0) 00000100:00100000:3.0:1746147259.635717:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8184 00000100:00100000:3.0:1746147259.635725:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465913344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.635738:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.635759:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 9 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.635770:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 9 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.635793:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948bd400/0xb4b2209fbdad1ede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed42b expref: 9 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.635802:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32107:x1830967465913216:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6563us (7410us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147259.635805:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.635807:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147259.635810:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16022 00010000:00010000:3.0:1746147259.635815:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.635823:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.635853:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.635865:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467115776:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.635933:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.635970:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465913600 00000100:00100000:3.0:1746147259.635974:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465913600 00002000:00100000:3.0:1746147259.636001:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x420:0x0] (1748992->2097151) req@ffff880094d79c00 x1830967465913600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.636010:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79c00 with x1830967465913600 ext(1748992->2097151) 00002000:00010000:3.0:1746147259.636014:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d79c00 00000100:00100000:3.0:1746147259.636027:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7620 00000100:00100000:3.0:1746147259.636033:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465913600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.637719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.637752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.637768:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465913856 00000100:00100000:0.0:1746147259.637774:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465913856 00002000:00100000:0.0:1746147259.637801:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012df76d80 x1830967465913856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147259.637809:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467115776:192.168.203.36@tcp:105: 00002000:00100000:0.0:1746147259.637814:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76d80 with x1830967465913856 ext(1048576->2097151) 00002000:00010000:0.0:1746147259.637818:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76d80 00010000:00010000:3.0:1746147259.637822:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.637831:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465914112 00000100:00100000:0.0:1746147259.637833:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465914112 00002000:00100000:0.0:1746147259.637844:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3096576->3100671) req@ffff88012df77480 x1830967465914112/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.637849:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77480 with x1830967465914112 ext(3096576->3100671) 00000100:00100000:3.0:1746147259.637850:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465913344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2125us (2253us total) trans 0 rc 0/0 00002000:00010000:0.0:1746147259.637851:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df77480 00000100:00100000:3.0:1746147259.637860:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8184 00000100:00100000:0.0:1746147259.637861:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7621 00000100:00100000:0.0:1746147259.637866:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465913856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.638150:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7622 00000100:00100000:1.0:1746147259.638162:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465914112:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147259.638302:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465914112:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 143us (548us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147259.638308:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7622 00002000:00100000:1.0:1746147259.638314:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3096576->3100671) req@ffff88012df77480 x1830967465914112/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.638322:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df77480 with x1830967465914112 ext(3096576->3100671) 00002000:00010000:1.0:1746147259.638327:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df77480 00000100:00100000:2.0:1746147259.638343:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465912832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11526us (11724us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.638350:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7619 00002000:00100000:2.0:1746147259.638356:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df74000 x1830967465912832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.638363:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74000 with x1830967465912832 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.638366:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df74000 00000100:00100000:3.0:1746147259.641647:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465913600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5603us (5997us total) trans 0 rc 348160/348160 00000100:00100000:3.0:1746147259.641659:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7620 00002000:00100000:3.0:1746147259.641670:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x420:0x0] (1748992->2097151) req@ffff880094d79c00 x1830967465913600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 348160/348160 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.641680:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79c00 with x1830967465913600 ext(1748992->2097151) 00002000:00010000:3.0:1746147259.641686:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d79c00 00000100:00100000:0.0:1746147259.643583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.643663:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465914240 00000100:00100000:2.0:1746147259.643671:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465914240 00000100:00100000:2.0:1746147259.644141:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16023 00000100:00100000:2.0:1746147259.644148:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32107:x1830967465914240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.644162:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.644176:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4f6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.644199:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.644206:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.644207:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.644211:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.644235:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.644244:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 9 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.644254:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467115904:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.644330:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.646381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.646450:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465914496 00000100:00100000:3.0:1746147259.646460:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465914496 00000100:00100000:0.0:1746147259.646470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147259.646502:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3096575) req@ffff88012df74380 x1830967465914496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.646510:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74380 with x1830967465914496 ext(2097152->3096575) 00002000:00010000:3.0:1746147259.646514:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df74380 00000100:00100000:3.0:1746147259.646540:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465914624 00000100:00100000:3.0:1746147259.646542:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465914624 00010000:00010000:3.0:1746147259.646556:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.646561:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467115904:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.646572:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8185 00000100:00100000:3.0:1746147259.646576:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465914624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.646585:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.646586:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.646599:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dde00, rc 0) 00010000:00010000:3.0:1746147259.646603:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.646615:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.646633:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f65600/0xb4b2209fbdad1ee5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed432 expref: 10 pid: 17530 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.646634:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32107:x1830967465914240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2486us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.646642:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16023 00010000:00010000:3.0:1746147259.646646:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.646648:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.646654:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.646660:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.646685:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.646694:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467116032:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147259.646747:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7623 00000100:00100000:0.0:1746147259.646755:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465914496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.646757:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.646934:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465913856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9067us (9221us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.646964:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7621 00002000:00100000:1.0:1746147259.646971:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012df76d80 x1830967465913856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.646984:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df76d80 with x1830967465913856 ext(1048576->2097151) 00002000:00010000:1.0:1746147259.646989:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df76d80 00000100:00100000:3.0:1746147259.650415:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467116032:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.650431:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.650482:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465914624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3903us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.650492:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8185 00000100:00100000:2.0:1746147259.652105:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465914496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5338us (5718us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746147259.652114:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7623 00002000:00100000:2.0:1746147259.652122:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3096575) req@ffff88012df74380 x1830967465914496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.652130:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df74380 with x1830967465914496 ext(2097152->3096575) 00002000:00010000:2.0:1746147259.652135:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df74380 00000100:00100000:0.0:1746147259.652950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.653015:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465915008 00000100:00100000:2.0:1746147259.653021:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465915008 00002000:00100000:2.0:1746147259.653048:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2183168->2187263) req@ffff88008d5ddc00 x1830967465915008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.653055:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddc00 with x1830967465915008 ext(2183168->2187263) 00002000:00010000:2.0:1746147259.653058:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5ddc00 00000100:00100000:2.0:1746147259.653078:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7624 00000100:00100000:2.0:1746147259.653083:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465915008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.653338:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467116160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147259.653391:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465915008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 307us (459us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147259.653397:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7624 00002000:00100000:2.0:1746147259.653402:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2183168->2187263) req@ffff88008d5ddc00 x1830967465915008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.653409:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddc00 with x1830967465915008 ext(2183168->2187263) 00002000:00010000:2.0:1746147259.653412:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5ddc00 00000100:00100000:1.0:1746147259.653438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.653468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147259.653591:0:11221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467116160 00000100:00100000:3.0:1746147259.653595:0:11221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467116160 00000100:00100000:3.0:1746147259.653615:0:11221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1746147259.653619:0:11221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467116160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746147259.653630:0:11221:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 643497984 pending 42598400 free 3847225344 avail 3845128192 00000100:00100000:3.0:1746147259.653655:0:11221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467116160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.653659:0:11221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1746147259.653700:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465914752 00000100:00100000:2.0:1746147259.653703:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465914752 00000100:00100000:1.0:1746147259.653715:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467116160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147259.653719:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16024 00000100:00100000:2.0:1746147259.653723:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32105:x1830967465914752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.653730:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.653742:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed4fd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.653757:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.653759:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.653764:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 38 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.653775:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 38 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.653844:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891200, rc 0) 00000100:00100000:2.0:1746147259.654088:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:32105:x1830967465914752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 363us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.654101:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16024 00000100:00100000:0.0:1746147259.656885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.656933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.657047:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465915520 00000100:00100000:1.0:1746147259.657048:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465915264 00000100:00100000:2.0:1746147259.657057:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465915520 00000100:00100000:1.0:1746147259.657057:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465915264 00002000:00100000:2.0:1746147259.657109:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008d5dca80 x1830967465915520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.657116:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2187264->3145727) req@ffff88008d5de680 x1830967465915264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.657119:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dca80 with x1830967465915520 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.657123:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dca80 00002000:00100000:1.0:1746147259.657125:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de680 with x1830967465915264 ext(2187264->3145727) 00002000:00010000:1.0:1746147259.657133:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5de680 00000100:00100000:2.0:1746147259.657212:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7625 00000100:00100000:2.0:1746147259.657219:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967465915520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.657224:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7626 00000100:00100000:1.0:1746147259.657230:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465915264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.661999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.662043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.662922:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465915776 00000100:00100000:2.0:1746147259.662922:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916032 00000100:00100000:3.0:1746147259.662929:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465915776 00000100:00100000:2.0:1746147259.662929:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916032 00002000:00100000:3.0:1746147259.662973:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008d5dc000 x1830967465915776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.662973:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a4673480 x1830967465916032/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.662981:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dc000 with x1830967465915776 ext(3145728->4194303) 00002000:00100000:2.0:1746147259.662981:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673480 with x1830967465916032 ext(3145728->4194303) 00002000:00010000:3.0:1746147259.662985:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dc000 00002000:00010000:2.0:1746147259.662985:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673480 00000100:00100000:3.0:1746147259.663008:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7627 00000100:00100000:3.0:1746147259.663013:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465915776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.663015:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7628 00000100:00100000:2.0:1746147259.663021:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967465916032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.664393:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967465915520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7169us (7454us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.664401:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7625 00002000:00100000:2.0:1746147259.664407:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008d5dca80 x1830967465915520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.664414:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dca80 with x1830967465915520 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.664418:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dca80 00000100:00100000:1.0:1746147259.667787:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465915264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10549us (10903us total) trans 0 rc 958464/958464 00000100:00100000:1.0:1746147259.667796:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7626 00002000:00100000:1.0:1746147259.667804:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2187264->3145727) req@ffff88008d5de680 x1830967465915264/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.667812:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de680 with x1830967465915264 ext(2187264->3145727) 00002000:00010000:1.0:1746147259.667817:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5de680 00000100:00100000:2.0:1746147259.672030:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830967467116544:0@lo:400:kworker.0 00000100:00100000:1.0:1746147259.672030:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967467116416:0@lo:400:kworker.0 00000100:00100000:1.0:1746147259.672072:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.672103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.672122:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147259.672127:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830967467116672:0@lo:400:kworker.0 00000100:00100000:2.0:1746147259.672143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147259.672165:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467116416 00000100:00100000:2.0:1746147259.672171:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467116416 00000100:00100000:2.0:1746147259.672203:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467116544 00000100:00100000:2.0:1746147259.672205:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467116544 00000100:00100000:3.0:1746147259.672233:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967465915776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9216us (10238us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.672235:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467116672 00000100:00100000:2.0:1746147259.672237:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467116672 00000100:00100000:3.0:1746147259.672241:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7627 00000100:00100000:2.0:1746147259.672248:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00002000:00100000:3.0:1746147259.672249:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008d5dc000 x1830967465915776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147259.672253:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967467116416:12345-0@lo:400:kworker.0 00002000:00100000:3.0:1746147259.672258:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dc000 with x1830967465915776 ext(3145728->4194303) 00002000:00010000:3.0:1746147259.672262:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dc000 00000100:00100000:2.0:1746147259.672282:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967467116416:12345-0@lo:400:kworker.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.672283:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1746147259.672288:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1746147259.672289:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830967467116544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147259.672298:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1746147259.672302:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830967467116672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147259.672315:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830967467116544:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.672320:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1746147259.672324:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830967467116672:12345-0@lo:400:kworker.0 Request processed in 22us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.672329:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1746147259.672332:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b57d6275-d138-4373-818f-9bad59bb9e6f:3295:1830967467116288:0@lo:400:kworker.0 00000100:00100000:3.0:1746147259.672351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.672384:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967467116416:0@lo:400:kworker.0 00000100:00080000:1.0:1746147259.672407:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147259.672628:0:14045:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467116288 00000100:00100000:2.0:1746147259.672632:0:14045:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467116288 00000100:00100000:2.0:1746147259.672648:0:14045:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1746147259.672652:0:14045:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3295:x1830967467116288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147259.672675:0:14045:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3295:x1830967467116288:12345-0@lo:400:kworker.0 Request processed in 22us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.672678:0:14045:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1746147259.672914:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b57d6275-d138-4373-818f-9bad59bb9e6f:3295:1830967467116288:0@lo:400:kworker.0 00000100:00100000:3.0:1746147259.672962:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830967467116672:0@lo:400:kworker.0 00000100:00100000:3.0:1746147259.672969:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830967467116544:0@lo:400:kworker.0 00000100:00100000:0.0:1746147259.673731:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1958:x1830967465916032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10708us (11686us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147259.673739:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7628 00002000:00100000:0.0:1746147259.673745:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a4673480 x1830967465916032/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.673753:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673480 with x1830967465916032 ext(3145728->4194303) 00002000:00010000:0.0:1746147259.673757:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673480 00000100:00100000:0.0:1746147259.675768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.675810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.675906:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916160 00000100:00100000:2.0:1746147259.675913:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916160 00000100:00100000:2.0:1746147259.675964:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916288 00000100:00100000:2.0:1746147259.675967:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916288 00000100:00100000:2.0:1746147259.675986:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16025 00000100:00100000:2.0:1746147259.675992:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465916160:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147259.675999:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16026 00010000:00010000:2.0:1746147259.676005:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147259.676007:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465916288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.676015:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.676019:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891600/0xb4b2209fbdad200b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed504 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.676024:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad2012 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed50b expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.676058:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467116928:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.676058:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467116800:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.676274:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.676561:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.677420:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.677532:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916416 00000100:00100000:3.0:1746147259.677538:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916416 00000100:00100000:3.0:1746147259.677574:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16027 00000100:00100000:3.0:1746147259.677581:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465916416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.677590:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.677600:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094682000/0xb4b2209fbdad2019 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed512 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.677631:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467117056:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147259.677743:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.678302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147259.678361:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147258 -> 1746147259 00002000:00010000:2.0:1746147259.678364:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147258 -> 1746147259 00002000:00010000:1.0:1746147259.678364:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147258 -> 1746147259 00002000:00010000:1.0:1746147259.678368:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147258 -> 1746147259 00000100:00100000:2.0:1746147259.678379:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467116928:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.678380:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467116800:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.678398:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f891600/0xb4b2209fbdad200b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed504 expref: 39 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.678398:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad2012 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed50b expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.678409:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891600/0xb4b2209fbdad200b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed504 expref: 39 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.678409:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e1e00/0xb4b2209fbdad2012 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed50b expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.678420:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e1e00, rc 0) 00010000:00010000:2.0:1746147259.678421:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891600, rc 0) 00000100:00100000:1.0:1746147259.678444:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465916288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2438us (2633us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.678448:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465916160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2456us (2686us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.678449:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16026 00000100:00100000:2.0:1746147259.678454:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16025 00000100:00100000:1.0:1746147259.678464:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916544 00000100:00100000:1.0:1746147259.678466:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916544 00000100:00100000:1.0:1746147259.678482:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16028 00000100:00100000:1.0:1746147259.678487:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465916544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.678494:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.678501:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093854200/0xb4b2209fbdad2020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed519 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.678525:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467117184:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.678564:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00002000:00010000:3.0:1746147259.679192:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime: 1746147258 -> 1746147259 00002000:00010000:3.0:1746147259.679195:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime: 1746147258 -> 1746147259 00000100:00100000:3.0:1746147259.679205:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467117056:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.679225:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094682000/0xb4b2209fbdad2019 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed512 expref: 26 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.679233:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094682000/0xb4b2209fbdad2019 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed512 expref: 26 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.679255:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682000, rc 0) 00000100:00100000:3.0:1746147259.679288:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967465916416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1708us (1870us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.679294:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16027 00002000:00010000:2.0:1746147259.679361:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147258 -> 1746147259 00002000:00010000:2.0:1746147259.679363:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147258 -> 1746147259 00000100:00100000:2.0:1746147259.679401:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467117184:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.679416:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093854200/0xb4b2209fbdad2020 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed519 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.679424:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093854200/0xb4b2209fbdad2020 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed519 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.679432:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854200, rc 0) 00000100:00100000:2.0:1746147259.679464:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465916544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 977us (1163us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.679469:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16028 00000100:00100000:0.0:1746147259.679617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.679667:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916672 00000100:00100000:3.0:1746147259.679670:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916672 00000100:00100000:3.0:1746147259.679753:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16029 00000100:00100000:3.0:1746147259.679758:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:32105:x1830967465916672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.679765:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.679774:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed520 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.679790:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.679795:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.679797:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.679800:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.679816:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.679825:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 24 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.679838:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467117312:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.679977:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.680986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.681023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.681039:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916928 00000100:00100000:0.0:1746147259.681043:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916928 00002000:00100000:0.0:1746147259.681065:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3096576->3145727) req@ffff880094400380 x1830967465916928/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.681073:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400380 with x1830967465916928 ext(3096576->3145727) 00010000:00010000:0.0:1746147259.681080:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 25 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746147259.681101:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 25 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.681102:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465916800 00000100:00100000:1.0:1746147259.681106:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465916800 00002000:00010000:0.0:1746147259.681108:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094400380 00000100:00100000:0.0:1746147259.681122:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2605 00000100:00100000:0.0:1746147259.681128:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967465916928:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147259.681136:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16030 00000100:00100000:1.0:1746147259.681142:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32102:x1830967465916800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.681149:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.681158:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed527 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.681171:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.681172:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.681176:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.681185:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.681192:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2600, rc 0) 00000100:00100000:1.0:1746147259.681216:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32102:x1830967465916800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.681222:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16030 00000100:00100000:3.0:1746147259.681271:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467117312:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.681285:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.681294:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094683000, rc 0) 00000100:00100000:3.0:1746147259.681309:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:32105:x1830967465916672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1551us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.681315:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16029 00000100:00100000:2.0:1746147259.682893:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465916928:12345-192.168.203.36@tcp:4:cat.0 Request processed in 1762us (1865us total) trans 17179874101 rc 0/0 00000100:00100000:2.0:1746147259.682902:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2605 00002000:00100000:2.0:1746147259.682909:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3096576->3145727) req@ffff880094400380 x1830967465916928/t17179874101(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.682918:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094400380 with x1830967465916928 ext(3096576->3145727) 00010000:00010000:2.0:1746147259.682925:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.682954:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.682960:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094400380 00000100:00100000:3.0:1746147259.685130:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467117440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147259.685176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147259.685218:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467117440 00000100:00100000:1.0:1746147259.685224:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467117440 00000100:00100000:1.0:1746147259.685253:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746147259.685259:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3295:x1830967467117440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147259.685274:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 636551168 pending 32374784 free 3843031040 avail 3840933888 00000100:00100000:1.0:1746147259.685728:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3295:x1830967467117440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 468us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.685734:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1746147259.685808:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467117440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147259.687212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.687261:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465917056 00000100:00100000:3.0:1746147259.687266:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465917056 00010000:00010000:3.0:1746147259.687289:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.687316:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8186 00000100:00100000:3.0:1746147259.687322:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465917056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.687332:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.687349:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.687364:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.687382:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1514600/0xb4b2209fbdad1ff6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4ef expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.687406:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.687408:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.687414:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.687421:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.687427:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.687428:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.687431:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.687437:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.687460:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.687469:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467117568:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.687549:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.687557:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467117696:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.688125:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.689125:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467117568:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.689134:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467117696:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.689146:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.689169:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465917056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1847us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.689328:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8186 00000100:00100000:2.0:1746147259.690253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.690359:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465917312 00000100:00100000:0.0:1746147259.690366:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465917312 00002000:00100000:0.0:1746147259.690394:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a5a0d880 x1830967465917312/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.690404:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967465917312 ext(4194304->4976639) 00002000:00010000:0.0:1746147259.690407:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d880 00000100:00100000:0.0:1746147259.690428:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7629 00000100:00100000:0.0:1746147259.690434:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465917312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147259.691076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.691160:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465917568 00000100:00100000:3.0:1746147259.691163:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465917568 00002000:00100000:3.0:1746147259.691181:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5a0c000 x1830967465917568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.691187:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967465917568 ext(2097152->3145727) 00002000:00010000:3.0:1746147259.691189:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c000 00000100:00100000:3.0:1746147259.691213:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7630 00000100:00100000:3.0:1746147259.691218:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465917568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.697577:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465917312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7134us (7316us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147259.697588:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7629 00002000:00100000:1.0:1746147259.697598:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a5a0d880 x1830967465917312/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.697619:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967465917312 ext(4194304->4976639) 00002000:00010000:1.0:1746147259.697624:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d880 00000100:00100000:0.0:1746147259.702667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.702712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.702800:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465917696 00000100:00100000:2.0:1746147259.702807:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465917696 00000100:00100000:2.0:1746147259.702839:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465917824 00000100:00100000:2.0:1746147259.702841:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465917824 00000100:00100000:2.0:1746147259.702856:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16031 00000100:00100000:2.0:1746147259.702863:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465917696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.702877:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.702891:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad2035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed52e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.702931:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467117824:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.702966:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16032 00000100:00100000:1.0:1746147259.702973:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1958:x1830967465917824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.702980:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.702993:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b26800/0xb4b2209fbdad203c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed535 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.703008:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.703019:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467117952:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.703045:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.703822:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465917568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12601us (12745us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.703831:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7630 00002000:00100000:3.0:1746147259.703839:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5a0c000 x1830967465917568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.703852:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967465917568 ext(2097152->3145727) 00002000:00010000:3.0:1746147259.703855:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0c000 00000100:00100000:1.0:1746147259.704476:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467117952:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.704497:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b26800/0xb4b2209fbdad203c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed535 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.704508:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b26800/0xb4b2209fbdad203c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed535 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.704519:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b26800, rc 0) 00000100:00100000:1.0:1746147259.704540:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1958:x1830967465917824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1568us (1827us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.704545:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16032 00000100:00100000:2.0:1746147259.704572:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467117824:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.704592:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad2035 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed52e expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.704602:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad2035 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed52e expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.704623:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854200, rc 0) 00000100:00100000:2.0:1746147259.704639:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465917696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1777us (1986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.704644:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16031 00000100:00100000:0.0:1746147259.708209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.708258:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465917952 00000100:00100000:2.0:1746147259.708266:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465917952 00000100:00100000:2.0:1746147259.708310:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16033 00000100:00100000:2.0:1746147259.708317:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:32105:x1830967465917952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.708330:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.708346:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed53c expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.708369:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.708375:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.708376:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147259.708379:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.708402:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.708416:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 30 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.708528:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467118080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.708608:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.708881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.708913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.708926:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465918080 00000100:00100000:0.0:1746147259.708929:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465918080 00000100:00100000:0.0:1746147259.708960:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465918208 00000100:00100000:0.0:1746147259.708962:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465918208 00000100:00100000:0.0:1746147259.708974:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16034 00000100:00100000:0.0:1746147259.708978:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465918080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.708985:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.708993:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad204a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed543 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.709008:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16035 00000100:00100000:1.0:1746147259.709015:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465918208:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147259.709016:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfe3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467118208:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.709022:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.709034:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad2051 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed54a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.709044:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.709057:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467118336:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.709077:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.710353:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467118080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.710378:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.710388:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537ee00, rc 0) 00000100:00100000:2.0:1746147259.710426:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:32105:x1830967465917952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2109us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.710431:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16033 00000100:00100000:0.0:1746147259.711352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.711534:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465918336 00000100:00100000:3.0:1746147259.711540:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465918336 00002000:00100000:3.0:1746147259.711568:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2187263) req@ffff88012bfe2a00 x1830967465918336/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.711575:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe2a00 with x1830967465918336 ext(2097152->2187263) 00010000:00010000:3.0:1746147259.711582:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.711596:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.711602:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bfe2a00 00000100:00100000:3.0:1746147259.711789:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2606 00000100:00100000:3.0:1746147259.711796:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465918336:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147259.712976:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bfe3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467118208:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.713001:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad204a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed543 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.713011:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891a00/0xb4b2209fbdad204a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed543 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.713033:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891a00, rc 0) 00000100:00100000:2.0:1746147259.713063:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465918080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4083us (4182us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.713072:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16034 00000100:00100000:1.0:1746147259.713314:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467118336:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.713329:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad2051 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed54a expref: 34 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.713338:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad2051 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed54a expref: 34 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.713349:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c0200, rc 0) 00000100:00100000:1.0:1746147259.713370:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465918208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4356us (4456us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.713375:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16035 00000100:00100000:3.0:1746147259.714394:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465918336:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2596us (3041us total) trans 21474841457 rc 0/0 00000100:00100000:3.0:1746147259.714401:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2606 00002000:00100000:3.0:1746147259.714408:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2187263) req@ffff88012bfe2a00 x1830967465918336/t21474841457(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.714415:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe2a00 with x1830967465918336 ext(2097152->2187263) 00010000:00010000:3.0:1746147259.714962:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.714973:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.714980:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bfe2a00 00000100:00100000:0.0:1746147259.722988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.723050:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465918464 00000100:00100000:3.0:1746147259.723057:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465918464 00010000:00010000:3.0:1746147259.723086:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.723123:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8187 00000100:00100000:3.0:1746147259.723129:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465918464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.723139:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.723159:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.723169:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.723187:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dde00/0xb4b2209fbdad1ffd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4f6 expref: 33 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.723311:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.723313:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.723319:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.723331:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.723357:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.723367:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467118464:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147259.723511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.723620:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.723661:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465918720 00000100:00100000:2.0:1746147259.723664:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465918720 00000100:00100000:2.0:1746147259.723739:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4837 00000100:00100000:2.0:1746147259.723744:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32102:x1830967465918720:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147259.723902:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32102:x1830967465918720:12345-192.168.203.36@tcp:35:cat.0 Request processed in 156us (390us total) trans 8589945552 rc 0/0 00000100:00100000:2.0:1746147259.723908:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4837 00000100:00100000:3.0:1746147259.725154:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467118464:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.725168:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.725203:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967465918464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2074us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.725210:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8187 00000100:00100000:0.0:1746147259.730279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.730746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.730792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.730840:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465919104 00000100:00100000:1.0:1746147259.730847:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465919104 00000100:00100000:3.0:1746147259.730854:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465919232 00000100:00100000:3.0:1746147259.730859:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465919232 00002000:00100000:3.0:1746147259.730883:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012bfe3b80 x1830967465919232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.730883:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012bfe0000 x1830967465919104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.730892:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3b80 with x1830967465919232 ext(3145728->4194303) 00002000:00100000:1.0:1746147259.730892:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe0000 with x1830967465919104 ext(2097152->3145727) 00002000:00010000:3.0:1746147259.730896:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3b80 00002000:00010000:1.0:1746147259.730896:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe0000 00000100:00100000:3.0:1746147259.730924:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465919488 00000100:00100000:3.0:1746147259.730927:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465919488 00002000:00100000:3.0:1746147259.730965:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880090508700 x1830967465919488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.730972:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508700 with x1830967465919488 ext(3145728->4194303) 00002000:00010000:3.0:1746147259.730975:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508700 00000100:00100000:1.0:1746147259.730975:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7631 00000100:00100000:1.0:1746147259.730982:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465919232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.730988:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7632 00000100:00100000:3.0:1746147259.730993:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465919104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.731087:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7633 00000100:00100000:0.0:1746147259.731105:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465919488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147259.739724:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465919232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8735us (8971us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147259.739732:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7631 00002000:00100000:1.0:1746147259.739741:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012bfe3b80 x1830967465919232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147259.739747:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe3b80 with x1830967465919232 ext(3145728->4194303) 00002000:00010000:1.0:1746147259.739752:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe3b80 00000100:00100000:2.0:1746147259.746657:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465919488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15544us (15856us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.746667:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7633 00002000:00100000:2.0:1746147259.746677:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880090508700 x1830967465919488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.746685:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508700 with x1830967465919488 ext(3145728->4194303) 00002000:00010000:2.0:1746147259.746690:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508700 00000100:00100000:3.0:1746147259.751214:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465919104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20211us (20933us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.751225:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7632 00002000:00100000:3.0:1746147259.751235:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012bfe0000 x1830967465919104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.751243:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bfe0000 with x1830967465919104 ext(2097152->3145727) 00002000:00010000:3.0:1746147259.751249:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bfe0000 00000100:00100000:0.0:1746147259.768263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.768332:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465919744 00000100:00100000:3.0:1746147259.768339:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465919744 00002000:00100000:3.0:1746147259.768379:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009050b100 x1830967465919744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.768389:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050b100 with x1830967465919744 ext(4194304->4976639) 00002000:00010000:3.0:1746147259.768393:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009050b100 00000100:00100000:3.0:1746147259.768417:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7634 00000100:00100000:3.0:1746147259.768423:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465919744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147259.780119:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465919744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11688us (11856us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147259.780129:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7634 00002000:00100000:3.0:1746147259.780138:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009050b100 x1830967465919744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.780151:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050b100 with x1830967465919744 ext(4194304->4976639) 00002000:00010000:3.0:1746147259.780156:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009050b100 00000100:00100000:0.0:1746147259.780475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.781895:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465920000 00000100:00100000:1.0:1746147259.781904:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465920000 00000100:00100000:0.0:1746147259.782021:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11536 00000100:00100000:0.0:1746147259.782030:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32112:x1830967465920000:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147259.782049:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.782064:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891a00/0xb4b2209fbdad2058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed551 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.782161:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782173:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782181:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782191:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782196:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782200:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782280:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782286:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782292:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147259.782299:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147259.782358:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782364:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782369:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782376:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f891400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147259.782379:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782385:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782394:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147259.782397:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147259.782399:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782404:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891400/0xb4b2209fbdad205f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782468:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782473:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782477:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782481:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f890200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147259.782483:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782487:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782493:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13e00) 00010000:00010000:0.0:1746147259.782495:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147259.782497:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782501:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f890200/0xb4b2209fbdad2066 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147259.782530:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891a00/0xb4b2209fbdad2058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 15 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.782539:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.782545:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147259.782546:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147259.782548:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891800, rc 0) 00000100:00100000:0.0:1746147259.782745:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32112:x1830967465920000:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 715us (2270us total) trans 8589945553 rc 0/0 00000100:00100000:0.0:1746147259.782751:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11536 00000100:00100000:0.0:1746147259.784445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.784524:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465920256 00000100:00100000:1.0:1746147259.784530:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465920256 00000100:00100000:1.0:1746147259.784568:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4838 00000100:00100000:1.0:1746147259.784574:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32112:x1830967465920256:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147259.784747:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32112:x1830967465920256:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 172us (306us total) trans 8589945554 rc 0/0 00000100:00100000:1.0:1746147259.784754:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4838 00000100:00100000:0.0:1746147259.787265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.787313:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465920384 00000100:00100000:1.0:1746147259.787321:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465920384 00000100:00100000:1.0:1746147259.787362:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16036 00000100:00100000:1.0:1746147259.787369:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32112:x1830967465920384:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147259.787383:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.787397:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed558 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.787423:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.787431:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 38 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.787437:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.787438:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.787441:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1798144->1806335] (req 1798144->1806335) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.787464:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 38 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.787474:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 38 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.787484:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467118592:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.787569:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.787577:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.787584:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467118720:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.787602:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.789603:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467118592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.789613:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467118720:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.789637:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1798144->1806335] (req 1798144->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 28 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.789649:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854200, rc 0) 00000100:00100000:1.0:1746147259.789678:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32112:x1830967465920384:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2309us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.789684:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16036 00000100:00100000:0.0:1746147259.790450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.790500:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465920512 00000100:00100000:3.0:1746147259.790506:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465920512 00010000:00010000:3.0:1746147259.790528:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.790561:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8188 00000100:00100000:3.0:1746147259.790567:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465920512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.790576:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.790594:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.790603:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.790620:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad1fe8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e8 expref: 28 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.790644:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.790674:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465920512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.790680:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8188 00000100:00100000:0.0:1746147259.791850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.792022:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465920640 00000100:00100000:3.0:1746147259.792026:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465920640 00010000:00010000:3.0:1746147259.792042:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.792343:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8189 00000100:00100000:3.0:1746147259.792349:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465920640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.792357:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.793038:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.793049:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.793065:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2004 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4fd expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.793075:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.793077:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.793082:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.793097:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.793124:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.793135:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467118848:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.793215:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.795997:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467118848:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147259.796017:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147259.796053:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967465920640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3703us (4204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.796061:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8189 00000100:00100000:0.0:1746147259.797559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.797961:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465920896 00000100:00100000:3.0:1746147259.797968:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465920896 00002000:00100000:3.0:1746147259.799019:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1798144->1802239) req@ffff88012db2ca80 x1830967465920896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.799032:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ca80 with x1830967465920896 ext(1798144->1802239) 00002000:00010000:3.0:1746147259.799037:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2ca80 00000100:00100000:3.0:1746147259.799068:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7635 00000100:00100000:3.0:1746147259.799077:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465920896:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147259.799280:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967465920896:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 205us (1724us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147259.799286:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7635 00002000:00100000:3.0:1746147259.799291:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1798144->1802239) req@ffff88012db2ca80 x1830967465920896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.799298:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2ca80 with x1830967465920896 ext(1798144->1802239) 00002000:00010000:3.0:1746147259.799301:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2ca80 00000100:00100000:0.0:1746147259.802859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.805261:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465921152 00000100:00100000:3.0:1746147259.805270:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465921152 00002000:00100000:3.0:1746147259.805305:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1802240->1806335) req@ffff88012db2df80 x1830967465921152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.805319:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2df80 with x1830967465921152 ext(1802240->1806335) 00002000:00010000:3.0:1746147259.805324:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2df80 00000100:00100000:3.0:1746147259.805351:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7636 00000100:00100000:3.0:1746147259.805357:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465921152:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147259.805493:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465921152:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 135us (2641us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147259.805498:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7636 00002000:00100000:3.0:1746147259.805502:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1802240->1806335) req@ffff88012db2df80 x1830967465921152/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.805508:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db2df80 with x1830967465921152 ext(1802240->1806335) 00002000:00010000:3.0:1746147259.805510:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db2df80 00000100:00100000:0.0:1746147259.852768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.852836:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465921408 00000100:00100000:2.0:1746147259.852844:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465921408 00000100:00100000:2.0:1746147259.852894:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11537 00000100:00100000:2.0:1746147259.852901:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32119:x1830967465921408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.852921:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.852966:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad2082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed55f expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.853051:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853061:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853069:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853081:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853087:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853118:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853206:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2097 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853214:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853219:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147259.853231:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147259.853295:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853301:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853305:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853313:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf1a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.853316:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853322:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853331:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147259.853333:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.853336:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.853341:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad2089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854082:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854096:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854101:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854105:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5dd800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.854107:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854112:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854120:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76100) 00010000:00010000:2.0:1746147259.854122:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.854125:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854129:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.854160:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad2082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed55f expref: 18 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.854171:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2097 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed55f expref: 17 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.854177:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.854179:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147259.854181:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ee00, rc 0) 00000100:00100000:2.0:1746147259.855596:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32119:x1830967465921408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2691us (2832us total) trans 8589945555 rc 0/0 00000100:00100000:2.0:1746147259.855605:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11537 00000100:00100000:0.0:1746147259.859585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.859666:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465921920 00000100:00100000:2.0:1746147259.859674:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465921920 00000100:00100000:2.0:1746147259.859722:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11538 00000100:00100000:2.0:1746147259.859733:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32118:x1830967465921920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.859753:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.859791:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad20a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed56d expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.859881:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.859892:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860017:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860031:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860037:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860042:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860145:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860153:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860159:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147259.860166:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147259.860232:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860237:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860242:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860247:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf1e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.860249:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860255:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860263:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147259.860265:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.860268:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860271:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860280:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860284:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860288:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860291:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929c0200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.860293:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860296:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860301:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76500) 00010000:00010000:2.0:1746147259.860302:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.860304:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860309:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929c0200/0xb4b2209fbdad20b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.860336:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad20a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 311 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.860345:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 310 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.860351:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.860352:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147259.860354:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aeb600, rc 0) 00000100:00100000:0.0:1746147259.860583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.860610:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.860634:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465921664 00000100:00100000:0.0:1746147259.860635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.860638:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465921664 00000100:00100000:0.0:1746147259.860657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.860671:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 787 00000100:00100000:3.0:1746147259.860677:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465921664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.860685:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.860694:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2097 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed55f expref: 17 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.860694:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465921536 00000100:00100000:0.0:1746147259.860698:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465921536 00000100:00100000:2.0:1746147259.860707:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32118:x1830967465921920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 979us (1129us total) trans 8589945556 rc 0/0 00010000:00010000:3.0:1746147259.860711:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.860713:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.860713:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11538 00000100:00100000:0.0:1746147259.860715:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922048 00000100:00100000:0.0:1746147259.860716:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922048 00000100:00100000:0.0:1746147259.860725:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922176 00000100:00100000:0.0:1746147259.860727:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922176 00000100:00100000:3.0:1746147259.860734:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465921664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.860736:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16037 00000100:00100000:3.0:1746147259.860740:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 787 00000100:00100000:0.0:1746147259.860741:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465921536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.860748:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.860756:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f890800/0xb4b2209fbdad20c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed566 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.860786:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16038 00000100:00100000:0.0:1746147259.860790:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467118976:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147259.860792:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465922048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.860798:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.860806:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad20cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed574 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.860808:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16039 00000100:00100000:2.0:1746147259.860814:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1956:x1830967465922176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147259.860820:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.860826:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed57b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.860828:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467119104:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.860835:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147259.860836:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00010000:00010000:2.0:1746147259.860837:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.860842:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147259.860849:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147259.860851:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.861203:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ac4000, rc 0) 00000100:00100000:2.0:1746147259.861235:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967465922176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 421us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.861240:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16039 00000100:00100000:2.0:1746147259.864438:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467118976:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.864477:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f890800/0xb4b2209fbdad20c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed566 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.864489:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f890800/0xb4b2209fbdad20c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed566 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.864498:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890800, rc 0) 00000100:00100000:2.0:1746147259.864546:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465921536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3804us (3934us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.864553:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16037 00000100:00100000:3.0:1746147259.865643:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467119104:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.865664:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad20cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed574 expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.865673:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad20cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed574 expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.865681:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682600, rc 0) 00000100:00100000:3.0:1746147259.865716:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465922048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4922us (5078us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.865721:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16038 00000100:00100000:0.0:1746147259.871991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.873984:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922304 00000100:00100000:3.0:1746147259.873994:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922304 00000100:00100000:3.0:1746147259.874045:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16040 00000100:00100000:3.0:1746147259.874052:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32119:x1830967465922304:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147259.874065:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.874079:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed582 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.874115:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 37 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.874121:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.874123:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147259.874126:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.874150:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 37 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.874159:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 37 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.874168:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467119232:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.874248:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.877207:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467119232:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.877235:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.877251:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094683800, rc 0) 00000100:00100000:3.0:1746147259.877303:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32119:x1830967465922304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3250us (5318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.877311:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16040 00000100:00100000:0.0:1746147259.877496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.877774:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922432 00000100:00100000:2.0:1746147259.877779:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922432 00002000:00100000:2.0:1746147259.877809:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (983040->1048575) req@ffff880134f31500 x1830967465922432/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.877818:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31500 with x1830967465922432 ext(983040->1048575) 00010000:00010000:2.0:1746147259.877824:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 38 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.877835:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 38 pid: 21080 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.877842:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f31500 00000100:00100000:2.0:1746147259.877865:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2607 00000100:00100000:2.0:1746147259.877871:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967465922432:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147259.881686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.882150:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922560 00000100:00100000:2.0:1746147259.882157:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922560 00000100:00100000:2.0:1746147259.882401:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11539 00000100:00100000:2.0:1746147259.882407:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32120:x1830967465922560:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147259.882423:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.882436:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed589 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.882451:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465922432:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4579us (4955us total) trans 17179874102 rc 0/0 00000100:00100000:3.0:1746147259.882459:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2607 00002000:00100000:3.0:1746147259.882466:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (983040->1048575) req@ffff880134f31500 x1830967465922432/t17179874102(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.882474:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31500 with x1830967465922432 ext(983040->1048575) 00010000:00010000:3.0:1746147259.882481:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.882493:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.882498:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f31500 00010000:00010000:2.0:1746147259.882597:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882608:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882616:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882625:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882630:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882635:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882715:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882723:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 15 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.882729:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.882754:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 15 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.882762:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 15 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.882771:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467119360:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.882828:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.889377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.889444:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922688 00000100:00100000:3.0:1746147259.889453:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922688 00010000:00010000:3.0:1746147259.889489:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.889527:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8190 00000100:00100000:3.0:1746147259.889534:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967465922688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.889546:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.889567:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.889578:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.889603:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f65e00/0xb4b2209fbdad1f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed486 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.889634:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.889636:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.889643:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.889650:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.889680:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.889691:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467119488:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147259.889784:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.891654:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.891721:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467119360:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.891786:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465922944 00000100:00100000:3.0:1746147259.891792:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465922944 00010000:00010000:2.0:1746147259.891847:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:3.0:1746147259.892058:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4839 00000100:00100000:3.0:1746147259.892066:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:19601:x1830967465922944:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147259.892891:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:19601:x1830967465922944:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 824us (1242us total) trans 8589945557 rc 0/0 00000100:00100000:3.0:1746147259.892898:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4839 00000100:00100000:2.0:1746147259.894086:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467119488:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.894153:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.894198:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967465922688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4663us (4827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.894206:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8190 00000100:00100000:0.0:1746147259.894521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.894573:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923200 00000100:00100000:3.0:1746147259.894578:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923200 00002000:00100000:3.0:1746147259.894603:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134f31f80 x1830967465923200/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.894611:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31f80 with x1830967465923200 ext(0->1048575) 00002000:00010000:3.0:1746147259.894616:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f31f80 00000100:00100000:3.0:1746147259.894634:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7637 00000100:00100000:3.0:1746147259.894640:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465923200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.897162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.897861:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923328 00000100:00100000:3.0:1746147259.897869:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923328 00010000:00010000:3.0:1746147259.897898:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 17 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.897921:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8191 00000100:00100000:3.0:1746147259.897927:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967465923328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147259.897954:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147259.897959:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 17 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.897970:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 17 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.897987:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d73600/0xb4b2209fbdad1fe1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4e1 expref: 17 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.897998:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147259.898003:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.898010:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.898016:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147259.898038:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147259.898048:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898055:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:3.0:1746147259.898081:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967465923328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 154us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.898096:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8191 00000004:00200000:2.0:1746147259.898195:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:2.0:1746147259.898199:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147259.898215:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898224:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898231:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898236:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898240:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898246:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf1000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.898248:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898253:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898260:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147259.898262:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.898265:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898269:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1000/0xb4b2209fbdad20eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898292:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898297:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898301:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898305:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf1a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.898307:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898311:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898317:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76600) 00010000:00010000:2.0:1746147259.898319:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.898321:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898328:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1a00/0xb4b2209fbdad20f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147259.898355:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ddf1e00/0xb4b2209fbdad20e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.898363:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.898368:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.898371:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147259.898372:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678200, rc 0) 00000100:00100000:2.0:1746147259.898406:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32120:x1830967465922560:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 15999us (16727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.898412:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11539 00000100:00100000:0.0:1746147259.905357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.905422:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923456 00000100:00100000:2.0:1746147259.905429:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923456 00000100:00100000:2.0:1746147259.905461:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16041 00000100:00100000:2.0:1746147259.905467:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465923456:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147259.905481:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.905494:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed590 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.905512:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.905514:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.905520:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.905532:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.905542:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c99c00, rc 0) 00000100:00100000:2.0:1746147259.905843:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465923456:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 375us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.905845:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465923200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11203us (11323us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147259.905849:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16041 00000100:00100000:3.0:1746147259.905853:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7637 00002000:00100000:3.0:1746147259.905861:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134f31f80 x1830967465923200/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.905869:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f31f80 with x1830967465923200 ext(0->1048575) 00002000:00010000:3.0:1746147259.905873:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f31f80 00000100:00100000:2.0:1746147259.907295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.907319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.907330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.907331:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923584 00000100:00100000:3.0:1746147259.907336:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923584 00000100:00100000:2.0:1746147259.907344:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923840 00000100:00100000:2.0:1746147259.907347:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923840 00000100:00100000:3.0:1746147259.907359:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465924096 00000100:00100000:3.0:1746147259.907361:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465924096 00000100:00100000:2.0:1746147259.907363:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16042 00000100:00100000:2.0:1746147259.907369:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465923584:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147259.907374:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16043 00000100:00100000:3.0:1746147259.907378:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465923840:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147259.907379:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.907385:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.907390:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2107 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed597 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.907394:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec72a00/0xb4b2209fbdad210e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5a5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147259.907423:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467119616:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.907423:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467119744:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147259.907478:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16044 00000100:00100000:1.0:1746147259.907484:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465924096:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147259.907490:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.907496:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5b3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.907506:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.907508:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.907514:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.907526:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.907534:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7c000, rc 0) 00000100:00100000:2.0:1746147259.907797:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.907840:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.908379:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465924096:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 892us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.908385:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16044 00000100:00100000:2.0:1746147259.908828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.908870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.908908:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923712 00000100:00100000:3.0:1746147259.908913:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923712 00000100:00100000:3.0:1746147259.908932:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465923968 00000100:00100000:3.0:1746147259.908933:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465923968 00000100:00100000:3.0:1746147259.908961:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16045 00000100:00100000:3.0:1746147259.908966:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465923712:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147259.908975:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.908984:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed59e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.908999:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16046 00000100:00100000:1.0:1746147259.909006:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465923968:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147259.909014:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.909023:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5ac expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.909037:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.909039:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.909044:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.909054:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.909062:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7ca00, rc 0) 00000100:00100000:1.0:1746147259.909099:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967465923968:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.909104:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16046 00010000:00010000:3.0:1746147259.909182:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.909184:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.909190:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.909200:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.909208:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec73400, rc 0) 00000100:00100000:3.0:1746147259.909229:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967465923712:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 263us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147259.909234:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16045 00002000:00010000:3.0:1746147259.909671:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147258 -> 1746147259 00002000:00010000:3.0:1746147259.909674:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147258 -> 1746147259 00000100:00100000:3.0:1746147259.909689:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467119616:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147259.909707:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec72a00/0xb4b2209fbdad210e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5a5 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.909720:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec72a00/0xb4b2209fbdad210e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5a5 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.909730:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec72a00, rc 0) 00000100:00100000:3.0:1746147259.909750:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465923840:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2371us (2430us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147259.909754:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16043 00000100:00100000:2.0:1746147259.909780:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467119744:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.909885:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2107 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed597 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.909894:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad2107 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed597 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.909900:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd800, rc 0) 00000100:00100000:2.0:1746147259.909923:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465923584:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2554us (2631us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.909928:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16042 00000100:00100000:1.0:1746147259.913582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.913609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.913666:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465924224 00000100:00100000:2.0:1746147259.913673:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465924224 00000100:00100000:0.0:1746147259.913756:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16047 00000100:00100000:0.0:1746147259.913764:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32119:x1830967465924224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.913779:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.913792:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5ba expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.913820:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.913826:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147259.913828:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147259.913836:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.913861:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.913871:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 40 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147259.913881:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467119872:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.914008:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465924480 00000100:00100000:3.0:1746147259.914012:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465924480 00000100:00100000:0.0:1746147259.914031:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147259.914111:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11540 00000100:00100000:1.0:1746147259.914117:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32120:x1830967465924480:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147259.914126:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.914136:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad2131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5c1 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.914206:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.914217:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.914222:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.914239:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 12 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.914246:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 12 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.914253:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467120000:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.914321:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.916476:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467119872:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.916502:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.916516:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094682600, rc 0) 00000100:00100000:2.0:1746147259.916638:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32119:x1830967465924224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2874us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.916645:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16047 00000100:00100000:0.0:1746147259.916681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.917051:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465924608 00000100:00100000:3.0:1746147259.917056:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465924608 00002000:00100000:3.0:1746147259.917099:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1748991) req@ffff88012c9f0700 x1830967465924608/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.917107:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0700 with x1830967465924608 ext(1048576->1748991) 00010000:00010000:3.0:1746147259.917113:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.917123:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.917129:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f0700 00000100:00100000:3.0:1746147259.917145:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2608 00000100:00100000:3.0:1746147259.917151:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465924608:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147259.917162:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467120000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.917178:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147259.920207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.920533:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465924736 00000100:00100000:2.0:1746147259.920541:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465924736 00010000:00010000:2.0:1746147259.920570:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 13 pid: 23726 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.920603:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8192 00000100:00100000:2.0:1746147259.920608:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465924736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.920618:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.920622:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 13 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.920631:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 13 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.920646:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdad20f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed589 expref: 13 pid: 23726 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.920667:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147259.920671:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.920681:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.920686:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.922013:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.922060:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465924736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1448us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.922068:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8192 00010000:00010000:1.0:1746147259.922269:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.922277:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147259.922293:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:1.0:1746147259.922402:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7c800/0xb4b2209fbdad2131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5c1 expref: 13 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.922432:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5c1 expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.922438:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.922441:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147259.922443:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7d000, rc 0) 00000100:00100000:1.0:1746147259.922473:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32120:x1830967465924480:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8357us (8864us total) trans 8589945558 rc 0/0 00000100:00100000:1.0:1746147259.922478:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11540 00000100:00100000:0.0:1746147259.925364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.928598:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465924992 00000100:00100000:1.0:1746147259.928609:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465924992 00000100:00100000:1.0:1746147259.928657:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11541 00000100:00100000:1.0:1746147259.928663:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32120:x1830967465924992:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147259.928681:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.928684:0:14047:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147259.928702:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7d000/0xb4b2209fbdad2138 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5c1 expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.928718:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.928721:0:14047:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147259.928730:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093854e00/0xb4b2209fbdad2146 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5c8 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.928792:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928801:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928810:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928818:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928823:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928828:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928832:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e6eb200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147259.928835:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928840:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928847:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.928849:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147259.928851:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928856:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb200/0xb4b2209fbdad214d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.928876:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093854e00/0xb4b2209fbdad2146 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5c8 expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.928883:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093854e00/0xb4b2209fbdad2146 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5c8 expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.928893:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854e00, rc 0) 00000100:00100000:1.0:1746147259.928950:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32120:x1830967465924992:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 273us (3580us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.928955:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11541 00000100:00100000:3.0:1746147259.932050:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465924608:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14891us (15360us total) trans 21474841458 rc 0/0 00000100:00100000:3.0:1746147259.932061:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2608 00002000:00100000:3.0:1746147259.932074:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1748991) req@ffff88012c9f0700 x1830967465924608/t21474841458(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.932083:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0700 with x1830967465924608 ext(1048576->1748991) 00010000:00010000:3.0:1746147259.932099:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746147259.932112:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746147259.932117:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f0700 00000100:00100000:0.0:1746147259.935540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.935694:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465925120 00000100:00100000:2.0:1746147259.935701:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465925120 00000100:00100000:2.0:1746147259.936905:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16048 00000100:00100000:2.0:1746147259.936915:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:32118:x1830967465925120:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147259.936930:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147259.936960:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5cf expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.936983:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.936992:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.936999:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.937004:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.937006:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.937009:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3735552->4194303] (req 3735552->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.937033:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.937042:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 27 pid: 11147 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.937052:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467120128:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.937157:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 9 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.937165:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 9 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746147259.937173:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467120256:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.937196:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.937203:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.937210:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467120384:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.937224:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.941466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.941610:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467120128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.941642:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467120256:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147259.941664:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467120384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147259.941700:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3735552->4194303] (req 3735552->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.941714:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dcd400, rc 0) 00000100:00100000:2.0:1746147259.941756:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:32118:x1830967465925120:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4843us (6222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.941771:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16048 00000100:00100000:2.0:1746147259.941849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.941868:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465925760 00000100:00100000:2.0:1746147259.941872:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465925760 00010000:00010000:2.0:1746147259.941891:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746147259.941925:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8193 00000100:00100000:2.0:1746147259.941931:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967465925760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.941959:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.941979:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.941987:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.942004:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dcc00/0xb4b2209fbdad1fd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1748991) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4da expref: 43 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.942016:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465925376 00000100:00100000:3.0:1746147259.942022:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465925376 00010000:00010000:2.0:1746147259.942024:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.942026:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.942031:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 33 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.942038:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 33 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147259.942064:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 33 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.942073:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467120512:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147259.942120:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147259.942219:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4840 00000100:00100000:3.0:1746147259.942225:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32120:x1830967465925376:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147259.942370:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32120:x1830967465925376:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 144us (909us total) trans 8589945559 rc 0/0 00000100:00100000:3.0:1746147259.942375:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4840 00000100:00100000:0.0:1746147259.942796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.942927:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465925632 00000100:00100000:1.0:1746147259.942932:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465925632 00000100:00100000:0.0:1746147259.942967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.942979:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11542 00000100:00100000:0.0:1746147259.942983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.942984:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32122:x1830967465925632:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147259.942995:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147259.943002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147259.943006:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad215b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5d6 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.943056:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465926016 00000100:00100000:2.0:1746147259.943059:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465926016 00010000:00010000:2.0:1746147259.943072:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 28 pid: 11147 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.943080:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943096:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465925888 00000100:00100000:2.0:1746147259.943098:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465925888 00010000:00010000:1.0:1746147259.943101:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943106:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.943109:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943116:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465926144 00000100:00100000:2.0:1746147259.943118:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465926144 00010000:00010000:1.0:1746147259.943121:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943124:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.943126:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943131:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943138:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8194 00000100:00100000:2.0:1746147259.943142:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967465926016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.943149:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147259.943160:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 28 pid: 11147 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.943167:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 28 pid: 11147 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.943179:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f2600/0xb4b2209fbdad202e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed527 expref: 28 pid: 11147 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.943188:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.943206:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465926016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.943211:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8194 00010000:00010000:1.0:1746147259.943212:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943218:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943221:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8195 00010000:00010000:1.0:1746147259.943224:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943225:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465925888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.943231:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:1.0:1746147259.943231:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147259.943236:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.943243:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.943256:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7ca00/0xb4b2209fbdad2123 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ac expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746147259.943263:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.943276:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465925888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.943280:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8195 00000100:00100000:2.0:1746147259.943288:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8196 00000100:00100000:2.0:1746147259.943292:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967465926144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147259.943297:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.943301:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943302:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.943307:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943310:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.943312:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943317:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e8e4000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147259.943318:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094683000/0xb4b2209fbdad2027 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed520 expref: 40 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.943320:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943325:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.943325:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943327:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147259.943330:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.943332:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147259.943334:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147259.943337:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.943337:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943341:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4000/0xb4b2209fbdad2162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147259.943356:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.943356:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943360:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943364:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943365:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467120640:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147259.943367:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e8e4200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147259.943369:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943372:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943377:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98ff00) 00010000:00010000:1.0:1746147259.943379:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147259.943381:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147259.943385:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4200/0xb4b2209fbdad2169 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147259.943396:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23de40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147259.943409:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad215b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 19 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.943418:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 18 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.943423:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147259.943425:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147259.943427:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e8e4400, rc 0) 00000100:00100000:1.0:1746147259.943445:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32122:x1830967465925632:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 461us (650us total) trans 8589945560 rc 0/0 00000100:00100000:1.0:1746147259.943450:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11542 00000100:00100000:2.0:1746147259.946174:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467120640:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.946188:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147259.946217:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465926144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2924us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.946225:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8196 00000100:00100000:2.0:1746147259.946457:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467120512:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147259.946468:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.946491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.946497:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967465925760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4567us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147259.946503:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8193 00000100:00100000:3.0:1746147259.946596:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465926400 00000100:00100000:3.0:1746147259.946602:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465926400 00002000:00100000:3.0:1746147259.946630:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3735552->3739647) req@ffff88012df79500 x1830967465926400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.946639:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967465926400 ext(3735552->3739647) 00002000:00010000:3.0:1746147259.946643:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79500 00000100:00100000:3.0:1746147259.946669:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7638 00000100:00100000:3.0:1746147259.946675:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465926400:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147259.947102:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967465926400:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 414us (598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147259.947108:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7638 00002000:00100000:3.0:1746147259.947113:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3735552->3739647) req@ffff88012df79500 x1830967465926400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.947120:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967465926400 ext(3735552->3739647) 00002000:00010000:3.0:1746147259.947123:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79500 00000100:00100000:0.0:1746147259.949318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147259.950293:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465926656 00000100:00100000:3.0:1746147259.950301:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465926656 00002000:00100000:3.0:1746147259.950335:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df7aa00 x1830967465926656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.950344:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7aa00 with x1830967465926656 ext(1048576->2097151) 00002000:00010000:3.0:1746147259.950349:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7aa00 00000100:00100000:3.0:1746147259.950371:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7639 00000100:00100000:3.0:1746147259.950377:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465926656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147259.953863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.953913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.953988:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465926912 00000100:00100000:3.0:1746147259.953995:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465927040 00000100:00100000:2.0:1746147259.953995:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465926912 00000100:00100000:3.0:1746147259.954001:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465927040 00002000:00100000:2.0:1746147259.954029:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df78000 x1830967465926912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 504/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.954038:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78000 with x1830967465926912 ext(1048576->2097151) 00002000:00010000:2.0:1746147259.954043:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df78000 00000100:00100000:3.0:1746147259.954068:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16049 00000100:00100000:3.0:1746147259.954078:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32118:x1830967465927040:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147259.954123:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147259.954141:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5dd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.954193:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.954208:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.954215:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.954221:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.954223:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147259.954226:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3391487] (req 3145728->3391487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147259.954302:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7640 00000100:00100000:2.0:1746147259.954308:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465926912:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147259.954835:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.954847:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 35 pid: 8480 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.954858:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467120768:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.954914:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147259.954922:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 10 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746147259.954930:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467120896:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147259.954969:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147259.954976:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746147259.954983:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467121024:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147259.954993:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.961692:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467120768:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.961705:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467120896:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147259.961712:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467121024:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147259.961739:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [3145728->3391487] (req 3145728->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147259.961752:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec72e00, rc 0) 00000100:00100000:0.0:1746147259.961788:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:32118:x1830967465927040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7712us (7875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.961795:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16049 00000100:00100000:3.0:1746147259.962166:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465926656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11787us (12852us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147259.962173:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7639 00002000:00100000:3.0:1746147259.962180:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012df7aa00 x1830967465926656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 488/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147259.962188:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7aa00 with x1830967465926656 ext(1048576->2097151) 00002000:00010000:3.0:1746147259.962191:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7aa00 00000100:00100000:2.0:1746147259.963424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.963481:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465927296 00000100:00100000:0.0:1746147259.963488:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465927296 00010000:00010000:0.0:1746147259.963512:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746147259.963568:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8197 00000100:00100000:0.0:1746147259.963575:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465927296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147259.963585:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147259.963604:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.963613:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.963630:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7c000/0xb4b2209fbdad2115 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5b3 expref: 11 pid: 17530 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746147259.963768:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147259.963880:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465927296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 304us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147259.963886:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8197 00000100:00100000:0.0:1746147259.966076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.966117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.966177:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465927168 00000100:00100000:1.0:1746147259.966184:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465927168 00010000:00010000:1.0:1746147259.966208:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 34 pid: 8480 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746147259.966226:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465927424 00000100:00100000:1.0:1746147259.966228:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465927424 00010000:00010000:1.0:1746147259.966237:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.966248:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8198 00000100:00100000:1.0:1746147259.966254:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1956:x1830967465927168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.966269:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.966287:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 34 pid: 8480 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.966296:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 34 pid: 8480 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.966312:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ac4000/0xb4b2209fbdad20d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed57b expref: 34 pid: 8480 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746147259.966329:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.966362:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465927168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.966369:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8198 00000100:00100000:1.0:1746147259.966391:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8199 00000100:00100000:1.0:1746147259.966396:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465927424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147259.966402:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147259.966409:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.966417:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.966429:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdad2043 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed53c expref: 43 pid: 21080 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147259.966438:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.966440:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147259.966445:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.966452:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.966476:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147259.966487:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467121152:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147259.966531:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.967770:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967465926912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13458us (13911us total) trans 0 rc 1040384/1040384 00000100:00100000:0.0:1746147259.967779:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7640 00002000:00100000:0.0:1746147259.967787:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df78000 x1830967465926912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:635/0 lens 504/440 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147259.967795:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78000 with x1830967465926912 ext(1048576->2097151) 00002000:00010000:0.0:1746147259.967798:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df78000 00000100:00100000:1.0:1746147259.972324:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467121152:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147259.972343:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147259.972388:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465927424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5990us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.972399:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8199 00000100:00100000:0.0:1746147259.973202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147259.973369:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465927680 00000100:00100000:2.0:1746147259.973375:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465927680 00002000:00100000:2.0:1746147259.973407:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3387392->3391487) req@ffff88012df7b480 x1830967465927680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.973416:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b480 with x1830967465927680 ext(3387392->3391487) 00002000:00010000:2.0:1746147259.973420:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7b480 00000100:00100000:2.0:1746147259.973603:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7641 00000100:00100000:2.0:1746147259.973609:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465927680:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147259.974713:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967465927680:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1099us (1510us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147259.974721:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7641 00002000:00100000:2.0:1746147259.974728:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3387392->3391487) req@ffff88012df7b480 x1830967465927680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746147270 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.974737:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b480 with x1830967465927680 ext(3387392->3391487) 00002000:00010000:2.0:1746147259.974741:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7b480 00000100:00100000:0.0:1746147259.980569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.981037:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465927936 00000100:00100000:1.0:1746147259.981046:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465927936 00000100:00100000:1.0:1746147259.981106:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4841 00000100:00100000:1.0:1746147259.981114:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32118:x1830967465927936:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147259.981302:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32118:x1830967465927936:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 188us (740us total) trans 8589945561 rc 0/0 00000100:00100000:1.0:1746147259.981308:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4841 00000100:00100000:2.0:1746147259.982885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.982925:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465928064 00000100:00100000:2.0:1746147259.982926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147259.982931:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465928064 00000100:00100000:0.0:1746147259.982997:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465928192 00000100:00100000:0.0:1746147259.982999:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465928192 00000100:00100000:0.0:1746147259.983014:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16050 00000100:00100000:0.0:1746147259.983020:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465928064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.983031:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.983044:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2185 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5e4 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.983083:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467121280:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147259.983157:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16051 00000100:00100000:0.0:1746147259.983163:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465928192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147259.983169:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147259.983177:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad218c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5eb expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147259.983196:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467121408:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147259.983991:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.984260:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147259.986671:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467121280:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147259.986697:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2185 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5e4 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.986709:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f891200/0xb4b2209fbdad2185 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5e4 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147259.986731:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f891200, rc 0) 00000100:00100000:2.0:1746147259.986763:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967465928064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3743us (3882us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147259.986770:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16050 00000100:00100000:1.0:1746147259.986992:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467121408:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147259.987007:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad218c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5eb expref: 34 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.987015:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad218c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5eb expref: 34 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147259.987024:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890400, rc 0) 00000100:00100000:1.0:1746147259.987039:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465928192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3877us (4113us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147259.987044:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16051 00000100:00100000:0.0:1746147259.991574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.991729:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465928320 00000100:00100000:1.0:1746147259.991737:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465928320 00000100:00100000:1.0:1746147259.992473:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16052 00000100:00100000:1.0:1746147259.992481:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32119:x1830967465928320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147259.992497:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147259.992513:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5f2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.992538:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 38 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.992545:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.992546:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147259.992550:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.992574:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 38 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.992584:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 38 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746147259.992594:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467121536:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147259.992665:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147259.995183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147259.995321:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467121536:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147259.995346:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147259.995369:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f740800, rc 0) 00000100:00100000:2.0:1746147259.995397:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465928448 00000100:00100000:2.0:1746147259.995403:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465928448 00000100:00100000:1.0:1746147259.995412:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32119:x1830967465928320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2932us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147259.995419:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16052 00002000:00100000:2.0:1746147259.995433:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3735552->4194303) req@ffff88012df78380 x1830967465928448/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/0 e 0 to 0 dl 1746147270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147259.995441:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78380 with x1830967465928448 ext(3735552->4194303) 00010000:00010000:2.0:1746147259.995446:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147259.995456:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 39 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147259.995461:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df78380 00000100:00100000:2.0:1746147259.996239:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2609 00000100:00100000:2.0:1746147259.996246:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967465928448:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147260.005886:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465928448:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9633us (10702us total) trans 17179874103 rc 0/0 00000100:00100000:2.0:1746147260.005897:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2609 00002000:00100000:2.0:1746147260.005906:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3735552->4194303) req@ffff88012df78380 x1830967465928448/t17179874103(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:635/0 lens 488/448 e 0 to 0 dl 1746147270 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.005920:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78380 with x1830967465928448 ext(3735552->4194303) 00010000:00010000:2.0:1746147260.005928:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746147260.005961:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746147260.005968:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012df78380 00000100:00100000:0.0:1746147260.010003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.010287:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465928576 00000100:00100000:1.0:1746147260.010295:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465928576 00010000:00010000:1.0:1746147260.010332:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746147260.010356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:2.0:1746147260.010747:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147260.011040:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8200 00000100:00100000:1.0:1746147260.011050:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465928576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.011064:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.011085:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147260.011106:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147260.011126:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dcd400/0xb4b2209fbdad2154 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3735552->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5cf expref: 41 pid: 6881 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746147260.011152:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.011154:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.011161:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.011172:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.011200:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147260.011211:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467121664:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.011317:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465928832 00000100:00100000:3.0:1746147260.011322:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465928832 00000100:00100000:3.0:1746147260.011355:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11543 00000100:00100000:3.0:1746147260.011362:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32127:x1830967465928832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.011377:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.011389:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad219a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed5f9 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.011479:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011489:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011497:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011593:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011599:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011604:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011702:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011710:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.011716:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147260.011822:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00080000:2.0:1746147260.011926:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1746147260.012196:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.012270:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012276:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012284:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012288:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbf000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.012291:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012296:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012304:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147260.012306:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.012309:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012313:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad21a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012339:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012343:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012348:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012351:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbf200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.012353:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012357:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012365:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473200) 00010000:00010000:3.0:1746147260.012367:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.012369:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012373:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad21a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.012408:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad219a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 314 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.012418:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 313 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.012423:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.012425:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147260.012427:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbf400, rc 0) 00000100:00100000:3.0:1746147260.012474:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32127:x1830967465928832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1113us (2117us total) trans 8589945562 rc 0/0 00000100:00100000:3.0:1746147260.012481:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11543 00010000:00010000:2.0:1746147260.015169:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147260.018988:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467121664:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147260.019007:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.019152:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465928576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8103us (9154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.019160:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8200 00000100:00100000:0.0:1746147260.020269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.020378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.020454:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929344 00000100:00100000:3.0:1746147260.020463:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929344 00000100:00100000:3.0:1746147260.020513:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4842 00000100:00100000:3.0:1746147260.020520:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32127:x1830967465929344:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147260.020681:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+314:32127:x1830967465929344:12345-192.168.203.36@tcp:35:cat.0 Request processed in 160us (301us total) trans 8589945563 rc 0/0 00000100:00100000:3.0:1746147260.020687:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4842 00000100:00100000:3.0:1746147260.020708:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929088 00000100:00100000:3.0:1746147260.020711:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929088 00002000:00100000:3.0:1746147260.020730:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012df79f80 x1830967465929088/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.020739:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79f80 with x1830967465929088 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.020743:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79f80 00000100:00100000:3.0:1746147260.020754:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7642 00000100:00100000:3.0:1746147260.020759:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465929088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.027292:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967465929088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6522us (9823us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.027304:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7642 00002000:00100000:3.0:1746147260.027317:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012df79f80 x1830967465929088/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.027326:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79f80 with x1830967465929088 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.027332:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79f80 00000100:00100000:1.0:1746147260.029054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.029139:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929472 00000100:00100000:2.0:1746147260.029145:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929472 00000100:00100000:2.0:1746147260.029186:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16053 00000100:00100000:2.0:1746147260.029191:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967465929472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.029201:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.029213:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed600 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.029229:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.029230:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.029235:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.029245:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.029256:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73c00, rc 0) 00000100:00100000:2.0:1746147260.029297:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967465929472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.029300:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16053 00000100:00100000:0.0:1746147260.029901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.029962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.029997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.030051:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929600 00000100:00100000:1.0:1746147260.030054:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929600 00000100:00100000:1.0:1746147260.030078:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929856 00000100:00100000:1.0:1746147260.030080:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929856 00000100:00100000:1.0:1746147260.030098:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929728 00000100:00100000:1.0:1746147260.030099:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929728 00000100:00100000:1.0:1746147260.030116:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16054 00000100:00100000:1.0:1746147260.030122:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465929600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.030134:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.030143:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed607 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.030160:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.030162:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.030166:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 43 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.030175:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 43 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.030183:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f741600, rc 0) 00000100:00100000:2.0:1746147260.030193:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16055 00000100:00100000:2.0:1746147260.030204:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465929856:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147260.030206:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465929600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 84us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.030212:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16054 00010000:00010000:2.0:1746147260.030219:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147260.030230:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16056 00010000:00010000:2.0:1746147260.030233:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed615 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147260.030235:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465929728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.030241:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.030248:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f740c00/0xb4b2209fbdad21d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed60e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.030251:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.030253:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.030260:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 44 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.030273:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 44 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147260.030276:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467121792:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147260.030283:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d73600, rc 0) 00000100:00100000:1.0:1746147260.030319:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00080000:3.0:1746147260.030435:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147260.030606:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465929856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 403us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.030622:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16055 00000100:00100000:1.0:1746147260.032555:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467121792:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147260.032586:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f740c00/0xb4b2209fbdad21d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed60e expref: 43 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.032599:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f740c00/0xb4b2209fbdad21d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed60e expref: 43 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.032727:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f740c00, rc 0) 00000100:00100000:1.0:1746147260.032773:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465929728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2536us (2774us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147260.032781:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16056 00000100:00100000:0.0:1746147260.038695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.038781:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465929984 00000100:00100000:1.0:1746147260.038788:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465929984 00000100:00100000:1.0:1746147260.038960:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16057 00000100:00100000:1.0:1746147260.038969:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32119:x1830967465929984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.038983:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.038996:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed61c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.039018:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.039025:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.039027:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.039030:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.039054:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.039064:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 42 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.039079:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467121920:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.039165:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.044156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.044192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.044230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.044252:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465930112 00000100:00100000:0.0:1746147260.044259:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465930112 00000100:00100000:2.0:1746147260.044261:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465930368 00000100:00100000:2.0:1746147260.044270:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465930368 00002000:00100000:0.0:1746147260.044298:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3391487) req@ffff88009b40b800 x1830967465930112/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.044304:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008e975f80 x1830967465930368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.044306:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40b800 with x1830967465930112 ext(3145728->3391487) 00002000:00100000:2.0:1746147260.044314:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975f80 with x1830967465930368 ext(0->1048575) 00010000:00010000:0.0:1746147260.044314:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 43 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.044318:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975f80 00010000:00010000:0.0:1746147260.044327:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 43 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:0.0:1746147260.044334:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b40b800 00000100:00100000:2.0:1746147260.044356:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465930624 00000100:00100000:2.0:1746147260.044359:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465930624 00002000:00100000:2.0:1746147260.044373:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e975180 x1830967465930624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.044379:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975180 with x1830967465930624 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.044381:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e975180 00000100:00100000:2.0:1746147260.044394:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2610 00000100:00100000:2.0:1746147260.044400:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465930112:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147260.044411:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467121920:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.044431:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.044443:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f741800, rc 0) 00000100:00100000:1.0:1746147260.044481:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32119:x1830967465929984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5514us (5793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.044487:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16057 00000100:00100000:3.0:1746147260.044568:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7643 00000100:00100000:3.0:1746147260.044577:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465930368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147260.044691:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7644 00000100:00100000:2.0:1746147260.044696:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465930624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.054773:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465930368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10190us (10572us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.054784:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7643 00002000:00100000:3.0:1746147260.054795:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008e975f80 x1830967465930368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.054802:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975f80 with x1830967465930368 ext(0->1048575) 00002000:00010000:3.0:1746147260.054807:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975f80 00000100:00100000:2.0:1746147260.055389:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967465930112:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10988us (11239us total) trans 21474841459 rc 0/0 00000100:00100000:2.0:1746147260.055397:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2610 00002000:00100000:2.0:1746147260.055403:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3391487) req@ffff88009b40b800 x1830967465930112/t21474841459(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.055410:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40b800 with x1830967465930112 ext(3145728->3391487) 00010000:00010000:2.0:1746147260.055418:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 47 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.055431:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 47 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.055442:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b40b800 00000100:00100000:2.0:1746147260.055813:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465930624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11116us (11581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.055819:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7644 00002000:00100000:2.0:1746147260.055825:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e975180 x1830967465930624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.055831:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975180 with x1830967465930624 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.055835:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e975180 00000100:00100000:0.0:1746147260.058532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.058728:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465930752 00000100:00100000:1.0:1746147260.058740:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465930752 00010000:00010000:1.0:1746147260.058780:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 45 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.058887:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8201 00000100:00100000:1.0:1746147260.058896:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465930752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.058911:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.058934:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 45 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.058992:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 45 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.059022:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec72e00/0xb4b2209fbdad217e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3391487) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5dd expref: 45 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.059062:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.059065:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.059073:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.059083:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.059133:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147260.059146:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467122048:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147260.059238:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.062547:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467122048:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147260.062569:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.062623:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465930752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3726us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.062633:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8201 00000100:00100000:0.0:1746147260.068472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.068512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.068534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.068543:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465930880 00000100:00100000:1.0:1746147260.068553:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465930880 00000100:00100000:0.0:1746147260.068556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.068584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.068592:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465931776 00000100:00100000:1.0:1746147260.068593:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465931776 00000100:00100000:0.0:1746147260.068604:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16058 00000100:00100000:1.0:1746147260.068610:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16059 00000100:00100000:0.0:1746147260.068612:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32122:x1830967465930880:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:1.0:1746147260.068616:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32127:x1830967465931776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.068629:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147260.068629:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.068645:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed62a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.068645:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed623 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.068671:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.068671:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.068678:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147260.068679:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.068680:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.068683:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.068689:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.068690:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.068693:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3022847] (req 2166784->3022847) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.068700:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465931136 00000100:00100000:2.0:1746147260.068705:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465931136 00010000:00010000:0.0:1746147260.068709:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.068710:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.068719:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 29 pid: 17530 timeout: 747 lvb_type: 0 00002000:00100000:2.0:1746147260.068735:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e974a80 x1830967465931136/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.068745:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974a80 with x1830967465931136 ext(2097152->3145727) 00002000:00010000:2.0:1746147260.068754:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974a80 00000100:00100000:2.0:1746147260.068767:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465931392 00000100:00100000:3.0:1746147260.068769:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465931648 00000100:00100000:2.0:1746147260.068769:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465931392 00000100:00100000:3.0:1746147260.068772:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465931648 00002000:00100000:2.0:1746147260.068780:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e974700 x1830967465931392/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.068787:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974700 with x1830967465931392 ext(3145728->4194303) 00002000:00100000:3.0:1746147260.068789:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e977480 x1830967465931648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746147260.068790:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974700 00002000:00100000:3.0:1746147260.068796:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967465931648 ext(3145728->4194303) 00010000:00010000:3.0:1746147260.068801:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.068801:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7645 00000100:00100000:2.0:1746147260.068807:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967465931136:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:0.0:1746147260.068871:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746147260.068882:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467122176:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.068907:0:8486:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147260.068913:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e977480 00000100:00100000:3.0:1746147260.068927:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2611 00000100:00100000:3.0:1746147260.068932:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967465931648:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:0.0:1746147260.068973:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.068981:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 30 pid: 21080 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.068989:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467122432:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147260.069006:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.069243:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7646 00000100:00100000:0.0:1746147260.069249:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967465931392:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147260.069299:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467122304:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.069325:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.070047:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467122432:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147260.070099:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467122176:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147260.070173:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3022847] (req 2166784->3022847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.070185:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093854c00, rc 0) 00000100:00100000:0.0:1746147260.070211:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32122:x1830967465930880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1599us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.070217:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16058 00000100:00100000:2.0:1746147260.070991:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467122304:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.071010:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.071021:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1515e00, rc 0) 00000100:00100000:2.0:1746147260.071051:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:32127:x1830967465931776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2434us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.071058:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16059 00000100:00100000:0.0:1746147260.071523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.071558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.071585:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465931904 00000100:00100000:2.0:1746147260.071588:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465932032 00000100:00100000:1.0:1746147260.071591:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465931904 00000100:00100000:2.0:1746147260.071599:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465932032 00010000:00010000:1.0:1746147260.071614:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.071640:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8202 00002000:00100000:2.0:1746147260.071643:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1798144->1806335) req@ffff88008e974e00 x1830967465932032/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 8680/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147260.071646:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465931904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746147260.071651:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967465932032 ext(1798144->1806335) 00010000:00010000:1.0:1746147260.071658:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147260.071659:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 31 pid: 17530 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.071670:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 31 pid: 17530 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.071676:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 747 lvb_type: 1 00002000:00010000:2.0:1746147260.071677:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e974e00 00010000:00010000:1.0:1746147260.071684:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.071703:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73600/0xb4b2209fbdad21cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed615 expref: 43 pid: 21080 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746147260.071710:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2612 00000100:00100000:2.0:1746147260.071717:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465932032:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:1.0:1746147260.071719:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.071762:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967465931904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.071768:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8202 00000100:00100000:2.0:1746147260.072107:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465932032:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 388us (583us total) trans 17179874104 rc 0/0 00000100:00100000:2.0:1746147260.072113:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2612 00002000:00100000:2.0:1746147260.072118:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1798144->1806335) req@ffff88008e974e00 x1830967465932032/t17179874104(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 8680/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.072126:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967465932032 ext(1798144->1806335) 00010000:00010000:2.0:1746147260.072131:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 33 pid: 17530 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.072138:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 33 pid: 17530 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.072143:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e974e00 00000100:00100000:2.0:1746147260.075480:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1956:x1830967465931136:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 6636us (6930us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.075491:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7645 00002000:00100000:2.0:1746147260.075501:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e974a80 x1830967465931136/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.075511:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974a80 with x1830967465931136 ext(2097152->3145727) 00002000:00010000:2.0:1746147260.075516:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974a80 00000100:00100000:1.0:1746147260.078506:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1956:x1830967465931392:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9250us (9963us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.078516:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7646 00002000:00100000:1.0:1746147260.078526:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e974700 x1830967465931392/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.078534:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974700 with x1830967465931392 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.078539:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974700 00000100:00100000:0.0:1746147260.079262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.079347:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465932160 00000100:00100000:3.0:1746147260.079359:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465932160 00010000:00010000:3.0:1746147260.079402:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 33 pid: 17530 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.079576:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8203 00000100:00100000:3.0:1746147260.079586:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465932160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.079600:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.079619:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 33 pid: 17530 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.079634:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 33 pid: 17530 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.079651:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093854200/0xb4b2209fbdad207b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1798144->1806335) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed558 expref: 33 pid: 17530 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.079676:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.079678:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.079684:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 41 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.079691:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 41 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.079718:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 41 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.079728:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467122560:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.079780:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.081834:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465931648:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12897us (13272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.081840:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2611 00002000:00100000:3.0:1746147260.081846:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e977480 x1830967465931648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.081852:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967465931648 ext(3145728->4194303) 00010000:00010000:3.0:1746147260.081858:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 31 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.081866:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 31 pid: 21080 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746147260.081870:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e977480 00000100:00100000:3.0:1746147260.082858:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467122560:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147260.082872:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.082904:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465932160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3321us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.082911:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8203 00000100:00100000:0.0:1746147260.083669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.083841:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465932288 00000100:00100000:2.0:1746147260.083847:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465932288 00000100:00100000:2.0:1746147260.083879:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16060 00000100:00100000:2.0:1746147260.083885:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32119:x1830967465932288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.083897:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.083910:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed631 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.083928:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.083930:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.084138:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.084155:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.084165:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c53600, rc 0) 00000100:00100000:2.0:1746147260.084322:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32119:x1830967465932288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 435us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.084328:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16060 00000100:00100000:0.0:1746147260.084460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.084603:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465932416 00000100:00100000:3.0:1746147260.084607:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465932416 00010000:00010000:3.0:1746147260.084621:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 31 pid: 21080 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.084648:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8204 00000100:00100000:3.0:1746147260.084653:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465932416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.084661:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.084676:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 31 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.084685:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 31 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.084700:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f740800/0xb4b2209fbdad2193 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f2 expref: 31 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.084723:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.084725:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.084729:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.084735:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.084757:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.084766:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467122688:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.084828:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.085489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.085545:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465932672 00000100:00100000:3.0:1746147260.085549:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465932672 00002000:00100000:3.0:1746147260.085571:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e977800 x1830967465932672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.085579:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967465932672 ext(1048576->2097151) 00002000:00010000:3.0:1746147260.085582:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:3.0:1746147260.085650:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7647 00000100:00100000:3.0:1746147260.085657:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465932672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.086297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.086611:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467122688:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.086623:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.086743:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465932928 00000100:00100000:1.0:1746147260.086747:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465932928 00002000:00100000:1.0:1746147260.086764:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2166784->2170879) req@ffff88008e975500 x1830967465932928/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.086776:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975500 with x1830967465932928 ext(2166784->2170879) 00002000:00010000:1.0:1746147260.086779:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975500 00000100:00100000:1.0:1746147260.086792:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7648 00000100:00100000:1.0:1746147260.086796:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967465932928:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147260.087003:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967465932416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2349us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.087010:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8204 00000100:00100000:1.0:1746147260.087219:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465932928:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 420us (921us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147260.087224:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7648 00002000:00100000:1.0:1746147260.087229:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2166784->2170879) req@ffff88008e975500 x1830967465932928/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.087236:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975500 with x1830967465932928 ext(2166784->2170879) 00002000:00010000:1.0:1746147260.087238:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975500 00000100:00100000:1.0:1746147260.087980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.088425:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465933184 00000100:00100000:2.0:1746147260.088430:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465933184 00002000:00100000:2.0:1746147260.088455:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094d79180 x1830967465933184/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.088463:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79180 with x1830967465933184 ext(3145728->4194303) 00002000:00010000:2.0:1746147260.088466:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79180 00000100:00100000:2.0:1746147260.088488:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7649 00000100:00100000:2.0:1746147260.088494:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465933184:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.095791:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465932672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10125us (10294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.095801:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7647 00002000:00100000:3.0:1746147260.095811:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e977800 x1830967465932672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.095819:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967465932672 ext(1048576->2097151) 00002000:00010000:3.0:1746147260.095824:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:0.0:1746147260.097117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.097225:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465933440 00000100:00100000:3.0:1746147260.097232:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465933440 00002000:00100000:3.0:1746147260.097262:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3018752->3022847) req@ffff88008e976680 x1830967465933440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.097270:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967465933440 ext(3018752->3022847) 00002000:00010000:3.0:1746147260.097274:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:3.0:1746147260.097294:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7650 00000100:00100000:3.0:1746147260.097300:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465933440:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.097431:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465933440:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 131us (317us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147260.097436:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7650 00002000:00100000:3.0:1746147260.097441:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3018752->3022847) req@ffff88008e976680 x1830967465933440/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.097448:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967465933440 ext(3018752->3022847) 00002000:00010000:3.0:1746147260.097450:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:3.0:1746147260.097975:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967465933184:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9480us (9995us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.097980:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7649 00002000:00100000:3.0:1746147260.097985:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880094d79180 x1830967465933184/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.097995:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79180 with x1830967465933184 ext(3145728->4194303) 00002000:00010000:3.0:1746147260.097998:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d79180 00000100:00100000:0.0:1746147260.099790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.099837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.099871:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465933568 00000100:00100000:2.0:1746147260.099885:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465933568 00000100:00100000:2.0:1746147260.099927:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465933696 00000100:00100000:2.0:1746147260.099930:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465933696 00000100:00100000:1.0:1746147260.099995:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16061 00000100:00100000:1.0:1746147260.100004:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465933568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.100016:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.100031:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6449400/0xb4b2209fbdad21f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed638 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.100067:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6449400/0xb4b2209fbdad21f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed638 expref: 43 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.100083:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6449400/0xb4b2209fbdad21f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed638 expref: 43 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.100123:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6449400, rc 0) 00000100:00100000:1.0:1746147260.100164:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967465933568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 162us (382us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147260.100190:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16062 00000100:00100000:2.0:1746147260.100196:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465933696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.100206:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.100216:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed63f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.100227:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.100229:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.100236:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 45 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.100247:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 45 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.100256:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c53e00, rc 0) 00000100:00100000:2.0:1746147260.100272:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465933696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.100277:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16062 00000100:00100000:1.0:1746147260.100390:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16061 00000100:00100000:1.0:1746147260.102560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.102596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.102632:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465933952 00000100:00100000:1.0:1746147260.102632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.102639:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465933952 00000100:00100000:0.0:1746147260.102640:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934208 00000100:00100000:1.0:1746147260.102647:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934080 00000100:00100000:1.0:1746147260.102650:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934080 00000100:00100000:0.0:1746147260.102650:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934208 00000100:00100000:1.0:1746147260.102676:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16063 00000100:00100000:2.0:1746147260.102680:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4843 00000100:00100000:1.0:1746147260.102681:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465934080:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147260.102686:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32122:x1830967465933952:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147260.102690:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16064 00010000:00010000:1.0:1746147260.102693:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147260.102697:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465934208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.102705:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed646 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.102709:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.102720:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.102722:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.102722:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2d2e00/0xb4b2209fbdad220a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed64d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.102728:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 32 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.102739:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.102746:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6449800, rc 0) 00010000:00010000:0.0:1746147260.102747:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c2d2e00/0xb4b2209fbdad220a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed64d expref: 33 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.102761:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2d2e00/0xb4b2209fbdad220a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed64d expref: 33 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.102779:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d2e00, rc 0) 00000100:00100000:1.0:1746147260.102780:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465934080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.102788:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16063 00000100:00100000:0.0:1746147260.102823:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967465934208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 126us (226us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147260.102826:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32122:x1830967465933952:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 139us (271us total) trans 8589945564 rc 0/0 00000100:00100000:0.0:1746147260.102829:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16064 00000100:00100000:2.0:1746147260.102832:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4843 00000100:00080000:3.0:1746147260.102884:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147260.103917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.103967:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934592 00000100:00100000:2.0:1746147260.103974:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934592 00000100:00100000:2.0:1746147260.104013:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11544 00000100:00100000:2.0:1746147260.104020:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+314:32129:x1830967465934592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147260.104034:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.104047:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53a00/0xb4b2209fbdad2211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed65b expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147260.104054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147260.104139:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.104154:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 18 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.104160:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 315 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.104166:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.104196:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 315 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.104206:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 315 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.104218:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467122816:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.104963:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 18 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.104980:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 18 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.104993:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467122944:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.105064:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.105082:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934336 00000100:00100000:2.0:1746147260.105097:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934336 00000100:00100000:2.0:1746147260.105125:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16065 00000100:00100000:2.0:1746147260.105131:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32127:x1830967465934336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.105141:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.105152:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed654 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.105169:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.105700:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.105702:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.105706:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.105724:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.105733:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 30 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.105747:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467123072:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.105767:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.107968:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467122816:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147260.109076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.109106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.109137:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.109161:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.109168:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934720 00000100:00100000:1.0:1746147260.109175:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934720 00000100:00100000:0.0:1746147260.109182:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465935232 00000100:00100000:0.0:1746147260.109188:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465935232 00010000:00010000:1.0:1746147260.109204:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00002000:00100000:0.0:1746147260.109225:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a4fadc00 x1830967465935232/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147260.109235:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934976 00002000:00100000:0.0:1746147260.109235:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967465935232 ext(4194304->4976639) 00000100:00100000:1.0:1746147260.109238:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934976 00002000:00010000:0.0:1746147260.109239:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fadc00 00010000:00010000:1.0:1746147260.109248:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 19 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.109253:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465934848 00000100:00100000:0.0:1746147260.109255:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465934848 00002000:00100000:0.0:1746147260.109263:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2166784->3022847) req@ffff8800a4faf480 x1830967465934848/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147260.109265:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8205 00000100:00100000:1.0:1746147260.109270:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465934720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746147260.109270:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf480 with x1830967465934848 ext(2166784->3022847) 00010000:00010000:0.0:1746147260.109278:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 32 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.109282:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.109286:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.109290:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 32 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.109295:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00002000:00010000:0.0:1746147260.109296:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4faf480 00000100:00100000:0.0:1746147260.109308:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2613 00000100:00100000:3.0:1746147260.109311:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467122944:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.109311:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf400/0xb4b2209fbdad21af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5f9 expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.109314:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465934848:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:1.0:1746147260.109327:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.109331:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.109337:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.109343:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.109381:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1957:x1830967465934720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (312us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147260.109383:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147260.109387:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8205 00000100:00100000:3.0:1746147260.109402:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7651 00000100:00100000:1.0:1746147260.109404:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8206 00000100:00100000:1.0:1746147260.109408:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967465934976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147260.109409:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967465935232:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:1.0:1746147260.109415:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.109418:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 19 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.109424:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 19 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.109432:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e8e4400/0xb4b2209fbdad2170 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5d6 expref: 19 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.109440:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.109442:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.109447:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.109452:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.109472:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.109487:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967465934976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.109493:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8206 00010000:00010000:3.0:1746147260.109499:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.109504:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147260.109519:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000100:00100000:2.0:1746147260.109520:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467123072:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.109537:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.109551:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c52a00, rc 0) 00000100:00100000:2.0:1746147260.109571:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:32127:x1830967465934336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4440us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.109577:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16065 00010000:00010000:3.0:1746147260.109632:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53a00/0xb4b2209fbdad2211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 316 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.109646:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 315 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.109651:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.109653:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147260.109654:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c53800, rc 0) 00000100:00100000:3.0:1746147260.109674:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+315:32129:x1830967465934592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5655us (5758us total) trans 8589945565 rc 0/0 00000100:00100000:3.0:1746147260.109681:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11544 00000100:00100000:3.0:1746147260.116321:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465935232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6904us (7174us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147260.116331:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7651 00002000:00100000:3.0:1746147260.116340:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a4fadc00 x1830967465935232/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.116348:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967465935232 ext(4194304->4976639) 00002000:00010000:3.0:1746147260.116353:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fadc00 00000100:00100000:1.0:1746147260.119540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.119734:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465935360 00000100:00100000:2.0:1746147260.119743:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465935360 00000100:00100000:2.0:1746147260.119781:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16066 00000100:00100000:2.0:1746147260.119787:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465935360:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.119804:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.119820:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c52800/0xb4b2209fbdad222d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed662 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.119849:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c52800/0xb4b2209fbdad222d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed662 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.119858:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c52800/0xb4b2209fbdad222d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed662 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.119885:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c52800, rc 0) 00000100:00100000:2.0:1746147260.119928:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465935360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (399us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147260.119934:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16066 00000100:00100000:0.0:1746147260.121882:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465934848:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12562us (12714us total) trans 17179874105 rc 0/0 00000100:00100000:0.0:1746147260.121892:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2613 00002000:00100000:0.0:1746147260.121900:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2166784->3022847) req@ffff8800a4faf480 x1830967465934848/t17179874105(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.121910:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf480 with x1830967465934848 ext(2166784->3022847) 00010000:00010000:0.0:1746147260.121918:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 33 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.121930:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 33 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:0.0:1746147260.121947:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4faf480 00000100:00100000:0.0:1746147260.126863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.127219:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465935488 00000100:00100000:1.0:1746147260.127226:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465935488 00000100:00100000:1.0:1746147260.127257:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16067 00000100:00100000:1.0:1746147260.127263:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465935488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.127277:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.127290:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6448c00/0xb4b2209fbdad2234 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed669 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.127315:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6448c00/0xb4b2209fbdad2234 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed669 expref: 34 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.127325:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6448c00/0xb4b2209fbdad2234 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed669 expref: 34 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.127336:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6448c00, rc 0) 00000100:00100000:1.0:1746147260.127369:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967465935488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (514us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147260.127374:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16067 00000100:00100000:0.0:1746147260.128269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.128315:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465935616 00000100:00100000:0.0:1746147260.128318:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465935616 00010000:00010000:0.0:1746147260.128335:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 33 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.128354:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8207 00000100:00100000:0.0:1746147260.128359:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1956:x1830967465935616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.128366:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.128383:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 33 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.128393:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 33 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.128409:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093854c00/0xb4b2209fbdad21e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2166784->3145727] (req 2166784->3022847) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed623 expref: 33 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.128420:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.128422:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.128428:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.128435:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.128460:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147260.128470:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467123200:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147260.128511:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.135447:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467123200:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147260.135464:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.135517:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465935616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7157us (7247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.135526:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8207 00000100:00100000:1.0:1746147260.141866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.141925:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465935872 00000100:00100000:2.0:1746147260.141932:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465935872 00000100:00100000:2.0:1746147260.141979:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4844 00000100:00100000:2.0:1746147260.141985:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32119:x1830967465935872:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147260.142140:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32119:x1830967465935872:12345-192.168.203.36@tcp:35:cat.0 Request processed in 154us (280us total) trans 8589945566 rc 0/0 00000100:00100000:2.0:1746147260.142146:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4844 00000100:00100000:0.0:1746147260.145499:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.145523:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465936128 00000100:00100000:0.0:1746147260.145530:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465936128 00002000:00100000:0.0:1746147260.145565:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012df7b800 x1830967465936128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.145574:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b800 with x1830967465936128 ext(2097152->3145727) 00002000:00010000:0.0:1746147260.145579:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7b800 00000100:00100000:0.0:1746147260.145606:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7652 00000100:00100000:0.0:1746147260.145612:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465936128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.147521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.147554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.147580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.147594:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465936384 00000100:00100000:0.0:1746147260.147599:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465936384 00002000:00100000:0.0:1746147260.147621:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012df7ad80 x1830967465936384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.147630:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7ad80 with x1830967465936384 ext(3145728->4194303) 00002000:00010000:0.0:1746147260.147633:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7ad80 00000100:00100000:0.0:1746147260.147643:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465936640 00000100:00100000:0.0:1746147260.147645:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465936640 00002000:00100000:0.0:1746147260.147652:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012df7b100 x1830967465936640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.147660:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b100 with x1830967465936640 ext(2097152->3145727) 00002000:00010000:0.0:1746147260.147662:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7b100 00000100:00100000:0.0:1746147260.147668:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465936896 00000100:00100000:0.0:1746147260.147669:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465936896 00002000:00100000:0.0:1746147260.147675:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012df78700 x1830967465936896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.147681:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78700 with x1830967465936896 ext(3145728->4194303) 00002000:00010000:0.0:1746147260.147683:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df78700 00000100:00100000:0.0:1746147260.147691:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7653 00000100:00100000:0.0:1746147260.147696:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465936384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.147960:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7654 00000100:00100000:0.0:1746147260.147965:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967465936640:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.148961:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7655 00000100:00100000:0.0:1746147260.148967:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967465936896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.160426:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465936128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14806us (14926us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147260.160436:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7652 00002000:00100000:0.0:1746147260.160446:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012df7b800 x1830967465936128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.160455:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b800 with x1830967465936128 ext(2097152->3145727) 00002000:00010000:0.0:1746147260.160460:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7b800 00000100:00100000:0.0:1746147260.165717:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967465936896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16743us (18129us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147260.165726:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7655 00002000:00100000:0.0:1746147260.165734:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012df78700 x1830967465936896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.165742:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78700 with x1830967465936896 ext(3145728->4194303) 00002000:00010000:0.0:1746147260.165747:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df78700 00000100:00100000:1.0:1746147260.173600:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465936640:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25626us (26036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.173611:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7654 00002000:00100000:1.0:1746147260.173622:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012df7b100 x1830967465936640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.173636:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b100 with x1830967465936640 ext(2097152->3145727) 00002000:00010000:1.0:1746147260.173641:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012df7b100 00000100:00100000:1.0:1746147260.178034:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967465936384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30328us (30508us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.178046:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7653 00002000:00100000:1.0:1746147260.178058:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012df7ad80 x1830967465936384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.178066:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7ad80 with x1830967465936384 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.178071:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7ad80 00000100:00100000:0.0:1746147260.184483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.185385:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465937152 00000100:00100000:1.0:1746147260.185392:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465937152 00002000:00100000:1.0:1746147260.185421:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b409f80 x1830967465937152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.185430:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409f80 with x1830967465937152 ext(4194304->4976639) 00002000:00010000:1.0:1746147260.185435:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409f80 00000100:00100000:1.0:1746147260.185450:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7656 00000100:00100000:1.0:1746147260.185456:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465937152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147260.190901:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465937152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5436us (6415us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147260.190911:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7656 00002000:00100000:1.0:1746147260.190920:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b409f80 x1830967465937152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.190929:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409f80 with x1830967465937152 ext(4194304->4976639) 00002000:00010000:1.0:1746147260.190934:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409f80 00000001:00080000:3.0:1746147260.234925:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841456 is committed 00000001:00080000:3.0:1746147260.234952:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841443 is committed 00000001:00080000:3.0:1746147260.234966:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841415 is committed 00000001:00080000:3.0:1746147260.234972:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841413 is committed 00000001:00080000:3.0:1746147260.234980:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841452 is committed 00000001:00080000:3.0:1746147260.234985:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841448 is committed 00000001:00080000:3.0:1746147260.235002:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841459 is committed 00000001:00080000:3.0:1746147260.235010:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841453 is committed 00000001:00080000:3.0:1746147260.235014:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841450 is committed 00000001:00080000:3.0:1746147260.235075:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841457 is committed 00000001:00080000:3.0:1746147260.235081:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841451 is committed 00000100:00100000:0.0:1746147260.257578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.257676:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465937280 00000100:00100000:2.0:1746147260.257684:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465937280 00000100:00100000:2.0:1746147260.257736:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16068 00000100:00100000:2.0:1746147260.257742:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:32129:x1830967465937280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147260.257758:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.257773:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed670 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.257796:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.257802:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.257804:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.257807:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3088383] (req 2174976->3088383) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 44 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.259349:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.259363:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.259375:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467123328:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.259878:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.264663:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467123328:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.264689:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3088383] (req 2174976->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 44 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.264703:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094840a00, rc 0) 00000100:00100000:2.0:1746147260.264743:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:32129:x1830967465937280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7001us (7171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.264750:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16068 00000100:00100000:0.0:1746147260.266479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.266616:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465937536 00000100:00100000:3.0:1746147260.266623:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465937536 00000100:00100000:3.0:1746147260.266672:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11545 00000100:00100000:3.0:1746147260.266863:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32136:x1830967465937536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.266881:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.266896:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad2242 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed677 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.267021:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267031:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147260.267178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.267204:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465937664 00000100:00100000:0.0:1746147260.267209:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465937664 00010000:00010000:0.0:1746147260.267236:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.267272:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8208 00000100:00100000:0.0:1746147260.267279:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465937664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.267291:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.267312:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.267325:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.267347:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c52a00/0xb4b2209fbdad221f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed654 expref: 44 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.267361:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267375:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267380:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147260.267383:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.267385:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147260.267385:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.267392:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.267399:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.267471:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.267543:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad2257 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267552:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad2257 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147260.267577:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467123456:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147260.267645:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147260.267687:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad2257 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147260.267696:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.267762:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267768:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267777:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267781:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbf000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.267784:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267789:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267798:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147260.267801:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.267804:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267808:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf000/0xb4b2209fbdad2249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267924:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267930:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267934:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267954:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbe800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.267956:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267960:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267970:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473300) 00010000:00010000:3.0:1746147260.267972:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.267974:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.267978:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbe800/0xb4b2209fbdad2250 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.268008:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbf200/0xb4b2209fbdad2242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed677 expref: 22 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.268016:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad2257 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed677 expref: 21 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.268021:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.268022:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147260.268024:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbea00, rc 0) 00000100:00100000:3.0:1746147260.268533:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32136:x1830967465937536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1671us (2057us total) trans 8589945567 rc 0/0 00000100:00100000:3.0:1746147260.268540:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11545 00000100:00100000:0.0:1746147260.269352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.269424:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465937920 00000100:00100000:2.0:1746147260.269430:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465937920 00002000:00100000:2.0:1746147260.269454:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2174976->2179071) req@ffff88009f732d80 x1830967465937920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.269463:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732d80 with x1830967465937920 ext(2174976->2179071) 00002000:00010000:2.0:1746147260.269466:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f732d80 00000100:00100000:2.0:1746147260.269479:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7657 00000100:00100000:2.0:1746147260.269485:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967465937920:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147260.269678:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467123456:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147260.269692:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.270566:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465937664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3286us (3391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.270574:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8208 00000100:00100000:2.0:1746147260.270652:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465937920:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1167us (1300us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147260.270657:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7657 00002000:00100000:2.0:1746147260.270662:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2174976->2179071) req@ffff88009f732d80 x1830967465937920/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.270669:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732d80 with x1830967465937920 ext(2174976->2179071) 00002000:00010000:2.0:1746147260.270672:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f732d80 00000100:00100000:0.0:1746147260.272105:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.272186:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465938048 00000100:00100000:2.0:1746147260.272192:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465938048 00000100:00100000:2.0:1746147260.272222:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16069 00000100:00100000:2.0:1746147260.272228:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465938048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.272238:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.272252:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094840000/0xb4b2209fbdad2265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed67e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.272275:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094840000/0xb4b2209fbdad2265 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed67e expref: 33 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.272283:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094840000/0xb4b2209fbdad2265 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed67e expref: 33 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.272307:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094840000, rc 0) 00000100:00100000:2.0:1746147260.272343:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967465938048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 114us (241us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147260.272348:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16069 00000100:00100000:0.0:1746147260.272981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.273000:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465938176 00000100:00100000:1.0:1746147260.273004:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465938176 00000100:00100000:1.0:1746147260.273044:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 788 00000100:00100000:1.0:1746147260.273049:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967465938176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.273058:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.273073:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad2257 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed677 expref: 21 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.273103:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.273107:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.273127:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967465938176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.273133:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 788 00000100:00100000:0.0:1746147260.282033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.282366:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465938432 00000100:00100000:2.0:1746147260.282374:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465938432 00002000:00100000:2.0:1746147260.282412:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3084288->3088383) req@ffff88012b0c2d80 x1830967465938432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.282421:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c2d80 with x1830967465938432 ext(3084288->3088383) 00002000:00010000:2.0:1746147260.282426:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c2d80 00000100:00100000:2.0:1746147260.282443:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7658 00000100:00100000:2.0:1746147260.282450:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465938432:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147260.283346:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967465938432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 894us (1316us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147260.283353:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7658 00002000:00100000:2.0:1746147260.283359:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3084288->3088383) req@ffff88012b0c2d80 x1830967465938432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.283366:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c2d80 with x1830967465938432 ext(3084288->3088383) 00002000:00010000:2.0:1746147260.283369:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c2d80 00000100:00100000:3.0:1746147260.283578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.283613:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465938688 00000100:00100000:0.0:1746147260.283617:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465938688 00002000:00100000:0.0:1746147260.283637:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a0449180 x1830967465938688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.283643:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967465938688 ext(1048576->2097151) 00002000:00010000:0.0:1746147260.283647:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449180 00000100:00100000:0.0:1746147260.283667:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7659 00000100:00100000:0.0:1746147260.283672:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465938688:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147260.294394:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967465938688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10712us (10807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.294405:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7659 00002000:00100000:2.0:1746147260.294414:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff8800a0449180 x1830967465938688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.294422:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967465938688 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.294428:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449180 00000100:00100000:0.0:1746147260.301373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.303705:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465938816 00000100:00100000:2.0:1746147260.303716:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465938816 00000100:00100000:2.0:1746147260.303770:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16070 00000100:00100000:2.0:1746147260.303777:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+32:32136:x1830967465938816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.303791:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.303806:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed685 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.303829:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.303835:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.303837:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.303840:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 33 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.303864:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.303874:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 42 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.303884:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467123584:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.303965:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.307360:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467123584:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147260.307385:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 33 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.307404:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56e000, rc 0) 00000100:00100000:0.0:1746147260.307448:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32136:x1830967465938816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3670us (6081us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.307458:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16070 00000100:00100000:2.0:1746147260.307554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.307628:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465938944 00000100:00100000:3.0:1746147260.307633:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465938944 00002000:00100000:3.0:1746147260.307663:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2174976->3088383) req@ffff88008f9fea00 x1830967465938944/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.307671:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fea00 with x1830967465938944 ext(2174976->3088383) 00010000:00010000:3.0:1746147260.307677:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 43 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.307692:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 43 pid: 4445 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746147260.307698:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fea00 00000100:00100000:3.0:1746147260.307711:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2614 00000100:00100000:3.0:1746147260.307716:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967465938944:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147260.323498:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967465938944:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 15773us (15936us total) trans 17179874106 rc 0/0 00000100:00100000:3.0:1746147260.323508:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2614 00002000:00100000:3.0:1746147260.323517:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2174976->3088383) req@ffff88008f9fea00 x1830967465938944/t17179874106(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.323525:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fea00 with x1830967465938944 ext(2174976->3088383) 00010000:00010000:3.0:1746147260.323534:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 45 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.323548:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 45 pid: 4445 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746147260.323555:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fea00 00000100:00100000:1.0:1746147260.326313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.326339:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465939200 00000100:00100000:1.0:1746147260.326346:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465939200 00000100:00100000:1.0:1746147260.326373:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11546 00000100:00100000:1.0:1746147260.326379:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32139:x1830967465939200:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147260.326395:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.326408:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed68c expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.326485:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326496:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326504:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326514:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326519:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326523:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326599:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b197e00/0xb4b2209fbdad2288 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326607:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b197e00/0xb4b2209fbdad2288 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326613:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b197e00/0xb4b2209fbdad2288 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147260.326624:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:1.0:1746147260.326681:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326686:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326691:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326696:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a1c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147260.326699:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326704:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326712:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147260.326715:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147260.326718:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326722:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad227a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326738:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326743:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326747:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326754:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a0800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147260.326756:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326760:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326765:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008dc4be00) 00010000:00010000:1.0:1746147260.326767:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147260.326768:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326772:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdad2281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.326797:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed68c expref: 23 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.326806:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b197e00/0xb4b2209fbdad2288 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed68c expref: 22 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.326811:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.326813:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147260.326815:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b197e00, rc 0) 00000100:00100000:1.0:1746147260.326849:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32139:x1830967465939200:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 470us (541us total) trans 8589945568 rc 0/0 00000100:00100000:1.0:1746147260.326855:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11546 00000100:00100000:0.0:1746147260.330448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.333266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.333378:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465939328 00000100:00100000:0.0:1746147260.333385:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465939328 00010000:00010000:0.0:1746147260.333411:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 45 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.333431:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465939456 00000100:00100000:0.0:1746147260.333433:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465939456 00000100:00100000:0.0:1746147260.333446:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8209 00000100:00100000:0.0:1746147260.333452:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967465939328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.333462:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147260.333476:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147259 -> 1746147260 00002000:00010000:0.0:1746147260.333478:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147259 -> 1746147260 00010000:00010000:0.0:1746147260.333483:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 45 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.333493:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 45 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.333510:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094840a00/0xb4b2209fbdad223b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->3088383) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed670 expref: 45 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.333525:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.333527:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.333532:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.333539:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.333563:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147260.333574:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467123712:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147260.333624:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.333651:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 789 00000100:00100000:0.0:1746147260.333656:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967465939456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.333663:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.333674:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b197e00/0xb4b2209fbdad2288 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed68c expref: 22 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.333688:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147260.333692:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.333707:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967465939456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.333713:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 789 00000100:00100000:1.0:1746147260.337223:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467123712:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147260.337240:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.337282:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967465939328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3829us (6841us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.337291:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8209 00000100:00100000:0.0:1746147260.343638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.343668:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465939712 00000100:00100000:3.0:1746147260.343675:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465939712 00002000:00100000:3.0:1746147260.343709:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012b0c3100 x1830967465939712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.343717:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3100 with x1830967465939712 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.343722:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c3100 00000100:00100000:3.0:1746147260.343783:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7660 00000100:00100000:3.0:1746147260.343790:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465939712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.354702:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967465939712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10904us (11063us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.354712:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7660 00002000:00100000:3.0:1746147260.354722:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012b0c3100 x1830967465939712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.354730:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3100 with x1830967465939712 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.354736:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c3100 00000100:00100000:3.0:1746147260.364670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.367755:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465939840 00000100:00100000:1.0:1746147260.367764:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465939840 00000100:00100000:1.0:1746147260.367815:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11547 00000100:00100000:1.0:1746147260.367822:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32140:x1830967465939840:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147260.367844:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.367863:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdad2296 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed693 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.368299:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368310:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368318:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368327:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368332:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368336:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368409:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368418:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 314 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.368424:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.368448:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 314 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.368458:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 314 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.368468:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467123840:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.368526:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00080000:1.0:1746147260.368537:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147260.369866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.369889:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940096 00000100:00100000:2.0:1746147260.369895:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940096 00000100:00100000:2.0:1746147260.370913:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4845 00000100:00100000:2.0:1746147260.370923:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32136:x1830967465940096:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147260.371133:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32136:x1830967465940096:12345-192.168.203.36@tcp:35:cat.0 Request processed in 212us (1269us total) trans 8589945569 rc 0/0 00000100:00100000:2.0:1746147260.371140:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4845 00000100:00100000:1.0:1746147260.373960:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467123840:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.373979:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147260.376675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.376787:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940352 00000100:00100000:2.0:1746147260.376795:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940352 00000100:00100000:2.0:1746147260.376827:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4846 00000100:00100000:2.0:1746147260.376833:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+315:14478:x1830967465940352:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147260.376998:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+316:14478:x1830967465940352:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 164us (327us total) trans 8589945570 rc 0/0 00000100:00100000:2.0:1746147260.377004:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4846 00000100:00100000:1.0:1746147260.380632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.380652:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940480 00000100:00100000:1.0:1746147260.380658:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940480 00010000:00010000:1.0:1746147260.380682:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.380778:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8210 00000100:00100000:1.0:1746147260.380785:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465940480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.380795:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.380800:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.380815:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.380830:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c53800/0xb4b2209fbdad2218 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed65b expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.380843:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.380847:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.380855:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.380860:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.380873:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147260.381457:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.381465:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147260.381498:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:1.0:1746147260.381502:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147260.381514:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.381522:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.381529:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.381533:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.381538:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383598:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1aa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147260.383603:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383610:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383621:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147260.383623:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147260.383626:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383631:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad229d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383646:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383651:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383656:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383660:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147260.383662:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383670:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383676:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093b89200) 00010000:00010000:1.0:1746147260.383677:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147260.383679:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383683:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad22a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.383724:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdad2296 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.383736:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 13 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.383742:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.383744:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147260.383746:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a400, rc 0) 00000100:00100000:1.0:1746147260.383791:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32140:x1830967465939840:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 15970us (19127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.383799:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11547 00000100:00100000:1.0:1746147260.383838:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1957:x1830967465940480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3053us (3212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.383844:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8210 00000100:00100000:0.0:1746147260.388883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.388908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.388952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.388969:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940608 00000100:00100000:3.0:1746147260.388970:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940736 00000100:00100000:3.0:1746147260.388976:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940736 00000100:00100000:0.0:1746147260.388976:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940608 00000100:00100000:0.0:1746147260.389012:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940864 00000100:00100000:0.0:1746147260.389014:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940864 00000100:00100000:0.0:1746147260.389027:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16071 00000100:00100000:0.0:1746147260.389033:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465940608:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147260.389045:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147260.389057:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed69a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.389075:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.389077:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.389096:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.389109:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.389118:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f865800, rc 0) 00000100:00100000:0.0:1746147260.389153:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465940608:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 120us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.389159:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16071 00000100:00100000:0.0:1746147260.389173:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16072 00000100:00100000:0.0:1746147260.389178:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465940864:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147260.389236:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147260.389244:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6a8 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.389254:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.389256:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.389260:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.389269:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.389275:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f865c00, rc 0) 00000100:00100000:0.0:1746147260.389290:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465940864:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.389295:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16072 00000100:00080000:0.0:1746147260.389308:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147260.389311:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147260.389522:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16073 00000100:00100000:3.0:1746147260.389527:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465940736:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147260.389534:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.389540:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6a1 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.389550:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.389551:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.389555:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147260.389564:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147260.389571:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422200, rc 0) 00000100:00100000:3.0:1746147260.389586:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465940736:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 59us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.389590:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16073 00000100:00100000:0.0:1746147260.390119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.390150:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465940992 00000100:00100000:1.0:1746147260.390154:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465940992 00000100:00100000:1.0:1746147260.390171:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16074 00000100:00100000:1.0:1746147260.390178:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465940992:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147260.390184:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.390191:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6af expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.390201:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.390202:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147260.390204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147260.390206:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.390215:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.390221:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a800, rc 0) 00000100:00100000:1.0:1746147260.390236:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465940992:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.390240:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16074 00000100:00100000:1.0:1746147260.390253:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465941120 00000100:00100000:1.0:1746147260.390255:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465941120 00000100:00100000:1.0:1746147260.390269:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16075 00000100:00100000:1.0:1746147260.390274:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32139:x1830967465941120:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147260.390279:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.390285:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6b6 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.391217:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.391230:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.391236:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.391241:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.391243:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.391245:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 6/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1261568->1875967] (req 1261568->1875967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 9 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.391268:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.391278:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 14 pid: 17530 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.391290:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467123968:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.391352:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 8 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.391360:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 8 pid: 8480 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.391368:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467124096:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.391648:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.391656:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.391664:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467124224:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.391685:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.392653:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467123968:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147260.392662:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467124096:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147260.392668:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467124224:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147260.392688:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [1261568->1875967] (req 1261568->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 9 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.392705:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1ac00, rc 0) 00000100:00100000:0.0:1746147260.392729:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32139:x1830967465941120:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2454us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.392735:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16075 00000100:00100000:0.0:1746147260.393891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.394815:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465941376 00000100:00100000:1.0:1746147260.395235:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465941376 00000100:00100000:1.0:1746147260.395271:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11548 00000100:00100000:1.0:1746147260.395277:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32140:x1830967465941376:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147260.395292:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.395305:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b52600/0xb4b2209fbdad22d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6bd expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.395374:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.395385:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.395392:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.395414:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.395423:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.395433:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467124352:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.396309:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.396351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.396441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.396457:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465941504 00000100:00100000:1.0:1746147260.396460:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465941504 00010000:00010000:1.0:1746147260.396476:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 15 pid: 17530 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.396491:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465941632 00000100:00100000:1.0:1746147260.396492:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465941632 00010000:00010000:1.0:1746147260.396501:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 9 pid: 8480 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.396515:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8211 00000100:00100000:1.0:1746147260.396520:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967465941504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.396527:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.396542:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 15 pid: 17530 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.396552:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 15 pid: 17530 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.396566:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929c0c00/0xb4b2209fbdad1fb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed4be expref: 15 pid: 17530 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.396583:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.396604:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465941504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.396611:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8211 00000100:00100000:1.0:1746147260.396628:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8212 00000100:00100000:1.0:1746147260.396633:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465941632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.396639:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.396646:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 9 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.396653:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 9 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.396662:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec73400/0xb4b2209fbdad211c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed59e expref: 9 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746147260.396670:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.396682:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465941632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.396687:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8212 00000100:00100000:1.0:1746147260.396725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.398029:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465941760 00000100:00100000:1.0:1746147260.398034:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465941760 00010000:00010000:1.0:1746147260.398049:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.398071:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8213 00000100:00100000:1.0:1746147260.398076:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465941760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.398083:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.398105:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.398113:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.398125:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e6eb400/0xb4b2209fbdad1f86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed48d expref: 9 pid: 4444 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.398136:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.398138:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.398143:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 8 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.398150:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 8 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.398173:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 8 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147260.398181:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467124480:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147260.398212:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.398340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.398350:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465941888 00000100:00100000:1.0:1746147260.398353:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465941888 00010000:00010000:1.0:1746147260.398363:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 15 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.398375:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8214 00000100:00100000:1.0:1746147260.398379:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465941888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.398386:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.398389:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 15 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.398397:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 15 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.398407:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.398410:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.398417:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.398422:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.398431:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.398444:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967465941888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.398449:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8214 00010000:00010000:0.0:1746147260.398854:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad22ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed693 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.398873:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467124352:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147260.398891:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147260.398900:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147260.398904:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:0.0:1746147260.398923:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147260.399558:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b52600/0xb4b2209fbdad22d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.399572:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.399580:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147260.399583:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147260.399586:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b53600, rc 0) 00000100:00100000:0.0:1746147260.399633:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32140:x1830967465941376:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4356us (5748us total) trans 8589945571 rc 0/0 00000100:00100000:0.0:1746147260.399640:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11548 00000100:00100000:1.0:1746147260.401756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.401797:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467124480:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147260.401811:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.401909:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465942144 00000100:00100000:3.0:1746147260.401914:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465942144 00002000:00100000:3.0:1746147260.401955:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1261568->1265663) req@ffff880134c55880 x1830967465942144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.401969:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967465942144 ext(1261568->1265663) 00002000:00010000:3.0:1746147260.401972:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55880 00000100:00100000:1.0:1746147260.402012:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465941760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3935us (5286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.402019:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8213 00000100:00100000:3.0:1746147260.402131:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7661 00000100:00100000:3.0:1746147260.402137:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465942144:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.402286:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465942144:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 148us (534us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147260.402292:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7661 00002000:00100000:3.0:1746147260.402296:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1261568->1265663) req@ffff880134c55880 x1830967465942144/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.402304:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967465942144 ext(1261568->1265663) 00002000:00010000:3.0:1746147260.402307:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55880 00000100:00100000:0.0:1746147260.402861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.402886:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465942272 00000100:00100000:0.0:1746147260.402908:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465942272 00000100:00100000:0.0:1746147260.403270:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11549 00000100:00100000:0.0:1746147260.403278:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32140:x1830967465942272:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147260.403295:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147260.403313:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864e00/0xb4b2209fbdad22ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6c4 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.403388:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147260.403403:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.403410:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147260.403439:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.403451:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 15 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.403462:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467124608:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147260.403538:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.404585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.404715:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465942528 00000100:00100000:1.0:1746147260.404722:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465942528 00000100:00100000:1.0:1746147260.404760:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11550 00000100:00100000:1.0:1746147260.404767:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+315:32143:x1830967465942528:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147260.404782:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.404796:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a0000/0xb4b2209fbdad22f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6cb expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.404882:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.404893:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.404898:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.404910:0:23726:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.404919:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147260.408098:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467124608:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.408111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147260.408118:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147260.408136:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465942656 00000100:00100000:1.0:1746147260.408143:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465942656 00010000:00010000:1.0:1746147260.408172:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 16 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.408196:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8215 00000100:00100000:1.0:1746147260.408203:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1959:x1830967465942656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.408214:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.408220:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 16 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.408229:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 16 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.408250:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b53600/0xb4b2209fbdad22dc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6bd expref: 16 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.408270:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.408274:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.408283:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.408290:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.408297:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.408302:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.408323:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.408362:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1959:x1830967465942656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 159us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.408368:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8215 00010000:00010000:0.0:1746147260.408777:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147260.408785:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00000004:00200000:0.0:1746147260.408819:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:0.0:1746147260.408823:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147260.408835:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147260.409221:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864e00/0xb4b2209fbdad22ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.409240:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.409247:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.409253:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f864200, rc 0) 00000100:00100000:1.0:1746147260.409598:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32140:x1830967465942272:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6318us (6738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.409606:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11549 00000100:00100000:0.0:1746147260.410740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.410786:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465942912 00000100:00100000:3.0:1746147260.410793:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465942912 00002000:00100000:3.0:1746147260.410822:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1871872->1875967) req@ffff88009b6b8000 x1830967465942912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.410896:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8000 with x1830967465942912 ext(1871872->1875967) 00002000:00010000:3.0:1746147260.410900:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b8000 00000100:00100000:3.0:1746147260.411260:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7662 00000100:00100000:3.0:1746147260.411267:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465942912:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.411391:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465942912:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 124us (655us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147260.411397:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7662 00002000:00100000:3.0:1746147260.411401:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1871872->1875967) req@ffff88009b6b8000 x1830967465942912/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.411408:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8000 with x1830967465942912 ext(1871872->1875967) 00002000:00010000:3.0:1746147260.411410:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b8000 00000100:00100000:1.0:1746147260.412037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.412060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.412074:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465943040 00000100:00100000:1.0:1746147260.412077:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465943040 00010000:00010000:1.0:1746147260.412100:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.412121:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8216 00000100:00100000:1.0:1746147260.412126:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967465943040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.412185:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.412190:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.412203:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.412218:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad22f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6c4 expref: 14 pid: 14047 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.412228:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.412232:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.412240:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.412246:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147260.412273:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147260.412292:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147260.412293:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967465943040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 166us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.412298:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8216 00010000:00010000:2.0:1746147260.412299:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:2.0:1746147260.412314:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147260.412414:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a0000/0xb4b2209fbdad22f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.412426:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 317 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.412431:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147260.412434:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147260.412437:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1e00, rc 0) 00000100:00100000:2.0:1746147260.412458:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32143:x1830967465942528:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7692us (7877us total) trans 8589945572 rc 0/0 00000100:00100000:2.0:1746147260.412464:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11550 00000100:00100000:0.0:1746147260.412469:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465943168 00000100:00100000:0.0:1746147260.412472:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465943168 00000100:00100000:0.0:1746147260.412492:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16076 00000100:00100000:0.0:1746147260.412497:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465943168:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147260.412504:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147260.412514:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad230d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6d2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147260.412544:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467124736:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147260.412588:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.413542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147260.413639:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147258 -> 1746147260 00002000:00010000:1.0:1746147260.413642:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147258 -> 1746147260 00002000:00010000:1.0:1746147260.413644:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147259 -> 1746147260 00000100:00100000:1.0:1746147260.413667:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467124736:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147260.413683:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad230d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6d2 expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.413692:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad230d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6d2 expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.413700:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f865e00, rc 0) 00000100:00100000:1.0:1746147260.413721:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465943168:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1224us (1659us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147260.413727:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16076 00000100:00100000:2.0:1746147260.414295:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465943424 00000100:00100000:2.0:1746147260.414633:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465943424 00000100:00100000:2.0:1746147260.414662:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4847 00000100:00100000:2.0:1746147260.414668:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32139:x1830967465943424:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147260.415433:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32139:x1830967465943424:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 763us (1889us total) trans 8589945573 rc 0/0 00000100:00100000:2.0:1746147260.415440:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4847 00000100:00100000:0.0:1746147260.416355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.416401:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465943680 00000100:00100000:2.0:1746147260.416406:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465943680 00000100:00100000:2.0:1746147260.416441:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11551 00000100:00100000:2.0:1746147260.416447:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32140:x1830967465943680:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147260.416458:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.416474:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad2314 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6d9 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.416537:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.416549:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 316 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.416555:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.416581:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 316 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.416592:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 316 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.416602:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467124864:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.416665:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.421563:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967467124864:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.421581:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147260.422070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.422326:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465943808 00000100:00100000:2.0:1746147260.422332:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465943808 00010000:00010000:2.0:1746147260.422357:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 317 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.422379:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8217 00000100:00100000:2.0:1746147260.422386:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967465943808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147260.422396:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147260.422401:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 317 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.422411:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 317 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.422427:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1e00/0xb4b2209fbdad22ff lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6cb expref: 317 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.422438:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147260.422442:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.422449:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.422454:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147260.422467:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.422498:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465943808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 112us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.422504:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8217 00010000:00010000:3.0:1746147260.422821:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422828:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422843:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422848:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422857:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422861:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f56e800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.422864:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422870:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422877:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.422879:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147260.422882:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422886:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56e800/0xb4b2209fbdad231b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.422915:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad2314 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6d9 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.422921:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f56f400/0xb4b2209fbdad2314 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6d9 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.422926:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56f400, rc 0) 00000100:00100000:3.0:1746147260.422982:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32140:x1830967465943680:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6534us (6628us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147260.422988:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11551 00000100:00100000:0.0:1746147260.424976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.425043:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944064 00000100:00100000:2.0:1746147260.425049:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944064 00000100:00100000:2.0:1746147260.425077:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4848 00000100:00100000:2.0:1746147260.425083:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32140:x1830967465944064:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147260.425239:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32140:x1830967465944064:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 156us (302us total) trans 8589945574 rc 0/0 00000100:00100000:2.0:1746147260.425245:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4848 00000001:00080000:3.0:1746147260.436314:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874105 is committed 00000001:00080000:3.0:1746147260.436327:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874099 is committed 00000001:00080000:3.0:1746147260.436335:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874095 is committed 00000001:00080000:3.0:1746147260.436350:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874044 is committed 00000001:00080000:3.0:1746147260.436367:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874096 is committed 00000001:00080000:3.0:1746147260.436383:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874057 is committed 00000001:00080000:3.0:1746147260.436405:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874103 is committed 00000001:00080000:3.0:1746147260.436450:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874106 is committed 00000001:00080000:3.0:1746147260.436458:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874100 is committed 00000100:00100000:0.0:1746147260.453751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.453796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.453855:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944192 00000100:00100000:2.0:1746147260.453862:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944192 00000100:00100000:2.0:1746147260.453905:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944320 00000100:00100000:2.0:1746147260.453907:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944320 00000100:00100000:2.0:1746147260.453929:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16077 00000100:00100000:2.0:1746147260.453950:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1959:x1830967465944192:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147260.453961:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16078 00010000:00010000:2.0:1746147260.453965:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147260.453968:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967465944320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147260.453976:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.453978:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad2322 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6e0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.453986:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6e7 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.453997:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.453999:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.454006:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147260.454018:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147260.454019:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467124992:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147260.454027:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4bbe00, rc 0) 00000100:00100000:0.0:1746147260.454061:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967465944320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.454066:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16078 00000100:00100000:2.0:1746147260.454136:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.459842:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467124992:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147260.459868:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad2322 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e0 expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.459880:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56f000/0xb4b2209fbdad2322 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e0 expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.459902:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56f000, rc 0) 00000100:00100000:2.0:1746147260.459960:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1959:x1830967465944192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6023us (6215us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147260.459966:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16077 00000100:00100000:0.0:1746147260.477862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.478068:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944448 00000100:00100000:2.0:1746147260.478076:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944448 00000100:00100000:2.0:1746147260.478128:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16079 00000100:00100000:2.0:1746147260.478135:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:32148:x1830967465944448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.478150:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.478164:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6ee expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.478187:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 7 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.478194:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.478195:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.478198:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.478226:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 7 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.478236:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 7 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.478246:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467125120:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.478319:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.480166:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467125120:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.480185:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.480197:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56f800, rc 0) 00000100:00100000:2.0:1746147260.480227:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32148:x1830967465944448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2092us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.480233:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16079 00000100:00100000:0.0:1746147260.481717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.481811:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944576 00000100:00100000:2.0:1746147260.481821:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944576 00002000:00100000:2.0:1746147260.481856:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1261568->1875967) req@ffff88009e584a80 x1830967465944576/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.481864:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584a80 with x1830967465944576 ext(1261568->1875967) 00010000:00010000:2.0:1746147260.481874:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 8 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.481890:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 8 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.481896:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e584a80 00000100:00100000:2.0:1746147260.481922:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2615 00000100:00100000:2.0:1746147260.481928:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465944576:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147260.496221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.496389:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944832 00000100:00100000:3.0:1746147260.496396:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944832 00000100:00100000:3.0:1746147260.496429:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11552 00000100:00100000:3.0:1746147260.496435:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32151:x1830967465944832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.496451:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.496464:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad2337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6f5 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.496537:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496546:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496554:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496563:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496567:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496572:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496650:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496657:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496661:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:3.0:1746147260.496668:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.496725:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496730:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496735:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496739:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.496742:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496747:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496761:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147260.496763:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.496766:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496770:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad233e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496797:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496802:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496806:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496810:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.496812:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496816:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496821:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473200) 00010000:00010000:3.0:1746147260.496823:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.496825:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496829:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147260.496856:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad2337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 26 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.496864:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 25 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.496870:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.496872:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147260.496874:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423600, rc 0) 00000100:00100000:3.0:1746147260.496920:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32151:x1830967465944832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 484us (707us total) trans 8589945575 rc 0/0 00000100:00100000:3.0:1746147260.496925:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11552 00000100:00100000:2.0:1746147260.497401:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465944576:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 15472us (15686us total) trans 21474841460 rc 0/0 00000100:00100000:2.0:1746147260.497409:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2615 00002000:00100000:2.0:1746147260.497416:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1261568->1875967) req@ffff88009e584a80 x1830967465944576/t21474841460(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.497425:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584a80 with x1830967465944576 ext(1261568->1875967) 00010000:00010000:2.0:1746147260.497431:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 10 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.497441:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 10 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.497447:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e584a80 00000100:00100000:0.0:1746147260.503732:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.503919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.504024:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465944960 00000100:00100000:2.0:1746147260.504031:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465944960 00000100:00100000:2.0:1746147260.504081:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16080 00000100:00100000:2.0:1746147260.504098:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465944960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.504115:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.504128:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcfa00/0xb4b2209fbdad235a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed6fc expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.504171:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467125248:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147260.504273:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465945088 00000100:00100000:3.0:1746147260.504283:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465945088 00010000:00010000:3.0:1746147260.504315:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 12 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.504321:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.504427:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8218 00000100:00100000:3.0:1746147260.504432:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465945088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.504442:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.504460:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 12 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.504470:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 12 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.504489:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.504491:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.504497:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.504502:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.504523:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.504531:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467125376:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.504576:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.506988:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467125376:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147260.507008:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.507062:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465945088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2628us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.507071:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8218 00010000:00010000:2.0:1746147260.507410:0:4445:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88008f9fd500 x1830967467125248) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.507443:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad22ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1875967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6b6 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.507471:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467125248:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147260.507496:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcfa00/0xb4b2209fbdad235a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6fc expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.507508:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcfa00/0xb4b2209fbdad235a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6fc expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.507515:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcfa00, rc 0) 00000100:00100000:2.0:1746147260.507580:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465944960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3482us (3855us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147260.507587:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16080 00000100:00100000:0.0:1746147260.511207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.511360:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465945344 00000100:00100000:2.0:1746147260.511370:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465945344 00002000:00100000:2.0:1746147260.511411:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e584380 x1830967465945344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.511420:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584380 with x1830967465945344 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.511425:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584380 00000100:00100000:2.0:1746147260.511465:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7663 00000100:00100000:2.0:1746147260.511472:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465945344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.512234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.514076:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465945472 00000100:00100000:2.0:1746147260.514094:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465945472 00000100:00100000:2.0:1746147260.514137:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16081 00000100:00100000:2.0:1746147260.514144:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32151:x1830967465945472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147260.514157:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.514169:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed703 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.514187:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.514189:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.514195:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.514207:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.514216:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcee00, rc 0) 00000100:00100000:2.0:1746147260.514238:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32151:x1830967465945472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 95us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.514243:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16081 00000100:00100000:2.0:1746147260.522966:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465945344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11485us (11760us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.522976:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7663 00002000:00100000:2.0:1746147260.522986:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e584380 x1830967465945344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.522994:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584380 with x1830967465945344 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.522999:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584380 00000100:00100000:0.0:1746147260.525316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.525370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.525594:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465945728 00000100:00100000:2.0:1746147260.525605:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465945728 00002000:00100000:2.0:1746147260.525652:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e585500 x1830967465945728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.525663:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585500 with x1830967465945728 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.525668:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e585500 00000100:00100000:2.0:1746147260.525817:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7664 00000100:00100000:2.0:1746147260.525826:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465945728:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147260.527211:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465945856 00000100:00100000:1.0:1746147260.527218:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465945856 00000100:00100000:1.0:1746147260.527261:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16082 00000100:00100000:1.0:1746147260.527267:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32143:x1830967465945856:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147260.527279:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.527295:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed70a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.527321:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.527330:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.527336:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.527341:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.527342:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.527345:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2359296->3145727] (req 2359296->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.527481:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.527492:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.527503:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467125504:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.527580:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.527588:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 7 pid: 11147 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746147260.527596:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467125632:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.527621:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.527628:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 11 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.527635:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467125760:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.527651:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.535139:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467125504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.535152:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467125632:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.535159:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467125760:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.535194:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2359296->3145727] (req 2359296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.535211:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486a00, rc 0) 00000100:00100000:1.0:1746147260.535273:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:32143:x1830967465945856:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8005us (9901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.535287:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16082 00000100:00100000:2.0:1746147260.536078:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465945728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10251us (10768us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.536097:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7664 00002000:00100000:2.0:1746147260.536107:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009e585500 x1830967465945728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.536115:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585500 with x1830967465945728 ext(1048576->2097151) 00002000:00010000:2.0:1746147260.536119:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e585500 00000100:00100000:0.0:1746147260.537768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.537867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.537880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.537913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.537959:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465945984 00000100:00100000:0.0:1746147260.537967:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465945984 00010000:00010000:0.0:1746147260.538000:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 8 pid: 11147 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746147260.538021:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465946112 00000100:00100000:0.0:1746147260.538023:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465946112 00010000:00010000:0.0:1746147260.538032:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746147260.538043:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465946368 00000100:00100000:0.0:1746147260.538045:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465946368 00010000:00010000:0.0:1746147260.538052:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 10 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.538062:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8219 00000100:00100000:0.0:1746147260.538069:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465945984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.538081:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147260.538112:0:16058:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:0.0:1746147260.538117:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 8 pid: 11147 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.538128:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 8 pid: 11147 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.538149:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdad22c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6af expref: 8 pid: 11147 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.538167:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.538198:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465945984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 128us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.538204:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8219 00000100:00100000:0.0:1746147260.538217:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8220 00000100:00100000:0.0:1746147260.538221:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465946112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.538227:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.538234:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.538241:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.538250:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129c53e00/0xb4b2209fbdad21fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed63f expref: 16 pid: 4445 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.538259:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.538269:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465946112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.538274:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8220 00000100:00100000:0.0:1746147260.538281:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8221 00000100:00100000:0.0:1746147260.538285:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465946368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.538290:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.538294:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 10 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.538303:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 10 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.538312:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f741800/0xb4b2209fbdad21d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed61c expref: 10 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.538320:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.538321:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.538328:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.538335:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147260.538363:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147260.538375:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467125888:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147260.538422:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.538458:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465946496 00000100:00100000:0.0:1746147260.538461:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465946496 00002000:00100000:0.0:1746147260.538488:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f0e00 x1830967465946496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.538496:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0e00 with x1830967465946496 ext(2097152->3145727) 00002000:00010000:0.0:1746147260.538500:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0e00 00000100:00100000:0.0:1746147260.538518:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7665 00000100:00100000:0.0:1746147260.538522:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465946496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.549233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.549308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.549334:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465946624 00000100:00100000:1.0:1746147260.549342:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465946624 00000100:00100000:2.0:1746147260.549372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.549377:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16083 00000100:00100000:1.0:1746147260.549383:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32151:x1830967465946624:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147260.549396:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947136 00010000:00010000:1.0:1746147260.549397:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147260.549401:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947136 00010000:00010000:1.0:1746147260.549411:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed711 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.549432:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147260.549435:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2359296->2363391) req@ffff88008f9fca80 x1830967465947136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147260.549438:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.549440:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.549443:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147260.549444:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fca80 with x1830967465947136 ext(2359296->2363391) 00010000:00010000:2.0:1746147260.549452:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.549462:0:21209:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.549467:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147260.549469:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fca80 00010000:00010000:1.0:1746147260.549476:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.549486:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467126016:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.549491:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2616 00000100:00100000:2.0:1746147260.549497:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465947136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.549697:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465946880 00000100:00100000:3.0:1746147260.549705:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465946880 00000100:00100000:3.0:1746147260.549731:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11553 00000100:00100000:3.0:1746147260.549735:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32153:x1830967465946880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147260.549749:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.549762:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed718 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147260.549822:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467125888:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147260.549835:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147260.549848:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147260.549883:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.549917:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465946368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 11630us (12035us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.549925:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8221 00010000:00010000:3.0:1746147260.549928:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 26 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.549951:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.549975:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 26 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.550315:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967465947136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 817us (941us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147260.550321:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2616 00002000:00100000:2.0:1746147260.550326:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2359296->2363391) req@ffff88008f9fca80 x1830967465947136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.550333:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fca80 with x1830967465947136 ext(2359296->2363391) 00010000:00010000:2.0:1746147260.550338:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.550348:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.550358:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fca80 00010000:00010000:3.0:1746147260.550995:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 26 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.551006:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467126144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.551496:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.553097:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467126016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147260.553129:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 10 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.553144:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486600, rc 0) 00000100:00100000:1.0:1746147260.553189:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32151:x1830967465946624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3805us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.553198:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16083 00000100:00100000:1.0:1746147260.555593:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465946496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17061us (17670us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.555604:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7665 00002000:00100000:1.0:1746147260.555615:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f0e00 x1830967465946496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.555625:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0e00 with x1830967465946496 ext(2097152->3145727) 00002000:00010000:1.0:1746147260.555630:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0e00 00000100:00100000:0.0:1746147260.556109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.556184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.556201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.556210:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947264 00000100:00100000:0.0:1746147260.556216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.556218:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947264 00000100:00100000:0.0:1746147260.556230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.556245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.556255:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:1.0:1746147260.556261:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1958:x1830967465947264:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147260.556261:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947520 00000100:00100000:0.0:1746147260.556269:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947520 00000100:00100000:0.0:1746147260.556289:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465948032 00000100:00100000:0.0:1746147260.556291:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465948032 00000100:00100000:1.0:1746147260.556299:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1958:x1830967465947264:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.556301:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947648 00000100:00100000:0.0:1746147260.556303:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947648 00000100:00100000:1.0:1746147260.556304:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:0.0:1746147260.556315:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:0.0:1746147260.556320:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967465947520:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147260.556335:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 242 00000100:00100000:1.0:1746147260.556340:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465948032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147260.556345:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967465947520:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.556350:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:0.0:1746147260.556358:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:1.0:1746147260.556361:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967465948032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 21us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.556362:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465947648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147260.556366:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 242 00000100:00100000:0.0:1746147260.556377:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967465947648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 14us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.556381:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947776 00000100:00100000:0.0:1746147260.556381:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:1.0:1746147260.556383:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947776 00000100:00100000:1.0:1746147260.556397:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947392 00000100:00100000:1.0:1746147260.556399:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947392 00000100:00100000:0.0:1746147260.556402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.556411:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465947904 00000100:00100000:0.0:1746147260.556413:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465947904 00000100:00100000:1.0:1746147260.556414:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:1.0:1746147260.556418:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1958:x1830967465947776:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147260.556424:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 244 00000100:00100000:0.0:1746147260.556428:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465947904:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147260.556446:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1958:x1830967465947776:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.556448:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1958:x1830967465947904:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 19us (45us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.556452:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:0.0:1746147260.556452:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 244 00000100:00100000:1.0:1746147260.556463:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:1.0:1746147260.556467:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1958:x1830967465947392:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147260.556487:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1958:x1830967465947392:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 19us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.556491:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:0.0:1746147260.556510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.556529:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465948160 00000100:00100000:1.0:1746147260.556531:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465948160 00010000:00010000:1.0:1746147260.556550:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 27 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.556570:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8222 00000100:00100000:1.0:1746147260.556574:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967465948160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.556585:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147260.556590:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 27 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.556605:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 27 pid: 23726 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.556628:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147260.556634:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.556644:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.556652:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147260.556673:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147260.556676:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad234c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6f5 expref: 27 pid: 23726 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.556692:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967465948160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.556695:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467126144:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.556698:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8222 00010000:00010000:3.0:1746147260.556713:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.556720:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.556725:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147260.556824:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.557227:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 27 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.557239:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 26 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.557245:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.558657:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147260.558662:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422a00, rc 0) 00000100:00100000:3.0:1746147260.558719:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32153:x1830967465946880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8981us (9492us total) trans 8589945576 rc 0/0 00000100:00100000:3.0:1746147260.558727:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11553 00000100:00100000:0.0:1746147260.560365:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.560735:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465948416 00000100:00100000:1.0:1746147260.560745:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465948416 00002000:00100000:1.0:1746147260.560788:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2359295) req@ffff88012c85c700 x1830967465948416/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.560797:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c700 with x1830967465948416 ext(2097152->2359295) 00010000:00010000:1.0:1746147260.560807:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.560821:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 15 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.560832:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c85c700 00000100:00100000:1.0:1746147260.560914:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2617 00000100:00100000:1.0:1746147260.560923:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967465948416:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.561331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.561517:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465948672 00000100:00100000:2.0:1746147260.561524:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465948672 00002000:00100000:2.0:1746147260.561560:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2359296->3145727) req@ffff88012c85dc00 x1830967465948672/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.561573:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85dc00 with x1830967465948672 ext(2359296->3145727) 00010000:00010000:2.0:1746147260.561581:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 16 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.561593:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 16 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.561599:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c85dc00 00000100:00100000:2.0:1746147260.561621:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2618 00000100:00100000:2.0:1746147260.561628:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967465948672:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147260.570482:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465948416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9551us (10111us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1746147260.570495:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2617 00002000:00100000:1.0:1746147260.570506:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2359295) req@ffff88012c85c700 x1830967465948416/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.570516:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c700 with x1830967465948416 ext(2097152->2359295) 00010000:00010000:1.0:1746147260.570527:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.570543:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.570551:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c85c700 00000100:00100000:2.0:1746147260.578460:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465948672:12345-192.168.203.36@tcp:4:cat.0 Request processed in 16824us (17126us total) trans 21474841461 rc 0/0 00000100:00100000:2.0:1746147260.578472:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2618 00002000:00100000:2.0:1746147260.578482:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2359296->3145727) req@ffff88012c85dc00 x1830967465948672/t21474841461(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.578489:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85dc00 with x1830967465948672 ext(2359296->3145727) 00010000:00010000:2.0:1746147260.578497:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.578514:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.578520:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c85dc00 00000100:00100000:0.0:1746147260.580636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.580696:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465948800 00000100:00100000:3.0:1746147260.580705:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465948800 00000100:00100000:3.0:1746147260.580765:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16084 00000100:00100000:3.0:1746147260.580773:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32153:x1830967465948800:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147260.580793:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.580811:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed71f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.580840:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.580846:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.580852:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147260.580855:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2838528->3145727] (req 2838528->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.580891:0:6881:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.580902:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2838528->3145727] (req 2838528->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.580912:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422400, rc 0) 00000100:00100000:3.0:1746147260.580994:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32153:x1830967465948800:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 221us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.581000:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16084 00000100:00100000:0.0:1746147260.582178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.583099:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465948928 00000100:00100000:1.0:1746147260.583106:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465948928 00010000:00010000:1.0:1746147260.583134:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.583213:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8223 00000100:00100000:1.0:1746147260.583218:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465948928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147260.583233:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147260.583251:0:16058:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147259 -> 1746147260 00002000:00010000:1.0:1746147260.583253:0:16058:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147259 -> 1746147260 00010000:00010000:1.0:1746147260.583257:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.583994:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.584019:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2368 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed70a expref: 17 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.584050:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.584052:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.584060:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 10 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.584068:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 10 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.584111:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 10 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.584123:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 10 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.584137:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467126400:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147260.584245:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.584699:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.584982:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465949184 00000100:00100000:3.0:1746147260.584994:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465949184 00002000:00100000:3.0:1746147260.585186:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e918700 x1830967465949184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.585195:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918700 with x1830967465949184 ext(3145728->4194303) 00002000:00010000:3.0:1746147260.585200:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e918700 00000100:00100000:3.0:1746147260.585226:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7666 00000100:00100000:3.0:1746147260.585234:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967465949184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.589013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.589033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.589060:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465949312 00000100:00100000:1.0:1746147260.589072:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465949312 00000100:00100000:2.0:1746147260.589102:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465949440 00000100:00100000:2.0:1746147260.589109:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465949440 00000100:00100000:1.0:1746147260.589137:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16085 00000100:00100000:1.0:1746147260.589144:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+17:32148:x1830967465949312:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147260.589156:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16086 00000100:00100000:2.0:1746147260.589163:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32143:x1830967465949440:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147260.589163:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147260.589176:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.589180:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed726 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589190:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed72d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.589203:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.589209:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2838528->3145727] (req 2838528->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589212:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.589214:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.589218:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589220:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.589226:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.589232:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589237:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.589239:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147260.589242:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.589252:0:4445:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2838528->3145727] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589266:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.589267:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589274:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 8 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.589282:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3dc800, rc 0) 00000100:00100000:2.0:1746147260.589284:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467126656:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147260.589346:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+18:32148:x1830967465949312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 200us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.589353:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16085 00000100:00100000:1.0:1746147260.589411:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467126400:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147260.589425:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147260.589448:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465948928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6229us (7272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.589455:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8223 00010000:00010000:2.0:1746147260.589475:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 7 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.589482:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 7 pid: 21080 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746147260.589489:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467126784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.589513:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.589520:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 24 pid: 8480 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746147260.589527:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467126912:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.589550:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.589558:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.589565:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467127040:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.589580:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.594704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.594746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.594834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.594885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.594911:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950080 00000100:00100000:0.0:1746147260.594919:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950080 00010000:00010000:0.0:1746147260.594986:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 8 pid: 21080 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746147260.595012:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950208 00000100:00100000:0.0:1746147260.595014:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950208 00010000:00010000:0.0:1746147260.595023:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 9 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.595037:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8224 00000100:00100000:0.0:1746147260.595043:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465950080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.595056:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.595076:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 8 pid: 21080 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.595097:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 8 pid: 21080 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746147260.595128:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.595170:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465950080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.595176:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8224 00000100:00100000:0.0:1746147260.595191:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8225 00000100:00100000:0.0:1746147260.595195:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465950208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.595201:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.595207:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 9 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.595214:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 9 pid: 4445 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.595224:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.595237:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465950208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147260.595241:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8225 00000100:00100000:1.0:1746147260.595425:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465949696 00000100:00100000:1.0:1746147260.595430:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465949696 00002000:00100000:1.0:1746147260.595459:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e918000 x1830967465949696/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.595468:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918000 with x1830967465949696 ext(2097152->3145727) 00010000:00010000:1.0:1746147260.595474:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.595484:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.595491:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e918000 00000100:00100000:1.0:1746147260.595502:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465949824 00000100:00100000:1.0:1746147260.595504:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465949824 00002000:00100000:1.0:1746147260.595512:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e919c00 x1830967465949824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.595518:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919c00 with x1830967465949824 ext(3145728->4194303) 00010000:00010000:1.0:1746147260.595522:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 12 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.595529:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 12 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.595535:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e919c00 00000100:00100000:1.0:1746147260.595546:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2619 00000100:00100000:1.0:1746147260.595550:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465949696:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147260.595623:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2620 00000100:00100000:2.0:1746147260.595631:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465949824:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147260.596220:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c53600/0xb4b2209fbdad21ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed631 expref: 8 pid: 4445 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.596242:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467126656:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.596254:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f865c00/0xb4b2209fbdad22b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a8 expref: 7 pid: 21080 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746147260.596261:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467126784:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.596272:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467126912:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.596284:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467127040:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.596318:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.596328:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcfc00, rc 0) 00000100:00100000:3.0:1746147260.596364:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32143:x1830967465949440:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7202us (7330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.596371:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16086 00000100:00100000:3.0:1746147260.597592:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465949184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12352us (12887us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.597600:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7666 00002000:00100000:3.0:1746147260.597610:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e918700 x1830967465949184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.597620:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918700 with x1830967465949184 ext(3145728->4194303) 00010000:00010000:3.0:1746147260.597630:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 22 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746147260.597642:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 22 pid: 8480 timeout: 747 lvb_type: 1 00002000:00010000:3.0:1746147260.597648:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e918700 00000100:00100000:1.0:1746147260.597835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.597867:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950336 00000100:00100000:3.0:1746147260.597874:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950336 00010000:00010000:3.0:1746147260.597895:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.597930:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8226 00000100:00100000:3.0:1746147260.598091:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465950336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.598104:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.598123:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.598137:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.598160:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f56e000/0xb4b2209fbdad226c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed685 expref: 8 pid: 21080 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.598172:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.599946:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1956:x1830967465950336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1987us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.599958:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8226 00000100:00100000:1.0:1746147260.603342:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465949696:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 7781us (8639us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.603354:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2619 00002000:00100000:1.0:1746147260.603365:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e918000 x1830967465949696/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.603374:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918000 with x1830967465949696 ext(2097152->3145727) 00010000:00010000:1.0:1746147260.603384:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 13 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.603396:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 13 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.603403:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e918000 00000100:00100000:0.0:1746147260.605714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.605811:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950464 00000100:00100000:3.0:1746147260.605822:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950464 00010000:00010000:3.0:1746147260.605856:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 22 pid: 8480 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746147260.605900:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8227 00000100:00100000:3.0:1746147260.605908:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967465950464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.605927:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.605987:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 22 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746147260.605997:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 22 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746147260.606020:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdad2329 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6e7 expref: 22 pid: 8480 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746147260.606036:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.606038:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.606044:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.606052:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.606093:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.606105:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467127168:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.606974:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.608567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.608698:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950592 00000100:00100000:3.0:1746147260.608705:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950592 00000100:00100000:3.0:1746147260.608744:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16087 00000100:00100000:3.0:1746147260.608749:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32151:x1830967465950592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.608764:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.608782:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed734 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.608824:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.608831:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.608834:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.608837:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.608862:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.608888:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.608901:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467127296:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.608968:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.608999:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467127168:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147260.609014:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.609032:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967465950464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3125us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.609040:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8227 00000100:00100000:1.0:1746147260.609403:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465949824:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13772us (14654us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.609414:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2620 00002000:00100000:1.0:1746147260.609423:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e919c00 x1830967465949824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.609433:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919c00 with x1830967465949824 ext(3145728->4194303) 00010000:00010000:1.0:1746147260.609443:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.609452:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.609457:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e919c00 00000100:00100000:0.0:1746147260.612005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.612361:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950848 00000100:00100000:1.0:1746147260.612371:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950848 00002000:00100000:1.0:1746147260.612416:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3194880->3198975) req@ffff88008e918a80 x1830967465950848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.612425:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918a80 with x1830967465950848 ext(3194880->3198975) 00010000:00010000:1.0:1746147260.612434:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.612447:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.612453:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e918a80 00000100:00100000:1.0:1746147260.612476:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2621 00000100:00100000:1.0:1746147260.612483:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465950848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.612561:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467127296:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.612585:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.612598:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422800, rc 0) 00000100:00100000:3.0:1746147260.612638:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32151:x1830967465950592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3887us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.612644:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16087 00000100:00100000:1.0:1746147260.612682:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967465950848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 198us (684us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147260.612687:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2621 00002000:00100000:1.0:1746147260.612692:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3194880->3198975) req@ffff88008e918a80 x1830967465950848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.612702:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918a80 with x1830967465950848 ext(3194880->3198975) 00010000:00010000:1.0:1746147260.612707:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.612714:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.612719:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e918a80 00000100:00100000:0.0:1746147260.616432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.616489:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465950976 00000100:00100000:3.0:1746147260.616498:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465950976 00010000:00010000:3.0:1746147260.616532:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746147260.616532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.616562:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8228 00000100:00100000:3.0:1746147260.616567:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465950976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.616579:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.616599:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.616606:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465951232 00010000:00010000:3.0:1746147260.616607:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.616611:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465951232 00010000:00010000:3.0:1746147260.616626:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad236f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed711 expref: 11 pid: 11147 timeout: 747 lvb_type: 0 00002000:00100000:1.0:1746147260.616643:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3198975) req@ffff88009f150700 x1830967465951232/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147260.616647:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.616648:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746147260.616651:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150700 with x1830967465951232 ext(3145728->3198975) 00000100:00100000:0.0:1746147260.616653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147260.616654:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.616658:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.616660:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.616669:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 21 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.616675:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f150700 00000100:00100000:1.0:1746147260.616694:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2622 00000100:00100000:2.0:1746147260.616699:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465951488 00000100:00100000:1.0:1746147260.616700:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967465951232:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147260.616702:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465951488 00000100:00100000:2.0:1746147260.616727:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4849 00000100:00100000:2.0:1746147260.616730:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+316:32143:x1830967465951488:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:3.0:1746147260.616885:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.616895:0:7120:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.616909:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467127424:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.616995:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.617079:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32143:x1830967465951488:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 255us (334us total) trans 8589945577 rc 0/0 00000100:00100000:2.0:1746147260.617096:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4849 00000100:00100000:2.0:1746147260.619503:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467127424:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.619530:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.619590:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465950976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3020us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.619601:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8228 00000100:00100000:0.0:1746147260.620173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.620278:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465951232:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3576us (3745us total) trans 17179874107 rc 0/0 00000100:00100000:1.0:1746147260.620288:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2622 00002000:00100000:1.0:1746147260.620300:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3198975) req@ffff88009f150700 x1830967465951232/t17179874107(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.620311:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150700 with x1830967465951232 ext(3145728->3198975) 00010000:00010000:1.0:1746147260.620323:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 23 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.620337:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 23 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.620344:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f150700 00000100:00100000:1.0:1746147260.620363:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465951744 00000100:00100000:1.0:1746147260.620370:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465951744 00002000:00100000:1.0:1746147260.620400:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2838528->2842623) req@ffff88009f151880 x1830967465951744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.620408:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151880 with x1830967465951744 ext(2838528->2842623) 00010000:00010000:1.0:1746147260.620413:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.620422:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.620428:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f151880 00000100:00100000:1.0:1746147260.620456:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2623 00000100:00100000:1.0:1746147260.620463:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465951744:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147260.620570:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465951744:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 108us (398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147260.620580:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2623 00002000:00100000:1.0:1746147260.620585:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2838528->2842623) req@ffff88009f151880 x1830967465951744/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.620592:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151880 with x1830967465951744 ext(2838528->2842623) 00010000:00010000:1.0:1746147260.620596:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.620604:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.620609:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f151880 00000100:00100000:0.0:1746147260.621973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.622058:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465951872 00000100:00100000:2.0:1746147260.622065:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465951872 00010000:00010000:2.0:1746147260.622102:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 23 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.622136:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8229 00000100:00100000:2.0:1746147260.622143:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465951872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147260.622155:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147260.622173:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 23 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.622184:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 23 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.622205:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2399 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed72d expref: 23 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.622218:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.622220:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.622234:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 7 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.622241:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 7 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.622274:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 7 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.622285:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467127552:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147260.622360:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.625339:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467127552:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.625385:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.625535:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967465951872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3389us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.625545:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8229 00000100:00100000:0.0:1746147260.627452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.628145:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465952128 00000100:00100000:1.0:1746147260.628155:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465952128 00002000:00100000:1.0:1746147260.628206:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2838528->3145727) req@ffff88009f153800 x1830967465952128/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.628216:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f153800 with x1830967465952128 ext(2838528->3145727) 00010000:00010000:1.0:1746147260.628226:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.628239:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.628246:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f153800 00000100:00100000:1.0:1746147260.628277:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2624 00000100:00100000:1.0:1746147260.628285:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465952128:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147260.629258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.629334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.629349:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465952384 00000100:00100000:0.0:1746147260.629353:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465952384 00002000:00100000:0.0:1746147260.629376:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009f150e00 x1830967465952384/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.629384:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150e00 with x1830967465952384 ext(3145728->4194303) 00002000:00010000:0.0:1746147260.629387:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f150e00 00000100:00100000:0.0:1746147260.629399:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465952640 00000100:00100000:0.0:1746147260.629401:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465952640 00002000:00100000:0.0:1746147260.629410:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f151500 x1830967465952640/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147260.629417:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7667 00002000:00100000:0.0:1746147260.629417:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151500 with x1830967465952640 ext(3145728->4194303) 00010000:00010000:0.0:1746147260.629422:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.629426:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465952384:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:0.0:1746147260.629433:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:0.0:1746147260.629439:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f151500 00000100:00100000:0.0:1746147260.629450:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2625 00000100:00100000:0.0:1746147260.629455:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465952640:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147260.637455:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465952128:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9160us (10001us total) trans 21474841462 rc 0/0 00000100:00100000:2.0:1746147260.637468:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2624 00002000:00100000:2.0:1746147260.637481:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2838528->3145727) req@ffff88009f153800 x1830967465952128/t21474841462(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.637500:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f153800 with x1830967465952128 ext(2838528->3145727) 00010000:00010000:2.0:1746147260.637510:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 14 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.637525:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 14 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.637531:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f153800 00000100:00100000:1.0:1746147260.641249:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465952640:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11777us (11899us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.641263:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2625 00002000:00100000:1.0:1746147260.641275:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f151500 x1830967465952640/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.641285:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151500 with x1830967465952640 ext(3145728->4194303) 00010000:00010000:1.0:1746147260.641297:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.641312:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.641320:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f151500 00000100:00100000:3.0:1746147260.643010:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967465952384:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13579us (13746us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.643021:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7667 00002000:00100000:3.0:1746147260.643030:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009f150e00 x1830967465952384/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.643039:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150e00 with x1830967465952384 ext(3145728->4194303) 00002000:00010000:3.0:1746147260.643043:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f150e00 00000100:00100000:0.0:1746147260.647448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.647483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.647544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.647631:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465952896 00000100:00100000:3.0:1746147260.647641:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465952896 00000100:00100000:3.0:1746147260.647679:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465953024 00000100:00100000:3.0:1746147260.647681:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465953024 00000100:00100000:3.0:1746147260.647697:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16088 00000100:00100000:3.0:1746147260.647704:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32153:x1830967465952896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147260.647722:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.647739:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed73b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.647767:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.647780:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.647782:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.647785:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.647813:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.647823:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.647835:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467127680:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.647916:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.647989:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16089 00000100:00100000:1.0:1746147260.647997:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32151:x1830967465953024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.648005:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.648017:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed742 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.648032:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.648034:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147260.648038:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 13 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.648047:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 13 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.648061:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d3200, rc 0) 00000100:00100000:2.0:1746147260.648098:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465952768 00000100:00100000:2.0:1746147260.648102:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465952768 00000100:00100000:1.0:1746147260.648104:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32151:x1830967465953024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 108us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147260.648111:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16089 00010000:00010000:2.0:1746147260.648120:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 14 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.648144:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8230 00000100:00100000:2.0:1746147260.648149:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465952768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147260.648159:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147260.648180:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 13 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.648189:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 13 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.648203:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad238b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2838528->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed71f expref: 13 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.648217:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.648219:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.648224:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.648232:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.648239:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.648240:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.648242:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.648247:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.648265:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.648274:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467127808:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.648319:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.648327:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467127936:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147260.648482:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.650587:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467127680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.650615:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.650630:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422600, rc 0) 00000100:00100000:3.0:1746147260.650681:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32153:x1830967465952896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2977us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.650689:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16088 00000100:00100000:2.0:1746147260.650768:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467127808:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147260.651800:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467127936:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.651816:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.651852:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465952768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3701us (4306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.651860:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8230 00000100:00100000:0.0:1746147260.655347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.655568:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465953280 00000100:00100000:3.0:1746147260.655582:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465953280 00002000:00100000:3.0:1746147260.655629:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f150380 x1830967465953280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.655650:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150380 with x1830967465953280 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.655655:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f150380 00000100:00100000:3.0:1746147260.655692:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7668 00000100:00100000:3.0:1746147260.655700:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465953280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.657092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.657983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.658037:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465953664 00000100:00100000:1.0:1746147260.658046:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465953664 00002000:00100000:1.0:1746147260.658095:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f152300 x1830967465953664/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.658104:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152300 with x1830967465953664 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.658109:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f152300 00000100:00100000:1.0:1746147260.658128:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7669 00000100:00100000:1.0:1746147260.658134:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465953664:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.658757:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465953408 00000100:00100000:3.0:1746147260.658763:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465953408 00010000:00010000:3.0:1746147260.658785:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.659290:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8231 00000100:00100000:3.0:1746147260.659296:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465953408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.659309:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.659328:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.659340:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.659362:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad23a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed734 expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.659388:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.659390:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.659398:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.659845:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.659883:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.659894:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467128064:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147260.662434:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.665819:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465953280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10105us (10468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.665833:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7668 00002000:00100000:3.0:1746147260.665847:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f150380 x1830967465953280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.665856:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150380 with x1830967465953280 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.665863:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f150380 00000100:00100000:2.0:1746147260.668433:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467128064:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147260.668434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147260.668453:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.668507:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465953408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9209us (11424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.668517:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8231 00000100:00100000:3.0:1746147260.668599:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465953920 00000100:00100000:3.0:1746147260.668606:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465953920 00002000:00100000:3.0:1746147260.668649:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3227648->3231743) req@ffff88009f153b80 x1830967465953920/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.668658:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f153b80 with x1830967465953920 ext(3227648->3231743) 00002000:00010000:3.0:1746147260.668663:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f153b80 00000100:00100000:3.0:1746147260.668685:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7670 00000100:00100000:3.0:1746147260.668691:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465953920:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.668862:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967465953920:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 171us (432us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147260.668868:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7670 00002000:00100000:3.0:1746147260.668872:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3227648->3231743) req@ffff88009f153b80 x1830967465953920/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.668879:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f153b80 with x1830967465953920 ext(3227648->3231743) 00002000:00010000:3.0:1746147260.668881:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f153b80 00000100:00100000:1.0:1746147260.672045:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465953664:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13903us (14057us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.672056:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7669 00002000:00100000:1.0:1746147260.672066:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f152300 x1830967465953664/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.672072:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f152300 with x1830967465953664 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.672077:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f152300 00000100:00100000:0.0:1746147260.677459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.677533:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465954048 00000100:00100000:3.0:1746147260.677544:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465954048 00000100:00100000:3.0:1746147260.677596:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16090 00000100:00100000:3.0:1746147260.677604:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:32148:x1830967465954048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.677623:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.677642:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed749 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.677672:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 7 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.677679:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.677681:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.677684:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.677720:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 7 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.677731:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 7 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.677747:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128192:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.678361:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.680007:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128192:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.680036:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.680053:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422000, rc 0) 00000100:00100000:3.0:1746147260.680111:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32148:x1830967465954048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2505us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.680120:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16090 00000100:00100000:0.0:1746147260.680633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.680828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.680932:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465954304 00000100:00100000:1.0:1746147260.680957:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465954304 00002000:00100000:1.0:1746147260.680994:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134f87100 x1830967465954304/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.681009:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87100 with x1830967465954304 ext(4194304->4976639) 00010000:00010000:1.0:1746147260.681016:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 8 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.681028:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 8 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.681034:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f87100 00000100:00100000:1.0:1746147260.681058:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465954432 00000100:00100000:1.0:1746147260.681061:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465954432 00002000:00100000:1.0:1746147260.681071:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3231743) req@ffff880134f86d80 x1830967465954432/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.681077:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86d80 with x1830967465954432 ext(3145728->3231743) 00010000:00010000:1.0:1746147260.681081:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.681096:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.681098:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2626 00002000:00010000:1.0:1746147260.681102:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f86d80 00000100:00100000:2.0:1746147260.681108:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465954304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147260.681112:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2627 00000100:00100000:1.0:1746147260.681116:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967465954432:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147260.684415:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465954432:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3287us (3576us total) trans 17179874108 rc 0/0 00000100:00100000:1.0:1746147260.684429:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2627 00002000:00100000:1.0:1746147260.684442:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3231743) req@ffff880134f86d80 x1830967465954432/t17179874108(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.684450:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86d80 with x1830967465954432 ext(3145728->3231743) 00010000:00010000:1.0:1746147260.684459:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.684471:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.684477:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f86d80 00000100:00100000:2.0:1746147260.688472:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465954304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7355us (7828us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147260.688485:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2626 00002000:00100000:2.0:1746147260.688497:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134f87100 x1830967465954304/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.688512:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87100 with x1830967465954304 ext(4194304->4976639) 00010000:00010000:2.0:1746147260.688522:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.688537:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.688545:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134f87100 00000100:00100000:1.0:1746147260.695697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.695795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.695966:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465954688 00000100:00100000:3.0:1746147260.695977:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465954560 00000100:00100000:2.0:1746147260.695977:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465954688 00000100:00100000:3.0:1746147260.695981:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465954560 00010000:00010000:2.0:1746147260.696017:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.696027:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16091 00000100:00100000:3.0:1746147260.696035:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465954560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.696050:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147260.696053:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8232 00000100:00100000:2.0:1746147260.696060:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465954688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.696064:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423400/0xb4b2209fbdad23bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed750 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.696071:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147260.696104:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.696116:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 12 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.696122:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128320:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147260.696136:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.696138:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147260.696146:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.696160:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.696183:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.696192:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467128448:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.696208:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.696217:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.699465:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467128448:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.699487:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.699542:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465954688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3480us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.699553:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8232 00010000:00010000:3.0:1746147260.699662:0:6881:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a044a300 x1830967467128320) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.699715:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094422600/0xb4b2209fbdad23a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed73b expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.699739:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128320:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147260.699763:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423400/0xb4b2209fbdad23bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed750 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147260.699774:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423400/0xb4b2209fbdad23bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed750 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147260.699781:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423400, rc 0) 00000100:00100000:3.0:1746147260.699818:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465954560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3784us (4131us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147260.699824:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16091 00000100:00100000:2.0:1746147260.704579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.704623:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.704667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.704738:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465955200 00000100:00100000:0.0:1746147260.704739:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465955328 00000100:00100000:1.0:1746147260.704748:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465955200 00000100:00100000:0.0:1746147260.704748:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465955328 00002000:00100000:1.0:1746147260.704797:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c9f0e00 x1830967465955200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.704798:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e91aa00 x1830967465955328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.704808:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967465955200 ext(3145728->4194303) 00002000:00100000:0.0:1746147260.704808:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91aa00 with x1830967465955328 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.704813:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0e00 00002000:00010000:0.0:1746147260.704813:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e91aa00 00000100:00100000:1.0:1746147260.704834:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7671 00000100:00100000:0.0:1746147260.704840:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7672 00000100:00100000:1.0:1746147260.704842:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465955200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.704845:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465954944 00000100:00100000:0.0:1746147260.704846:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465955328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.704848:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465954944 00000100:00100000:3.0:1746147260.704877:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16092 00000100:00100000:3.0:1746147260.704882:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32151:x1830967465954944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.704891:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.704906:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed757 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.704926:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.704928:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.704953:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.704967:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.704976:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423c00, rc 0) 00000100:00100000:3.0:1746147260.705021:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32151:x1830967465954944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.705027:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16092 00000100:00100000:0.0:1746147260.711882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.714202:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465955584 00000100:00100000:2.0:1746147260.714214:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465955584 00002000:00100000:2.0:1746147260.716907:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff880134f87b80 x1830967465955584/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.716920:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87b80 with x1830967465955584 ext(4972544->4976639) 00002000:00010000:2.0:1746147260.716925:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f87b80 00000100:00100000:2.0:1746147260.716985:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7673 00000100:00100000:2.0:1746147260.716993:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465955584:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147260.720142:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465955584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 3139us (8255us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147260.720152:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7673 00002000:00100000:2.0:1746147260.720161:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff880134f87b80 x1830967465955584/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.720169:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87b80 with x1830967465955584 ext(4972544->4976639) 00002000:00010000:2.0:1746147260.720175:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f87b80 00000100:00100000:1.0:1746147260.721208:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967465955328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16359us (16538us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.721217:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7672 00002000:00100000:1.0:1746147260.721223:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e91aa00 x1830967465955328/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.721234:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91aa00 with x1830967465955328 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.721238:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e91aa00 00000100:00100000:0.0:1746147260.722754:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465955200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17907us (18128us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147260.722762:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7671 00002000:00100000:0.0:1746147260.722769:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c9f0e00 x1830967465955200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147260.722776:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967465955200 ext(3145728->4194303) 00002000:00010000:0.0:1746147260.722780:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:0.0:1746147260.725560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.725619:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465955840 00000100:00100000:2.0:1746147260.725626:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465955840 00000100:00100000:2.0:1746147260.725667:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4850 00000100:00100000:2.0:1746147260.725673:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32151:x1830967465955840:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147260.725840:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32151:x1830967465955840:12345-192.168.203.36@tcp:35:cat.0 Request processed in 166us (286us total) trans 8589945578 rc 0/0 00000100:00100000:2.0:1746147260.725846:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4850 00000100:00100000:0.0:1746147260.729046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.729115:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465956096 00000100:00100000:2.0:1746147260.729123:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465956096 00002000:00100000:2.0:1746147260.729158:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134f84000 x1830967465956096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.729166:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84000 with x1830967465956096 ext(4194304->4976639) 00002000:00010000:2.0:1746147260.729170:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84000 00000100:00100000:2.0:1746147260.729198:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7674 00000100:00100000:2.0:1746147260.729204:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465956096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147260.738048:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967465956096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8836us (9001us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147260.738062:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7674 00002000:00100000:2.0:1746147260.738072:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880134f84000 x1830967465956096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.738080:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84000 with x1830967465956096 ext(4194304->4976639) 00002000:00010000:2.0:1746147260.738101:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84000 00000100:00100000:0.0:1746147260.844900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.845298:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465956352 00000100:00100000:3.0:1746147260.845306:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465956352 00000100:00100000:3.0:1746147260.846559:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11554 00000100:00100000:3.0:1746147260.846567:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32159:x1830967465956352:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147260.846586:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.846601:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad23ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed75e expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.846672:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.846684:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.846691:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147260.846699:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.846785:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad23ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 320 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.846819:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 319 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.846827:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.846829:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147260.846832:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422800, rc 0) 00000100:00100000:3.0:1746147260.846890:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32159:x1830967465956352:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 323us (1996us total) trans 8589945579 rc 0/0 00000100:00100000:3.0:1746147260.846896:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11554 00000100:00100000:0.0:1746147260.858762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.858871:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465956480 00000100:00100000:3.0:1746147260.858881:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465956480 00000100:00100000:3.0:1746147260.858927:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16093 00000100:00100000:3.0:1746147260.858964:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32159:x1830967465956480:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147260.858984:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.859004:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed765 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.859037:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.859045:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.859052:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.859054:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.859058:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3702784->3719167] (req 3702784->3719167) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.859384:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.859397:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 9 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.859409:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.859520:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.859527:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 24 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.859535:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128704:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.859553:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147260.863826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.864183:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465956736 00000100:00100000:3.0:1746147260.864194:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465956736 00000100:00100000:3.0:1746147260.864250:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11555 00000100:00100000:3.0:1746147260.864258:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32164:x1830967465956736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.864282:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.864300:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad23e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed76c expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.864401:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864413:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864423:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864435:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864440:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864445:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864548:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea800/0xb4b2209fbdad23fb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864556:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea800/0xb4b2209fbdad23fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864561:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea800/0xb4b2209fbdad23fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147260.864569:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.864639:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864644:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864650:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864658:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.864661:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864666:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864674:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147260.864677:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.864680:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864684:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad23ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864912:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864925:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864930:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864962:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094422600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.864966:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.864972:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147260.864987:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147260.864998:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128704:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147260.865020:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3702784->3719167] (req 3702784->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.865034:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423600, rc 0) 00000100:00100000:2.0:1746147260.865075:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32159:x1830967465956480:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6141us (6325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.865095:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16093 00010000:00010000:3.0:1746147260.865455:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473200) 00010000:00010000:3.0:1746147260.865457:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.865461:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.865465:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad23f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.865508:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad23e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed76c expref: 30 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.865517:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea800/0xb4b2209fbdad23fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed76c expref: 29 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.865523:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.865525:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147260.865527:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aea800, rc 0) 00000100:00100000:3.0:1746147260.865550:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32164:x1830967465956736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1293us (2874us total) trans 8589945580 rc 0/0 00000100:00100000:3.0:1746147260.865556:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11555 00000100:00100000:0.0:1746147260.865734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.867144:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465956864 00000100:00100000:2.0:1746147260.867152:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465956864 00010000:00010000:2.0:1746147260.867176:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.867287:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8233 00000100:00100000:2.0:1746147260.867448:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465956864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147260.867461:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147260.867478:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.867493:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.867510:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad23c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed757 expref: 10 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147260.867593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.867672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.867710:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465956992 00000100:00100000:1.0:1746147260.867716:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465956992 00000100:00100000:1.0:1746147260.867746:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16094 00000100:00100000:1.0:1746147260.867752:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465956992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.867767:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.867780:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f741000/0xb4b2209fbdad2409 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed773 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147260.867798:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147260.867807:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f741000/0xb4b2209fbdad2409 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed773 expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.867816:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f741000/0xb4b2209fbdad2409 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed773 expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147260.867908:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.867914:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465957120 00000100:00100000:0.0:1746147260.867918:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465957120 00010000:00010000:0.0:1746147260.867934:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.867961:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465956864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 663us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.867968:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8233 00000100:00100000:0.0:1746147260.867973:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8234 00000100:00100000:0.0:1746147260.867979:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465957120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.867986:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147260.868001:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.868010:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746147260.868024:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0xb4b2209fbdad23b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed749 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147260.868038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147260.868043:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.868045:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147260.868052:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.868055:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465957248 00000100:00100000:2.0:1746147260.868058:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465957248 00010000:00010000:0.0:1746147260.868059:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147260.868076:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 790 00000100:00100000:2.0:1746147260.868109:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967465957248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147260.868114:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.868117:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147260.868127:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467128832:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.868129:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea800/0xb4b2209fbdad23fb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed76c expref: 29 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147260.868140:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147260.868143:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147260.868192:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5cb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147260.868286:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f741000, rc 0) 00000100:00100000:2.0:1746147260.868621:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967465957248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 538us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.868677:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 790 00000100:00100000:1.0:1746147260.868729:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967465956992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 976us (1138us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147260.868736:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16094 00000100:00100000:0.0:1746147260.870168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.870356:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465957376 00000100:00100000:1.0:1746147260.870362:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465957376 00000100:00100000:1.0:1746147260.870400:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16095 00000100:00100000:1.0:1746147260.870407:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465957376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147260.870421:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147260.870433:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f740a00/0xb4b2209fbdad2410 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed77a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147260.870472:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128960:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147260.870548:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147260.874905:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467128832:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147260.874923:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147260.875004:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967465957120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7024us (7330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147260.875012:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8234 00002000:00010000:1.0:1746147260.880287:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147259 -> 1746147260 00000100:00100000:2.0:1746147260.880289:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.880327:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467128960:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147260.880368:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f740a00/0xb4b2209fbdad2410 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed77a expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147260.880383:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f740a00/0xb4b2209fbdad2410 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed77a expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147260.880492:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465957632 00000100:00100000:3.0:1746147260.880500:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465957632 00002000:00100000:3.0:1746147260.880562:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3702784->3706879) req@ffff88008e91a680 x1830967465957632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.880571:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a680 with x1830967465957632 ext(3702784->3706879) 00002000:00010000:3.0:1746147260.880576:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91a680 00000100:00100000:3.0:1746147260.880787:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7675 00000100:00100000:3.0:1746147260.880794:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465957632:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.882139:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967465957632:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1342us (1854us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147260.882151:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7675 00002000:00100000:3.0:1746147260.882158:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3702784->3706879) req@ffff88008e91a680 x1830967465957632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.882166:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91a680 with x1830967465957632 ext(3702784->3706879) 00002000:00010000:3.0:1746147260.882170:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e91a680 00010000:00010000:1.0:1746147260.882863:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f740a00, rc 0) 00000100:00100000:1.0:1746147260.882904:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465957376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12497us (12738us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147260.882911:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16095 00000100:00100000:0.0:1746147260.885198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.886278:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465957888 00000100:00100000:3.0:1746147260.886288:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465957888 00002000:00100000:3.0:1746147260.886333:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3715072->3719167) req@ffff88012e2b8a80 x1830967465957888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.886343:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8a80 with x1830967465957888 ext(3715072->3719167) 00002000:00010000:3.0:1746147260.886349:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8a80 00000100:00100000:3.0:1746147260.886378:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7676 00000100:00100000:3.0:1746147260.886385:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967465957888:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147260.887182:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967465957888:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 794us (1987us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147260.887190:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7676 00002000:00100000:3.0:1746147260.887195:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3715072->3719167) req@ffff88012e2b8a80 x1830967465957888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.887203:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8a80 with x1830967465957888 ext(3715072->3719167) 00002000:00010000:3.0:1746147260.887207:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8a80 00000100:00100000:0.0:1746147260.892918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.893004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.893060:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465958272 00000100:00100000:1.0:1746147260.893070:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465958272 00002000:00100000:1.0:1746147260.893129:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3702783) req@ffff88012e2b9880 x1830967465958272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.893139:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9880 with x1830967465958272 ext(3145728->3702783) 00002000:00010000:1.0:1746147260.893145:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b9880 00000100:00100000:1.0:1746147260.893164:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465958144 00000100:00100000:1.0:1746147260.893167:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465958144 00002000:00100000:1.0:1746147260.893177:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012e2bad80 x1830967465958144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.893184:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bad80 with x1830967465958144 ext(2097152->3145727) 00002000:00010000:1.0:1746147260.893186:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bad80 00000100:00100000:1.0:1746147260.893207:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7677 00000100:00100000:1.0:1746147260.893215:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465958272:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147260.893365:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7678 00000100:00100000:2.0:1746147260.893375:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967465958144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.894265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.894364:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465958528 00000100:00100000:3.0:1746147260.894371:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465958528 00000100:00100000:3.0:1746147260.894456:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16096 00000100:00100000:3.0:1746147260.894464:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32164:x1830967465958528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.894776:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.894979:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed781 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.895191:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.895204:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.895209:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.895215:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.895263:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.895551:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.895572:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129088:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147260.897797:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147260.898229:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465958272:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5009us (5317us total) trans 0 rc 557056/557056 00000100:00100000:1.0:1746147260.898242:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7677 00002000:00100000:1.0:1746147260.898255:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3702783) req@ffff88012e2b9880 x1830967465958272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 557056/557056 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.898265:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9880 with x1830967465958272 ext(3145728->3702783) 00010000:00010000:1.0:1746147260.898274:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.898288:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.898294:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2b9880 00000100:00100000:3.0:1746147260.902606:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129088:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147260.902639:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.902658:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcfc00, rc 0) 00000100:00100000:3.0:1746147260.902717:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32164:x1830967465958528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8254us (8458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.902727:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16096 00000100:00100000:0.0:1746147260.903910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.903976:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465958656 00000100:00100000:1.0:1746147260.903986:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465958656 00002000:00100000:1.0:1746147260.904025:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3702784->3719167) req@ffff88012e2b8e00 x1830967465958656/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 16872/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.904040:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8e00 with x1830967465958656 ext(3702784->3719167) 00010000:00010000:1.0:1746147260.904048:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.904060:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.904067:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2b8e00 00000100:00100000:1.0:1746147260.904104:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2628 00000100:00100000:1.0:1746147260.904111:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465958656:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147260.904604:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465958656:12345-192.168.203.36@tcp:4:cat.0 Request processed in 491us (702us total) trans 17179874109 rc 0/0 00000100:00100000:2.0:1746147260.904606:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465958144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11230us (11599us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147260.904610:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2628 00000100:00100000:2.0:1746147260.904616:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7678 00002000:00100000:1.0:1746147260.904617:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3702784->3719167) req@ffff88012e2b8e00 x1830967465958656/t17179874109(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 16872/448 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.904624:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8e00 with x1830967465958656 ext(3702784->3719167) 00002000:00100000:2.0:1746147260.904626:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012e2bad80 x1830967465958144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147260.904629:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00002000:00100000:2.0:1746147260.904635:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bad80 with x1830967465958144 ext(2097152->3145727) 00010000:00010000:1.0:1746147260.904639:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.904644:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.904644:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2b8e00 00010000:00010000:2.0:1746147260.904656:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.904663:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2bad80 00000100:00100000:0.0:1746147260.904922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.905186:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465958912 00000100:00100000:3.0:1746147260.905191:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465958912 00000100:00100000:3.0:1746147260.905235:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11556 00000100:00100000:3.0:1746147260.905241:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32167:x1830967465958912:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147260.905855:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.905880:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c0c00/0xb4b2209fbdad241e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed788 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.906252:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906264:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906270:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906278:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906281:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906285:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906350:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1e00/0xb4b2209fbdad2433 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906355:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1e00/0xb4b2209fbdad2433 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906358:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1e00/0xb4b2209fbdad2433 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147260.906363:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147260.906419:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906422:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906426:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906429:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5c1c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.906431:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906435:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906441:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147260.906442:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.906445:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906448:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1c00/0xb4b2209fbdad2425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906465:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906467:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906473:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906475:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5c1600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147260.906476:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906478:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906481:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e473c00) 00010000:00010000:3.0:1746147260.906482:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147260.906483:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906486:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdad242c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147260.906508:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c0c00/0xb4b2209fbdad241e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed788 expref: 31 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.906515:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1e00/0xb4b2209fbdad2433 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed788 expref: 30 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.906518:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.906519:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147260.906520:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5c1e00, rc 0) 00000100:00100000:3.0:1746147260.906559:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32167:x1830967465958912:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1319us (1638us total) trans 8589945581 rc 0/0 00000100:00100000:3.0:1746147260.906564:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11556 00000100:00100000:0.0:1746147260.907344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.907386:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465959168 00000100:00100000:2.0:1746147260.907393:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465959168 00002000:00100000:2.0:1746147260.907484:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3719168->4194303) req@ffff88012e2bb480 x1830967465959168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.907494:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967465959168 ext(3719168->4194303) 00010000:00010000:2.0:1746147260.907503:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.907513:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.907519:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2bb480 00000100:00100000:2.0:1746147260.907549:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2629 00000100:00100000:2.0:1746147260.907555:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465959168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.908364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.908407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.908414:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465959552 00000100:00100000:3.0:1746147260.908552:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465959296 00000100:00100000:3.0:1746147260.908559:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465959296 00000100:00100000:3.0:1746147260.908597:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 791 00000100:00100000:3.0:1746147260.908603:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967465959296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.908614:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.908628:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5c1e00/0xb4b2209fbdad2433 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed788 expref: 30 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.908641:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147260.908645:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.908667:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967465959296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.908673:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 791 00000100:00100000:1.0:1746147260.908806:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465959552 00000100:00100000:1.0:1746147260.908835:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4851 00000100:00100000:1.0:1746147260.908840:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32167:x1830967465959552:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147260.908982:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32167:x1830967465959552:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 141us (621us total) trans 8589945582 rc 0/0 00000100:00100000:1.0:1746147260.908987:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4851 00000100:00100000:0.0:1746147260.909858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.909893:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465959808 00000100:00100000:1.0:1746147260.909897:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465959808 00002000:00100000:1.0:1746147260.909915:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012e2ba300 x1830967465959808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.909921:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967465959808 ext(4194304->4976639) 00010000:00010000:1.0:1746147260.909926:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 27 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.909970:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 27 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.909975:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2ba300 00000100:00100000:1.0:1746147260.909990:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2630 00000100:00100000:1.0:1746147260.909993:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465959808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.913539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.913801:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465959936 00000100:00100000:3.0:1746147260.913808:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465959936 00000100:00100000:3.0:1746147260.913850:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16097 00000100:00100000:3.0:1746147260.913857:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32165:x1830967465959936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147260.913870:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147260.913883:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed78f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.913904:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.913906:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147260.913910:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.913919:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.913933:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5c1600, rc 0) 00000100:00100000:3.0:1746147260.913995:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32165:x1830967465959936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 139us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.914001:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16097 00000100:00100000:2.0:1746147260.916016:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465959168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8457us (8672us total) trans 0 rc 475136/475136 00000100:00100000:2.0:1746147260.916024:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2629 00002000:00100000:2.0:1746147260.916033:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3719168->4194303) req@ffff88012e2bb480 x1830967465959168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.916041:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967465959168 ext(3719168->4194303) 00010000:00010000:2.0:1746147260.916047:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 28 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147260.916058:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 28 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746147260.916063:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2bb480 00000100:00100000:1.0:1746147260.920293:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967465959808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10289us (10428us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147260.920304:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2630 00002000:00100000:1.0:1746147260.920316:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012e2ba300 x1830967465959808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.920329:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967465959808 ext(4194304->4976639) 00010000:00010000:1.0:1746147260.920338:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147260.920351:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746147260.920357:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2ba300 00000100:00100000:0.0:1746147260.928168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.928971:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465960064 00000100:00100000:3.0:1746147260.928983:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465960064 00010000:00010000:3.0:1746147260.929009:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147260.929039:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8235 00000100:00100000:3.0:1746147260.929043:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967465960064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147260.929052:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147260.929067:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.929075:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.929103:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad23df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->3719167) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed765 expref: 26 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746147260.929166:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.929169:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.929175:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.929187:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.929195:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.929196:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147260.929199:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.929205:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147260.929234:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.929245:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467129216:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147260.930020:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147260.930029:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467129344:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.930065:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147260.931736:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467129216:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147260.931746:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467129344:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147260.931758:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147260.931783:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465960064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2739us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147260.931792:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8235 00000100:00100000:0.0:1746147260.933499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147260.933548:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465960320 00000100:00100000:1.0:1746147260.933555:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465960320 00002000:00100000:1.0:1746147260.933587:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012e2baa00 x1830967465960320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147260.933600:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967465960320 ext(3145728->4194303) 00002000:00010000:1.0:1746147260.933605:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2baa00 00000100:00100000:1.0:1746147260.933723:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7679 00000100:00100000:1.0:1746147260.933731:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465960320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147260.940506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.940710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147260.940749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.943199:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465960704 00000100:00100000:2.0:1746147260.943209:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465960704 00002000:00100000:2.0:1746147260.943246:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009ee5ed80 x1830967465960704/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.943261:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ed80 with x1830967465960704 ext(2097152->3145727) 00002000:00010000:2.0:1746147260.943265:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ed80 00000100:00100000:2.0:1746147260.943282:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465960832 00000100:00100000:2.0:1746147260.943285:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465960832 00002000:00100000:2.0:1746147260.943295:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009ee5f800 x1830967465960832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.943301:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f800 with x1830967465960832 ext(3145728->4194303) 00002000:00010000:2.0:1746147260.943304:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5f800 00000100:00100000:3.0:1746147260.943331:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465961088 00000100:00100000:3.0:1746147260.943336:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465961088 00000100:00100000:1.0:1746147260.943338:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7680 00000100:00100000:1.0:1746147260.943348:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465960704:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147260.943352:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009ee5dc00 x1830967465961088/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.943360:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5dc00 with x1830967465961088 ext(2097152->3145727) 00002000:00010000:3.0:1746147260.943363:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5dc00 00000100:00100000:3.0:1746147260.943374:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7681 00000100:00100000:3.0:1746147260.943378:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465960832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.943523:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7682 00000100:00100000:3.0:1746147260.943528:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465961088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147260.946110:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465960320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12373us (12609us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.946120:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7679 00002000:00100000:2.0:1746147260.946128:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012e2baa00 x1830967465960320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.946136:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967465960320 ext(3145728->4194303) 00002000:00010000:2.0:1746147260.946140:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2baa00 00000100:00100000:0.0:1746147260.959415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147260.959545:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465961344 00000100:00100000:2.0:1746147260.959553:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465961344 00002000:00100000:2.0:1746147260.959591:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009ee5c000 x1830967465961344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.959602:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5c000 with x1830967465961344 ext(4194304->4976639) 00002000:00010000:2.0:1746147260.959607:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5c000 00000100:00100000:2.0:1746147260.959628:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7683 00000100:00100000:2.0:1746147260.959634:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465961344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.960242:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465960832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16861us (19530us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147260.960250:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7681 00002000:00100000:3.0:1746147260.960256:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009ee5f800 x1830967465960832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.960263:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f800 with x1830967465960832 ext(3145728->4194303) 00002000:00010000:3.0:1746147260.960266:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5f800 00000100:00100000:2.0:1746147260.963572:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465961088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20037us (22817us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.963583:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7682 00002000:00100000:2.0:1746147260.963594:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009ee5dc00 x1830967465961088/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.963602:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5dc00 with x1830967465961088 ext(2097152->3145727) 00002000:00010000:2.0:1746147260.963607:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5dc00 00000100:00100000:2.0:1746147260.966835:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465960704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23483us (26330us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147260.966844:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7680 00002000:00100000:2.0:1746147260.966853:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009ee5ed80 x1830967465960704/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147260.966860:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ed80 with x1830967465960704 ext(2097152->3145727) 00002000:00010000:2.0:1746147260.966865:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ed80 00000100:00100000:3.0:1746147260.968240:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465961344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8600us (8827us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147260.968249:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7683 00002000:00100000:3.0:1746147260.968257:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009ee5c000 x1830967465961344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.968270:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5c000 with x1830967465961344 ext(4194304->4976639) 00002000:00010000:3.0:1746147260.968275:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5c000 00000100:00100000:0.0:1746147260.973055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.973734:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465961600 00000100:00100000:3.0:1746147260.973744:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465961600 00002000:00100000:3.0:1746147260.973781:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009ee5df80 x1830967465961600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/0 e 0 to 0 dl 1746147271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.973790:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5df80 with x1830967465961600 ext(4194304->4976639) 00002000:00010000:3.0:1746147260.973795:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5df80 00000100:00100000:3.0:1746147260.977124:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7684 00000100:00100000:3.0:1746147260.977142:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465961600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147260.983806:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465961600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6663us (10754us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147260.983817:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7684 00002000:00100000:3.0:1746147260.983825:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009ee5df80 x1830967465961600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:636/0 lens 488/440 e 0 to 0 dl 1746147271 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147260.983834:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5df80 with x1830967465961600 ext(4194304->4976639) 00002000:00010000:3.0:1746147260.983838:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5df80 00000100:00100000:0.0:1746147260.988523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147260.988639:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465961856 00000100:00100000:3.0:1746147260.988646:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465961856 00000100:00100000:3.0:1746147260.988893:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4852 00000100:00100000:3.0:1746147260.988905:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32164:x1830967465961856:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147260.989347:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32164:x1830967465961856:12345-192.168.203.36@tcp:35:cat.0 Request processed in 441us (830us total) trans 8589945583 rc 0/0 00000100:00100000:3.0:1746147260.989356:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4852 00000100:00100000:0.0:1746147261.007408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.008174:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465961984 00000100:00100000:3.0:1746147261.008182:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465961984 00000100:00100000:3.0:1746147261.008240:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16098 00000100:00100000:3.0:1746147261.008247:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32167:x1830967465961984:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.008260:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.008273:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed796 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.008405:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.008414:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.008418:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00080000:0.0:1746147261.008427:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746147261.008646:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.008651:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2211840->2965503] (req 2211840->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.008679:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.008689:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 24 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147261.008700:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129472:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.009431:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.009440:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746147261.009448:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129600:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.009914:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.014268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.014381:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129472:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.014391:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129600:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.014420:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2211840->2965503] (req 2211840->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.014435:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f361e00, rc 0) 00000100:00100000:3.0:1746147261.014473:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32167:x1830967465961984:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6226us (7071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.014480:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16098 00000100:00100000:2.0:1746147261.014568:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465962112 00000100:00100000:2.0:1746147261.014574:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465962112 00010000:00010000:2.0:1746147261.014597:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746147261.014630:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8236 00000100:00100000:2.0:1746147261.014636:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465962112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.014647:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.014664:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147261.014680:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147261.014699:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1600/0xb4b2209fbdad2441 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed78f expref: 25 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746147261.014721:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.014739:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465962112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.014744:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8236 00000100:00100000:0.0:1746147261.014933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.015050:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465962240 00000100:00100000:1.0:1746147261.015053:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465962240 00010000:00010000:1.0:1746147261.015066:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746147261.015090:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8237 00000100:00100000:1.0:1746147261.015095:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1958:x1830967465962240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147261.015102:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147261.015111:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147261.015118:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147261.015128:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcfc00/0xb4b2209fbdad2417 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed781 expref: 11 pid: 6881 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746147261.015139:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.015140:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.015146:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.015153:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.015176:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.015185:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467129728:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147261.015230:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147261.017343:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147261.017441:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467129728:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.017461:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.017505:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465962240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2409us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.017512:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8237 00000100:00100000:1.0:1746147261.017699:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.017744:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465962496 00000100:00100000:3.0:1746147261.017749:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465962496 00002000:00100000:3.0:1746147261.017778:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2211840->2215935) req@ffff88009e6f2d80 x1830967465962496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.017786:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2d80 with x1830967465962496 ext(2211840->2215935) 00002000:00010000:3.0:1746147261.017790:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2d80 00000100:00100000:3.0:1746147261.018161:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7685 00000100:00100000:3.0:1746147261.018168:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465962496:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147261.018298:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465962496:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 130us (605us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147261.018304:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7685 00002000:00100000:3.0:1746147261.018309:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2211840->2215935) req@ffff88009e6f2d80 x1830967465962496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.018316:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2d80 with x1830967465962496 ext(2211840->2215935) 00002000:00010000:3.0:1746147261.018319:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2d80 00000100:00100000:0.0:1746147261.024399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.024527:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465962752 00000100:00100000:2.0:1746147261.024537:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465962752 00002000:00100000:2.0:1746147261.024573:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2961408->2965503) req@ffff88009ee5ce00 x1830967465962752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.024582:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ce00 with x1830967465962752 ext(2961408->2965503) 00002000:00010000:2.0:1746147261.024586:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ce00 00000100:00100000:2.0:1746147261.024611:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7686 00000100:00100000:2.0:1746147261.024617:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465962752:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147261.024778:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967465962752:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 161us (391us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147261.024785:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7686 00002000:00100000:2.0:1746147261.024789:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2961408->2965503) req@ffff88009ee5ce00 x1830967465962752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.024795:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ce00 with x1830967465962752 ext(2961408->2965503) 00002000:00010000:2.0:1746147261.024798:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ce00 00000100:00100000:0.0:1746147261.168527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.168892:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465962880 00000100:00100000:3.0:1746147261.168900:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465962880 00000100:00100000:3.0:1746147261.168960:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16099 00000100:00100000:3.0:1746147261.168967:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32173:x1830967465962880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.168983:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.168999:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed79d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.169069:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.169077:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 6 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.169096:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.169105:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.169107:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.169109:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.169136:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.169146:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 9 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.169156:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129856:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.169251:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 6 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.169258:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 6 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.169266:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129984:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.169288:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.169295:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.169308:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.169324:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.172114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.172200:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963008 00000100:00100000:2.0:1746147261.172207:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963008 00000100:00100000:3.0:1746147261.172209:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129856:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.172218:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467129984:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.172225:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.172235:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 7 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.172249:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.172257:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8238 00010000:00010000:3.0:1746147261.172262:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360200, rc 0) 00000100:00100000:2.0:1746147261.172263:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465963008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.172273:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.172289:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 7 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.172298:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 7 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.172311:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:32173:x1830967465962880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3344us (3790us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147261.172316:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094422200/0xb4b2209fbdad22c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6a1 expref: 7 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.172317:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16099 00010000:00010000:2.0:1746147261.172329:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.172348:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465963008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.172356:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8238 00000100:00100000:0.0:1746147261.173180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.173254:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963136 00000100:00100000:2.0:1746147261.173259:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963136 00010000:00010000:2.0:1746147261.173273:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 10 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.173294:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8239 00000100:00100000:2.0:1746147261.173300:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465963136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.173307:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.173318:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 10 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.173327:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 10 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.173339:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6449800/0xb4b2209fbdad2203 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed646 expref: 10 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.173347:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.173378:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967465963136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.173383:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8239 00000100:00100000:1.0:1746147261.173713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.173799:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963264 00000100:00100000:0.0:1746147261.173802:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963264 00010000:00010000:0.0:1746147261.173815:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.173844:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8240 00000100:00100000:0.0:1746147261.173850:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967465963264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.173856:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.173864:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.173872:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.173883:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1515e00/0xb4b2209fbdad21e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed62a expref: 25 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.173895:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.173896:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.173902:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.173909:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.173930:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.173960:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467130240:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147261.174008:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.175261:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467130240:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.175273:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.175300:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967465963264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1449us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.175310:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8240 00000100:00100000:0.0:1746147261.177621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.177800:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963392 00000100:00100000:3.0:1746147261.177807:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963392 00000100:00100000:3.0:1746147261.178016:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16100 00000100:00100000:3.0:1746147261.178023:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32173:x1830967465963392:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.178037:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.178051:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7a4 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.178076:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.178101:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147261.178103:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147261.178106:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->2478079] (req 2097152->2478079) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.178129:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.178140:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 8 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.178150:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130368:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.178219:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.179966:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130368:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.179990:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->2478079] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.180002:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360a00, rc 0) 00000100:00100000:3.0:1746147261.180040:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:32173:x1830967465963392:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2017us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.180047:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16100 00000100:00100000:0.0:1746147261.181331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.181508:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963520 00000100:00100000:3.0:1746147261.181513:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963520 00002000:00100000:3.0:1746147261.181542:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2211840->2965503) req@ffff880099f6ad80 x1830967465963520/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.181556:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6ad80 with x1830967465963520 ext(2211840->2965503) 00010000:00010000:3.0:1746147261.181562:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 9 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.181572:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 9 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.181578:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f6ad80 00000100:00100000:3.0:1746147261.181599:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2631 00000100:00100000:3.0:1746147261.181604:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465963520:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147261.197253:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465963520:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 15641us (15915us total) trans 17179874110 rc 0/0 00000100:00100000:3.0:1746147261.197264:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2631 00002000:00100000:3.0:1746147261.197277:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2211840->2965503) req@ffff880099f6ad80 x1830967465963520/t17179874110(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/448 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.197285:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6ad80 with x1830967465963520 ext(2211840->2965503) 00010000:00010000:3.0:1746147261.197293:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.197305:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.197311:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f6ad80 00000100:00100000:0.0:1746147261.198528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.198604:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963648 00000100:00100000:3.0:1746147261.198610:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963648 00000100:00100000:3.0:1746147261.198652:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16101 00000100:00100000:3.0:1746147261.198659:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465963648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147261.198671:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.198684:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d54400/0xb4b2209fbdad245d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7ab expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.198722:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130496:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147261.199356:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.199492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.199560:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465963776 00000100:00100000:2.0:1746147261.199564:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465963776 00010000:00010000:2.0:1746147261.199584:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.199863:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8241 00000100:00100000:2.0:1746147261.199870:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465963776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.199880:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.199896:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.199906:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.199923:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.200146:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.200154:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.200161:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.200183:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.200192:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467130624:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147261.200632:0:6881:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a044a300 x1830967467130496) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.200650:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f361e00/0xb4b2209fbdad2448 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2965503) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed796 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.200667:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130496:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147261.200686:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d54400/0xb4b2209fbdad245d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ab expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.200694:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d54400/0xb4b2209fbdad245d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ab expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.200701:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d54400, rc 0) 00000100:00100000:3.0:1746147261.201103:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465963648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2443us (2577us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147261.201105:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.201109:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16101 00000100:00100000:0.0:1746147261.206223:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467130624:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147261.206245:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.206292:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967465963776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6422us (6800us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.206302:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8241 00000100:00100000:0.0:1746147261.207179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.207221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.207564:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465964032 00000100:00100000:0.0:1746147261.208573:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465964288 00000100:00100000:0.0:1746147261.208581:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465964288 00000100:00100000:0.0:1746147261.208625:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11557 00000100:00100000:0.0:1746147261.208632:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32180:x1830967465964288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147261.208652:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.208666:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766e00/0xb4b2209fbdad2464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7b2 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.208721:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465964032 00010000:00010000:0.0:1746147261.208744:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208755:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208763:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00002000:00100000:3.0:1746147261.208764:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2473984->2478079) req@ffff880099f6b100 x1830967465964032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746147261.208773:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00002000:00100000:3.0:1746147261.208775:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b100 with x1830967465964032 ext(2473984->2478079) 00010000:00010000:0.0:1746147261.208778:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00002000:00010000:3.0:1746147261.208780:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6b100 00010000:00010000:0.0:1746147261.208783:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:3.0:1746147261.208802:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7687 00000100:00100000:3.0:1746147261.208809:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465964032:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:0.0:1746147261.208856:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766200/0xb4b2209fbdad2479 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208863:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766200/0xb4b2209fbdad2479 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208868:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766200/0xb4b2209fbdad2479 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:0.0:1746147261.208874:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:0.0:1746147261.208934:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208973:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208983:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208987:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e767600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147261.208991:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.208996:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209004:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147261.209006:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746147261.209008:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967465964032:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 199us (1835us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746147261.209009:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209013:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767600/0xb4b2209fbdad246b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00000100:00100000:3.0:1746147261.209015:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7687 00002000:00100000:3.0:1746147261.209020:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2473984->2478079) req@ffff880099f6b100 x1830967465964032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.209027:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b100 with x1830967465964032 ext(2473984->2478079) 00010000:00010000:0.0:1746147261.209028:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00002000:00010000:3.0:1746147261.209029:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6b100 00010000:00010000:0.0:1746147261.209032:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209037:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209041:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e767200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147261.209043:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209047:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209055:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f200) 00010000:00010000:0.0:1746147261.209056:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147261.209058:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209062:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e767200/0xb4b2209fbdad2472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147261.209101:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766e00/0xb4b2209fbdad2464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7b2 expref: 34 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.209111:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766200/0xb4b2209fbdad2479 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7b2 expref: 33 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.209117:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147261.209118:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147261.209120:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e766200, rc 0) 00000100:00100000:0.0:1746147261.209157:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32180:x1830967465964288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 525us (1938us total) trans 8589945584 rc 0/0 00000100:00100000:0.0:1746147261.209162:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11557 00000100:00100000:0.0:1746147261.212226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.212285:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465964416 00000100:00100000:2.0:1746147261.212297:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465964416 00000100:00100000:2.0:1746147261.212361:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 792 00000100:00100000:2.0:1746147261.212368:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967465964416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.212380:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.212399:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e766200/0xb4b2209fbdad2479 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7b2 expref: 33 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.212428:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147261.212432:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.212474:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1958:x1830967465964416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.212480:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 792 00000100:00100000:0.0:1746147261.215075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.215237:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465964544 00000100:00100000:3.0:1746147261.215244:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465964544 00000100:00100000:3.0:1746147261.215288:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16102 00000100:00100000:3.0:1746147261.215295:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465964544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147261.215309:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.215324:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d55400/0xb4b2209fbdad2487 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7b9 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.215368:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130752:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147261.215450:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.217382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.218497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.218782:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465964672 00000100:00100000:1.0:1746147261.218789:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465964672 00000100:00100000:1.0:1746147261.218823:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16103 00000100:00100000:1.0:1746147261.218829:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465964672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.218843:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.218855:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929c1e00/0xb4b2209fbdad248e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7c0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.218893:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467130880:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147261.218957:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.219154:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465964928 00000100:00100000:3.0:1746147261.219159:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465964928 00002000:00100000:3.0:1746147261.219181:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1814527) req@ffff880099f6b480 x1830967465964928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.219351:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b480 with x1830967465964928 ext(1048576->1814527) 00002000:00010000:3.0:1746147261.219355:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6b480 00000100:00100000:3.0:1746147261.219370:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7688 00000100:00100000:3.0:1746147261.219376:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465964928:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:2.0:1746147261.219406:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147259 -> 1746147261 00002000:00010000:2.0:1746147261.219410:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147259 -> 1746147261 00002000:00010000:2.0:1746147261.219411:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147259 -> 1746147261 00000100:00100000:2.0:1746147261.219420:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467130752:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147261.219441:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d55400/0xb4b2209fbdad2487 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7b9 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.219450:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d55400/0xb4b2209fbdad2487 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7b9 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.219457:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d55400, rc 0) 00000100:00100000:2.0:1746147261.219493:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465964544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4198us (4424us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147261.219499:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16102 00002000:00010000:0.0:1746147261.220908:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147260 -> 1746147261 00002000:00010000:0.0:1746147261.220913:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147260 -> 1746147261 00002000:00010000:0.0:1746147261.220915:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147260 -> 1746147261 00000100:00100000:0.0:1746147261.220933:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467130880:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147261.221031:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929c1e00/0xb4b2209fbdad248e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c0 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.221042:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929c1e00/0xb4b2209fbdad248e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c0 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.221145:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929c1e00, rc 0) 00000100:00100000:0.0:1746147261.221169:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967465964672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2341us (3793us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147261.221219:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16103 00000100:00100000:3.0:1746147261.227747:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967465964928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8363us (9313us total) trans 0 rc 765952/765952 00000100:00100000:3.0:1746147261.227758:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7688 00002000:00100000:3.0:1746147261.227767:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1814527) req@ffff880099f6b480 x1830967465964928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.227775:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b480 with x1830967465964928 ext(1048576->1814527) 00002000:00010000:3.0:1746147261.227780:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6b480 00000100:00100000:0.0:1746147261.229838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.231606:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465965056 00000100:00100000:2.0:1746147261.231615:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465965056 00000100:00100000:2.0:1746147261.232576:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16104 00000100:00100000:2.0:1746147261.232585:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32180:x1830967465965056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.232600:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.232616:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7c7 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.232639:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.232645:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.232647:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.232650:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.232674:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.232684:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 24 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.232694:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467131008:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.232772:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.237251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.237278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.237332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.237335:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465965184 00000100:00100000:3.0:1746147261.237346:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465965184 00002000:00100000:3.0:1746147261.237392:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1814528->2097151) req@ffff880099f69f80 x1830967465965184/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.237402:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69f80 with x1830967465965184 ext(1814528->2097151) 00010000:00010000:3.0:1746147261.237411:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 25 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.237424:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 25 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.237426:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465965440 00000100:00100000:2.0:1746147261.237433:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465965440 00002000:00010000:3.0:1746147261.237436:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69f80 00000100:00100000:3.0:1746147261.237456:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465965568 00000100:00100000:3.0:1746147261.237458:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465965568 00002000:00100000:2.0:1746147261.237467:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2478080->3526655) req@ffff880099f68000 x1830967465965440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.237470:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3526656->4194303) req@ffff88009b40a300 x1830967465965568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.237476:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40a300 with x1830967465965568 ext(3526656->4194303) 00002000:00100000:2.0:1746147261.237476:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967465965440 ext(2478080->3526655) 00002000:00010000:3.0:1746147261.237479:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40a300 00002000:00010000:2.0:1746147261.237480:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:3.0:1746147261.237501:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2632 00000100:00100000:3.0:1746147261.237507:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465965184:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147261.237649:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7689 00000100:00100000:2.0:1746147261.237657:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465965568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147261.237781:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7690 00000100:00100000:3.0:1746147261.237787:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465965440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.238250:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467131008:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.238275:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.238290:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7546600, rc 0) 00000100:00100000:2.0:1746147261.238332:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32180:x1830967465965056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5748us (8499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.238339:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16104 00000100:00100000:3.0:1746147261.244157:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967465965184:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6638us (6908us total) trans 17179874111 rc 0/0 00000100:00100000:3.0:1746147261.244170:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2632 00002000:00100000:3.0:1746147261.244183:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1814528->2097151) req@ffff880099f69f80 x1830967465965184/t17179874111(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/448 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.244193:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69f80 with x1830967465965184 ext(1814528->2097151) 00010000:00010000:3.0:1746147261.244204:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 31 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.244221:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 31 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.244234:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69f80 00000100:00100000:0.0:1746147261.246989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.247627:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465965952 00000100:00100000:2.0:1746147261.247637:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465965952 00000100:00100000:2.0:1746147261.247693:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11558 00000100:00100000:2.0:1746147261.247701:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+32:32183:x1830967465965952:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147261.247726:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.247745:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546800/0xb4b2209fbdad249c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7ce expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.247861:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.247876:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.247890:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.247903:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.247909:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.247914:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248049:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdad24b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248058:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdad24b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248064:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdad24b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147261.248072:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:2.0:1746147261.248197:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248203:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248208:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248216:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7547a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147261.248220:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248225:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248234:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147261.248237:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147261.248240:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248245:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248268:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248272:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248275:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248278:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7547600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147261.248279:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248283:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248288:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76600) 00010000:00010000:2.0:1746147261.248289:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147261.248291:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248295:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdad24aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.248329:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546800/0xb4b2209fbdad249c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ce expref: 35 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.248338:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdad24b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ce expref: 34 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.248343:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147261.248344:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147261.248346:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7546000, rc 0) 00000100:00100000:2.0:1746147261.248386:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32183:x1830967465965952:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 686us (1407us total) trans 8589945585 rc 0/0 00000100:00100000:2.0:1746147261.248392:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11558 00000100:00100000:3.0:1746147261.248523:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465965568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10866us (11190us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746147261.248532:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7689 00002000:00100000:3.0:1746147261.248540:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3526656->4194303) req@ffff88009b40a300 x1830967465965568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.248548:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40a300 with x1830967465965568 ext(3526656->4194303) 00002000:00010000:3.0:1746147261.248552:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40a300 00000100:00100000:0.0:1746147261.251387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.251455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.251487:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.251787:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465966080 00000100:00100000:2.0:1746147261.251797:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465966080 00010000:00010000:2.0:1746147261.251834:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.251869:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465966464 00000100:00100000:2.0:1746147261.251872:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465966464 00000100:00100000:2.0:1746147261.251888:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8242 00000100:00100000:2.0:1746147261.251895:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465966080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147261.251898:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 793 00000100:00100000:0.0:1746147261.251903:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465966464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.251908:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.251910:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.251931:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.251932:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdad24b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ce expref: 34 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.251950:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465966336 00000100:00100000:3.0:1746147261.251953:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465966336 00010000:00010000:2.0:1746147261.251958:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.251964:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147261.251969:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147261.251974:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f360200/0xb4b2209fbdad244f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed79d expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.251979:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4853 00000100:00100000:3.0:1746147261.251984:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32183:x1830967465966336:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:2.0:1746147261.251991:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.251993:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.251999:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.252005:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.252012:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1957:x1830967465966464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.252018:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 793 00010000:00010000:2.0:1746147261.252041:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.252052:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467131136:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147261.252122:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.252217:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32183:x1830967465966336:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 232us (761us total) trans 8589945586 rc 0/0 00000100:00100000:3.0:1746147261.252222:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4853 00000100:00100000:3.0:1746147261.253986:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467131136:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147261.254004:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.254735:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465965440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16945us (17452us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.254746:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7690 00002000:00100000:2.0:1746147261.254756:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2478080->3526655) req@ffff880099f68000 x1830967465965440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.254765:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967465965440 ext(2478080->3526655) 00000100:00100000:3.0:1746147261.254822:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465966080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2922us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.254830:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8242 00002000:00010000:2.0:1746147261.255633:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:1.0:1746147261.257242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.257369:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465966720 00000100:00100000:2.0:1746147261.257380:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465966720 00002000:00100000:2.0:1746147261.257561:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e6f2680 x1830967465966720/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.257572:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2680 with x1830967465966720 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.257576:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2680 00000100:00100000:2.0:1746147261.257628:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7691 00000100:00100000:2.0:1746147261.257636:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465966720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.264886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.264967:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465966848 00000100:00100000:2.0:1746147261.264975:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465966848 00000100:00100000:2.0:1746147261.265158:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16105 00000100:00100000:2.0:1746147261.265165:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465966848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.265180:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.265193:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7d5 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.265211:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.265212:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.265219:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.265231:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.265239:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7547a00, rc 0) 00000100:00100000:2.0:1746147261.265273:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465966848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.265280:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16105 00000100:00100000:3.0:1746147261.265823:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465966720:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8186us (8600us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.265831:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7691 00002000:00100000:3.0:1746147261.265839:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009e6f2680 x1830967465966720/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.265847:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2680 with x1830967465966720 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.265850:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2680 00000100:00100000:0.0:1746147261.268344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.268400:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465967104 00000100:00100000:3.0:1746147261.268407:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465967104 00002000:00100000:3.0:1746147261.268443:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e584000 x1830967465967104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.268452:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584000 with x1830967465967104 ext(4194304->4976639) 00002000:00010000:3.0:1746147261.268456:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584000 00000100:00100000:3.0:1746147261.268485:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7692 00000100:00100000:3.0:1746147261.268492:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465967104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.274244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.274382:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465967232 00000100:00100000:1.0:1746147261.274390:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465967232 00000100:00100000:1.0:1746147261.274798:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16106 00000100:00100000:1.0:1746147261.274806:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32180:x1830967465967232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.274823:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.274838:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7dc expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.274865:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.274872:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147261.274874:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147261.274877:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.274903:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.274918:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 28 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.274929:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467131264:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147261.276067:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.277974:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465967104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9477us (9630us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147261.277983:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7692 00002000:00100000:3.0:1746147261.277993:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009e584000 x1830967465967104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.278001:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584000 with x1830967465967104 ext(4194304->4976639) 00010000:00010000:3.0:1746147261.278009:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.278020:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.278026:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e584000 00000100:00100000:1.0:1746147261.278298:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467131264:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147261.278324:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.278337:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485d400, rc 0) 00000100:00100000:1.0:1746147261.278370:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32180:x1830967465967232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3564us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.278375:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16106 00000100:00100000:0.0:1746147261.279207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.280254:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465967360 00000100:00100000:3.0:1746147261.280261:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465967360 00002000:00100000:3.0:1746147261.280290:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2478079) req@ffff88009e587480 x1830967465967360/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.280298:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587480 with x1830967465967360 ext(2097152->2478079) 00010000:00010000:3.0:1746147261.280305:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.280316:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.280322:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e587480 00000100:00100000:3.0:1746147261.280338:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2633 00000100:00100000:3.0:1746147261.280345:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967465967360:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147261.283405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.283461:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465967488 00000100:00100000:1.0:1746147261.283469:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465967488 00000100:00100000:1.0:1746147261.283518:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16107 00000100:00100000:1.0:1746147261.283525:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465967488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.283539:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.283553:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f0b400/0xb4b2209fbdad24cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7e3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.283594:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467131392:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147261.283653:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.285636:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967465967360:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5286us (6425us total) trans 17179874112 rc 0/0 00000100:00100000:3.0:1746147261.285645:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2633 00002000:00100000:3.0:1746147261.285654:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2478079) req@ffff88009e587480 x1830967465967360/t17179874112(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/448 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.285663:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587480 with x1830967465967360 ext(2097152->2478079) 00010000:00010000:3.0:1746147261.285671:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 31 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.285683:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 31 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.285694:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e587480 00000100:00100000:1.0:1746147261.287020:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467131392:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147261.287051:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f0b400/0xb4b2209fbdad24cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7e3 expref: 30 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.287061:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f0b400/0xb4b2209fbdad24cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7e3 expref: 30 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.287196:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f0b400, rc 0) 00000100:00100000:1.0:1746147261.287379:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465967488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3853us (3981us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147261.287386:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16107 00000100:00100000:0.0:1746147261.292345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.292401:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465967616 00000100:00100000:3.0:1746147261.292409:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465967616 00010000:00010000:3.0:1746147261.292439:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.292473:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8243 00000100:00100000:3.0:1746147261.292481:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465967616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.292492:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.292510:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.292521:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.292539:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f360a00/0xb4b2209fbdad2456 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7a4 expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.292568:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.292570:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.292575:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.292582:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.292613:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.292623:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467131520:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147261.292692:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.293371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.294163:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465967744 00000100:00100000:1.0:1746147261.294169:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465967744 00000100:00100000:1.0:1746147261.294209:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16108 00000100:00100000:1.0:1746147261.294216:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32177:x1830967465967744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.294229:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.294240:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7ea expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.294256:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.294257:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.294262:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.294274:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.294281:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f361600, rc 0) 00000100:00100000:1.0:1746147261.294318:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32177:x1830967465967744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 102us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.294323:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16108 00000100:00100000:3.0:1746147261.298429:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467131520:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147261.298447:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.298507:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465967616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6026us (6168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.298516:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8243 00000100:00100000:0.0:1746147261.299304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.299415:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465968000 00000100:00100000:3.0:1746147261.299423:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465968000 00002000:00100000:3.0:1746147261.299467:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c9f0380 x1830967465968000/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.299477:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967465968000 ext(2097152->3145727) 00002000:00010000:3.0:1746147261.299482:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0380 00000100:00100000:3.0:1746147261.300688:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7693 00000100:00100000:3.0:1746147261.300697:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465968000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147261.303050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.303098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.303399:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465968512 00000100:00100000:0.0:1746147261.303409:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465968512 00002000:00100000:0.0:1746147261.303458:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff88009e6f1f80 x1830967465968512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.303468:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1f80 with x1830967465968512 ext(4972544->4976639) 00002000:00010000:0.0:1746147261.303474:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f1f80 00000100:00100000:0.0:1746147261.303493:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465968128 00000100:00100000:0.0:1746147261.303496:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465968128 00002000:00100000:0.0:1746147261.303507:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e6f0000 x1830967465968128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.303513:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0000 with x1830967465968128 ext(3145728->4194303) 00002000:00010000:0.0:1746147261.303516:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0000 00000100:00100000:0.0:1746147261.303539:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7694 00000100:00100000:0.0:1746147261.303546:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465968512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.303708:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465968512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 163us (665us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147261.303716:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7694 00002000:00100000:0.0:1746147261.303722:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff88009e6f1f80 x1830967465968512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.303728:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1f80 with x1830967465968512 ext(4972544->4976639) 00002000:00010000:0.0:1746147261.303731:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f1f80 00000100:00100000:0.0:1746147261.303744:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7695 00000100:00100000:0.0:1746147261.303748:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465968128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.311546:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465968000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10837us (12235us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147261.311561:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7693 00002000:00100000:0.0:1746147261.311575:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012c9f0380 x1830967465968000/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.311586:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967465968000 ext(2097152->3145727) 00002000:00010000:0.0:1746147261.311593:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0380 00000100:00100000:2.0:1746147261.319575:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465968128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15814us (16464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.319588:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7695 00002000:00100000:2.0:1746147261.319601:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009e6f0000 x1830967465968128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.319610:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0000 with x1830967465968128 ext(3145728->4194303) 00002000:00010000:2.0:1746147261.319617:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f0000 00000100:00100000:0.0:1746147261.330668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.332728:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465968768 00000100:00100000:2.0:1746147261.332744:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465968768 00002000:00100000:2.0:1746147261.332807:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012e2bb100 x1830967465968768/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.332819:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb100 with x1830967465968768 ext(4194304->4976639) 00002000:00010000:2.0:1746147261.332825:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb100 00000100:00100000:2.0:1746147261.332870:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7696 00000100:00100000:2.0:1746147261.332878:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465968768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.341314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.341427:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465968896 00000100:00100000:3.0:1746147261.341437:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465968896 00000100:00100000:3.0:1746147261.341501:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16109 00000100:00100000:3.0:1746147261.341509:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32183:x1830967465968896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.341528:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.341546:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7f1 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.341577:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.341586:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.341592:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.341594:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.341598:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1232896->1871871] (req 1232896->1871871) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.341630:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.341642:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 28 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.341654:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467131648:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.341763:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.341770:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 15 pid: 8480 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.341778:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467131776:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.341797:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.344309:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465968768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11421us (13642us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147261.344322:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7696 00002000:00100000:2.0:1746147261.344333:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012e2bb100 x1830967465968768/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.344342:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb100 with x1830967465968768 ext(4194304->4976639) 00002000:00010000:2.0:1746147261.344348:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb100 00000100:00100000:0.0:1746147261.345751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.346624:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465969024 00000100:00100000:2.0:1746147261.346634:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465969024 00000100:00100000:1.0:1746147261.346637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147261.346679:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 29 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.346705:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465969152 00000100:00100000:2.0:1746147261.346707:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465969152 00010000:00010000:2.0:1746147261.346717:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 14 pid: 8480 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.346742:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8244 00000100:00100000:2.0:1746147261.346749:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465969024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.346763:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147261.346763:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8245 00000100:00100000:1.0:1746147261.346776:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465969152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.346784:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 29 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746147261.346784:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.346794:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 29 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746147261.346809:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 14 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.346823:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 14 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.346954:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147261.346961:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.346963:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.346971:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.346980:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.346986:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7547a00/0xb4b2209fbdad24bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7d5 expref: 29 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.346997:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465969024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 248us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.347004:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8244 00000100:00100000:3.0:1746147261.347007:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467131648:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147261.347012:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 14 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.347020:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7546600/0xb4b2209fbdad2495 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7c7 expref: 14 pid: 8480 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.347023:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467131904:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147261.347029:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467131776:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.347051:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 13 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.347061:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065200, rc 0) 00000100:00100000:1.0:1746147261.347069:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.347097:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32183:x1830967465968896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5590us (5793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.347104:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16109 00000100:00100000:2.0:1746147261.350672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.351527:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465969280 00000100:00100000:3.0:1746147261.351536:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465969280 00000100:00100000:3.0:1746147261.351605:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16110 00000100:00100000:3.0:1746147261.351613:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465969280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147261.351634:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.351653:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad24e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7f8 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.351708:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467132032:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147261.351802:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147261.352580:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467131904:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147261.352601:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147261.352640:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465969152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5870us (6004us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.352649:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8245 00000100:00100000:0.0:1746147261.353022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.353259:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467132032:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147261.353281:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad24e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f8 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.353292:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad24e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f8 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147261.353382:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465969536 00000100:00100000:2.0:1746147261.353388:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465969536 00002000:00100000:2.0:1746147261.353422:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1232896->1236991) req@ffff88012e2bb800 x1830967465969536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.353437:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967465969536 ext(1232896->1236991) 00002000:00010000:2.0:1746147261.353441:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:2.0:1746147261.353460:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7697 00000100:00100000:2.0:1746147261.353466:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465969536:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147261.353515:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064200, rc 0) 00000100:00100000:3.0:1746147261.353888:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465969280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2274us (3224us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147261.353951:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967465969536:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 468us (912us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147261.353958:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7697 00002000:00100000:2.0:1746147261.353965:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1232896->1236991) req@ffff88012e2bb800 x1830967465969536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.353971:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967465969536 ext(1232896->1236991) 00002000:00010000:2.0:1746147261.353974:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:3.0:1746147261.354163:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16110 00000100:00100000:0.0:1746147261.362167:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.362230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.362328:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465969792 00000100:00100000:3.0:1746147261.362339:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465969792 00000100:00100000:2.0:1746147261.362368:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465970048 00000100:00100000:2.0:1746147261.362376:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465970048 00000100:00100000:3.0:1746147261.362403:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4854 00000100:00100000:3.0:1746147261.362411:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32180:x1830967465969792:12345-192.168.203.36@tcp:35:cat.0 00002000:00100000:2.0:1746147261.362496:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1867776->1871871) req@ffff88009ee5d500 x1830967465970048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.362506:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d500 with x1830967465970048 ext(1867776->1871871) 00002000:00010000:2.0:1746147261.362513:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5d500 00000100:00100000:2.0:1746147261.362579:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7698 00000100:00100000:2.0:1746147261.362587:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465970048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147261.362632:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:32180:x1830967465969792:12345-192.168.203.36@tcp:35:cat.0 Request processed in 221us (476us total) trans 8589945587 rc 0/0 00000100:00100000:3.0:1746147261.362638:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4854 00000100:00100000:2.0:1746147261.362916:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465970048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 330us (685us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147261.362923:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7698 00002000:00100000:2.0:1746147261.362929:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1867776->1871871) req@ffff88009ee5d500 x1830967465970048/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.362965:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d500 with x1830967465970048 ext(1867776->1871871) 00002000:00010000:2.0:1746147261.362968:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5d500 00000100:00100000:0.0:1746147261.380785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.380890:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465970176 00000100:00100000:2.0:1746147261.380900:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465970176 00000100:00100000:2.0:1746147261.380971:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11559 00000100:00100000:2.0:1746147261.380979:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32187:x1830967465970176:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147261.381001:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.381020:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad24e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed7ff expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.381101:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381115:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381125:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381138:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381144:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381149:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381262:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381274:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 34 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.381282:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 318 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.381288:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 5/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.381319:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 318 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.381332:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 318 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.381343:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132160:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.382049:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 34 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.382058:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 34 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.382066:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132288:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.382102:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.385402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.385446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.385580:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132160:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.385591:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132288:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.385618:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147261.385706:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465970432 00000100:00100000:1.0:1746147261.385713:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465970432 00000100:00100000:1.0:1746147261.385753:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465970688 00000100:00100000:1.0:1746147261.385755:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465970688 00000100:00100000:1.0:1746147261.385770:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4855 00000100:00100000:1.0:1746147261.385777:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+319:19602:x1830967465970432:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147261.386014:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+320:19602:x1830967465970432:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 237us (622us total) trans 8589945588 rc 0/0 00000100:00100000:1.0:1746147261.386020:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4855 00000100:00100000:1.0:1746147261.386044:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4856 00000100:00100000:1.0:1746147261.386049:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+35:7642:x1830967465970688:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147261.386128:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+36:7642:x1830967465970688:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 78us (682us total) trans 8589945589 rc 0/0 00000100:00100000:1.0:1746147261.386133:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4856 00000100:00100000:0.0:1746147261.387876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.387964:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465970816 00000100:00100000:1.0:1746147261.387971:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465970816 00010000:00010000:1.0:1746147261.388003:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 320 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.388418:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8246 00000100:00100000:1.0:1746147261.388425:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967465970816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147261.388440:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147261.388446:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 320 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.388457:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 320 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.388629:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad23d1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed75e expref: 320 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.388644:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:1.0:1746147261.388650:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147261.388658:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147261.388663:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147261.388668:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147261.388909:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967465970816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 483us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.388917:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8246 00000100:00100000:1.0:1746147261.389756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.389895:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465970944 00000100:00100000:2.0:1746147261.389901:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465970944 00010000:00010000:2.0:1746147261.389921:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 36 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.390151:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8247 00000100:00100000:2.0:1746147261.390158:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1959:x1830967465970944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.390168:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.390174:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 36 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.390184:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 36 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.390199:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad237d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed718 expref: 36 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.390224:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147261.390228:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.390237:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.390244:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.391174:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.391216:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1959:x1830967465970944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1057us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.391223:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8247 00010000:00010000:3.0:1746147261.391520:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391528:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147261.391573:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147261.391578:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147261.391595:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391605:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391614:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391620:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391626:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391631:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094422c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147261.391635:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391641:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391651:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147261.391654:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147261.391656:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391660:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad24f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391673:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391677:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391685:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391688:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147261.391690:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391694:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391699:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76500) 00010000:00010000:3.0:1746147261.391700:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147261.391702:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391706:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423800/0xb4b2209fbdad24f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.391739:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad24e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.391761:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.391767:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.391768:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147261.391771:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422400, rc 0) 00000100:00100000:3.0:1746147261.393167:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:32187:x1830967465970176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 12185us (12389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.393177:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11559 00000100:00100000:0.0:1746147261.395399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.395428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.395687:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971200 00000100:00100000:1.0:1746147261.395692:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971456 00000100:00100000:0.0:1746147261.395695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.395696:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971200 00000100:00100000:1.0:1746147261.395697:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971456 00000100:00100000:1.0:1746147261.395716:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971072 00000100:00100000:1.0:1746147261.395718:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971072 00000100:00100000:0.0:1746147261.395731:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.395747:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971328 00000100:00100000:3.0:1746147261.395749:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971328 00000100:00100000:1.0:1746147261.395752:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16111 00000100:00100000:1.0:1746147261.395759:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465971200:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:0.0:1746147261.395759:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16112 00000100:00100000:3.0:1746147261.395763:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16113 00000100:00100000:0.0:1746147261.395764:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465971072:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147261.395768:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465971328:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147261.395779:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.395779:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.395786:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.395794:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed814 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.395794:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5d800/0xb4b2209fbdad2505 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed80d expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.395794:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed806 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.395814:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.395814:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.395816:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.395816:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.395824:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.395824:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.395836:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.395836:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147261.395842:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467132416:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147261.395844:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065c00, rc 0) 00010000:00010000:0.0:1746147261.395844:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f890200, rc 0) 00000100:00100000:3.0:1746147261.395893:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465971328:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 125us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.395894:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465971072:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 130us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.395898:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16113 00000100:00100000:0.0:1746147261.395901:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16112 00000100:00100000:1.0:1746147261.396014:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147261.396039:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16114 00000100:00100000:1.0:1746147261.396044:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465971456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147261.396050:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.396057:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed81b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.396066:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.396067:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.396072:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.396094:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.396100:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5da00, rc 0) 00000100:00100000:1.0:1746147261.396136:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465971456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 91us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.396141:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16114 00000100:00100000:1.0:1746147261.398347:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467132416:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147261.398381:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5d800/0xb4b2209fbdad2505 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed80d expref: 8 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.398394:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5d800/0xb4b2209fbdad2505 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed80d expref: 8 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.398564:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5d800, rc 0) 00000100:00100000:1.0:1746147261.398616:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465971200:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2856us (3223us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147261.398623:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16111 00000100:00100000:0.0:1746147261.401259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.401421:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971712 00000100:00100000:3.0:1746147261.401430:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971712 00000100:00100000:3.0:1746147261.401477:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11560 00000100:00100000:3.0:1746147261.401567:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:32187:x1830967465971712:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147261.401587:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.401605:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdad2521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed822 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.401705:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.401719:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.401725:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.401758:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.401769:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 16 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.401780:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132544:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.401921:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.405334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.405405:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132544:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.405422:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147261.405989:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971840 00000100:00100000:2.0:1746147261.406000:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971840 00010000:00010000:2.0:1746147261.406040:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 17 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.406067:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8248 00000100:00100000:2.0:1746147261.406074:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1956:x1830967465971840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.406101:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.406106:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 17 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.406118:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 17 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.406139:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422400/0xb4b2209fbdad24fe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ff expref: 17 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.406162:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147261.406167:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.406176:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.406187:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.406236:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147261.406265:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.406282:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147261.406301:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000100:00100000:2.0:1746147261.406348:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:1956:x1830967465971840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 273us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.406355:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8248 00010000:00010000:3.0:1746147261.406415:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdad2521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.406452:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.406459:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.406462:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147261.406465:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065000, rc 0) 00000100:00100000:3.0:1746147261.406637:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:32187:x1830967465971712:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5152us (5385us total) trans 8589945590 rc 0/0 00000100:00100000:3.0:1746147261.406644:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11560 00000100:00100000:0.0:1746147261.408537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.408634:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465971968 00000100:00100000:3.0:1746147261.408642:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465971968 00000100:00100000:3.0:1746147261.408690:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11561 00000100:00100000:3.0:1746147261.408697:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:32187:x1830967465971968:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147261.408714:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.408728:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064800/0xb4b2209fbdad2536 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed829 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.408789:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.408801:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.408806:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.408831:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.408841:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 17 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.408850:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132672:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.408967:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.413430:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467132672:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.413451:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147261.413952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.414261:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972096 00000100:00100000:2.0:1746147261.414268:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972096 00010000:00010000:2.0:1746147261.414292:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 18 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.414312:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8249 00000100:00100000:2.0:1746147261.414317:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:1957:x1830967465972096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.414327:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.414331:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 18 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.414341:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 18 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.414357:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdad2528 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed822 expref: 18 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.414380:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:2.0:1746147261.414384:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.414397:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.414403:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.414422:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.414451:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+17:1957:x1830967465972096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 134us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.414456:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8249 00010000:00010000:3.0:1746147261.415021:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.415028:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147261.415060:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147261.415063:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147261.415075:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.415111:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064800/0xb4b2209fbdad2536 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed829 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.415122:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed829 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.415127:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.415129:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147261.415132:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064200, rc 0) 00000100:00100000:3.0:1746147261.415164:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:32187:x1830967465971968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6468us (6633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.415171:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11561 00000100:00100000:0.0:1746147261.419345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.419562:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972224 00000100:00100000:1.0:1746147261.419570:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972224 00000100:00100000:1.0:1746147261.419619:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16115 00000100:00100000:1.0:1746147261.419626:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465972224:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147261.419640:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.419655:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5d600/0xb4b2209fbdad2544 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed830 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.419695:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467132800:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147261.419760:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.424314:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467132800:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147261.424344:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5d600/0xb4b2209fbdad2544 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed830 expref: 8 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.424356:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5d600/0xb4b2209fbdad2544 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed830 expref: 8 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.424379:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5d600, rc 0) 00000100:00100000:2.0:1746147261.424428:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967465972224:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4802us (5089us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147261.424436:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16115 00000100:00100000:0.0:1746147261.427403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.427458:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972480 00000100:00100000:3.0:1746147261.427466:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972480 00000100:00100000:3.0:1746147261.427508:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11562 00000100:00100000:3.0:1746147261.427515:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:32187:x1830967465972480:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147261.427529:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.427540:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065800/0xb4b2209fbdad254b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed837 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.427602:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad2552 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.427611:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad2552 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.427617:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad2552 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147261.427623:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147261.427694:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065800/0xb4b2209fbdad254b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed837 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.427714:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad2552 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed837 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.427719:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.427721:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147261.427723:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065a00, rc 0) 00000100:00100000:3.0:1746147261.427756:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:32187:x1830967465972480:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 243us (469us total) trans 8589945591 rc 0/0 00000100:00100000:3.0:1746147261.427761:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11562 00000100:00100000:0.0:1746147261.429644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.429679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.429706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.429741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.429890:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972608 00000100:00100000:2.0:1746147261.429896:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972608 00000100:00100000:2.0:1746147261.429926:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972736 00000100:00100000:2.0:1746147261.429928:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972736 00000100:00100000:2.0:1746147261.429963:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972864 00000100:00100000:2.0:1746147261.429965:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972864 00000100:00100000:2.0:1746147261.429976:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465972992 00000100:00100000:2.0:1746147261.429978:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465972992 00000100:00100000:2.0:1746147261.429990:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16116 00000100:00100000:2.0:1746147261.429995:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465972608:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147261.430024:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430039:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430047:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430053:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430059:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.430060:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.430063:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430095:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 8 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430105:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 8 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.430116:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467132928:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.430177:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430184:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 27 pid: 21080 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.430191:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467133056:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.430214:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430222:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.430229:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467133184:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.430244:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.430264:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16117 00000100:00100000:2.0:1746147261.430269:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465972736:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147261.430287:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430297:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430307:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430313:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430318:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.430319:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.430322:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430339:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.430347:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 16 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746147261.430352:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16118 00000100:00100000:2.0:1746147261.430354:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467133312:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.430358:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967465972864:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147261.430371:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430376:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.430380:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430383:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 10 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.430386:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147261.430390:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467133440:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147261.430392:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.430396:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.430398:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.430399:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.430411:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.430418:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 11 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.430420:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430426:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.430427:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467133568:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.430438:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467133696:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147261.430447:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147261.430451:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147261.430453:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 10 pid: 21080 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746147261.430459:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467133824:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.430464:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16119 00000100:00100000:2.0:1746147261.430469:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465972992:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147261.430477:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430483:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.430483:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 16 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.430489:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467133952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.430491:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430496:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.430497:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.430499:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.430499:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147261.430511:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.430517:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 11 pid: 8480 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.430523:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467134080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.430535:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.431006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.431562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.431641:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973120 00000100:00100000:3.0:1746147261.431646:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973120 00000100:00100000:3.0:1746147261.431675:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973248 00000100:00100000:3.0:1746147261.431677:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973248 00000100:00100000:3.0:1746147261.431693:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16120 00000100:00100000:3.0:1746147261.431699:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967465973120:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147261.431717:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431727:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431734:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.431740:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431745:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.431746:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.431748:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431763:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431770:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.431778:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467134208:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.431825:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.431832:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.431839:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467134336:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.431857:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431864:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.431870:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467134464:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.431881:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.431892:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16121 00000100:00100000:3.0:1746147261.431897:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967465973248:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147261.431910:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431921:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431928:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.431933:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431959:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.431960:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.431962:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431974:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.431981:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 11 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.431988:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467134592:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.432019:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.432026:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 11 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.432038:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467134720:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.432058:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.432065:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 16 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.432072:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467134848:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.432098:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.433864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.434006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.434151:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467132928:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.434164:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467133056:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.434171:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467133184:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.434192:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.436605:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973504 00000100:00100000:1.0:1746147261.436605:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973376 00000100:00100000:3.0:1746147261.436613:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973504 00000100:00100000:1.0:1746147261.436613:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973376 00010000:00010000:3.0:1746147261.436646:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.436647:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:1.0:1746147261.436674:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8250 00000100:00100000:1.0:1746147261.436680:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465973376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147261.436692:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147261.436709:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746147261.436718:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746147261.436734:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c99c00/0xb4b2209fbdad2100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed590 expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746147261.436749:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147261.436809:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465973376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 128us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.436814:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8250 00000100:00100000:3.0:1746147261.437453:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8251 00000100:00100000:3.0:1746147261.437458:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465973504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.437465:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.437473:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.437481:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.437491:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094683800/0xb4b2209fbdad20dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed582 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.437507:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.438229:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465973504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 769us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.438235:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8251 00000100:00100000:0.0:1746147261.440831:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467133312:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.441835:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467134592:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.441882:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467134720:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.441901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.441918:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973760 00000100:00100000:2.0:1746147261.441922:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973760 00000100:00100000:1.0:1746147261.442002:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467133568:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.442017:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467133440:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147261.442020:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467133824:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.442029:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467133696:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147261.442031:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467133952:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147261.442052:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.442060:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.442111:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467134208:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.442119:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467134336:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.442125:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467134464:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.442140:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.442159:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467134080:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.442169:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.442245:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.442276:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8252 00000100:00100000:2.0:1746147261.442283:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465973760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.442294:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.442309:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.442318:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.442335:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890200/0xb4b2209fbdad250c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed806 expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.442361:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.442392:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465973760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.442398:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8252 00000100:00100000:2.0:1746147261.442440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.442625:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974144 00000100:00100000:1.0:1746147261.442628:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974144 00010000:00010000:1.0:1746147261.442641:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 17 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.442663:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8253 00000100:00100000:1.0:1746147261.442668:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967465974144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147261.442674:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147261.442681:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 17 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.442688:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 17 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.442699:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56f800/0xb4b2209fbdad2330 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed6ee expref: 17 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.442709:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147261.442724:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967465974144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.442728:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8253 00000100:00100000:1.0:1746147261.443644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.443668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.443686:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973632 00000100:00100000:3.0:1746147261.443690:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973632 00000100:00100000:1.0:1746147261.443696:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.443705:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 28 pid: 21080 timeout: 748 lvb_type: 1 00000100:00100000:1.0:1746147261.443709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.443720:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465973888 00000100:00100000:1.0:1746147261.443720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.443722:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465973888 00010000:00010000:3.0:1746147261.443729:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 11 pid: 21080 timeout: 748 lvb_type: 1 00000100:00100000:1.0:1746147261.443731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.443742:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974400 00000100:00100000:1.0:1746147261.443742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.443743:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974400 00000100:00100000:1.0:1746147261.443754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.443756:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 12 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.443762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.443763:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974656 00000100:00100000:3.0:1746147261.443764:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974656 00010000:00010000:3.0:1746147261.443772:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.443779:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974016 00000100:00100000:3.0:1746147261.443780:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974016 00000100:00100000:1.0:1746147261.443781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.443786:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 16 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.443793:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974528 00000100:00100000:3.0:1746147261.443794:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974528 00000100:00100000:1.0:1746147261.443794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.443799:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 29 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.443806:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974784 00000100:00100000:3.0:1746147261.443807:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974784 00010000:00010000:3.0:1746147261.443812:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.443818:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974912 00000100:00100000:3.0:1746147261.443820:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974912 00000100:00100000:1.0:1746147261.443822:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467134848:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.443825:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 12 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.443832:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975040 00000100:00100000:3.0:1746147261.443834:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975040 00010000:00010000:1.0:1746147261.443838:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.443840:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.443846:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975168 00000100:00100000:3.0:1746147261.443847:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975168 00010000:00010000:3.0:1746147261.443853:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 14 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.443861:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8254 00000100:00100000:3.0:1746147261.443865:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465973632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.443872:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147261.443875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.443882:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 29 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.443890:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 29 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.443902:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d73c00/0xb4b2209fbdad21bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed600 expref: 29 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.443911:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147261.443911:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465974272 00010000:00010000:3.0:1746147261.443913:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147261.443915:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465974272 00010000:00010000:3.0:1746147261.443916:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.443928:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147261.443948:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1232896->1871871) req@ffff88009f731180 x1830967465974272/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.443958:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967465974272 ext(1232896->1871871) 00010000:00010000:3.0:1746147261.443959:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147261.443963:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.443971:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.443999:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975296 00000100:00100000:0.0:1746147261.444005:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975296 00010000:00010000:0.0:1746147261.444017:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 17 pid: 4445 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.444028:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8255 00000100:00100000:0.0:1746147261.444032:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465973888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.444038:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147261.444050:0:11078:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746147261.444055:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.444061:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.444072:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f865800/0xb4b2209fbdad22b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed69a expref: 12 pid: 21080 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.444093:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746147261.444173:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f731180 00010000:00010000:2.0:1746147261.444194:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444200:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444216:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444226:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444232:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444236:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147261.444239:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444245:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444252:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.444257:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2560 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.444503:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2634 00000100:00100000:1.0:1746147261.444508:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465974272:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147261.444511:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465973632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 645us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.444517:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8254 00000100:00100000:3.0:1746147261.444527:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8256 00000100:00100000:3.0:1746147261.444531:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465974400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.444537:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444544:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 14 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444551:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 14 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444561:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xb4b2209fbdad2361 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed703 expref: 14 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444568:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.444569:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.444572:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.444578:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.444599:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.444611:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465974400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.444615:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8256 00000100:00100000:0.0:1746147261.444617:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465973888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 584us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.444622:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8257 00000100:00100000:3.0:1746147261.444626:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465974656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147261.444629:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8255 00010000:00010000:3.0:1746147261.444631:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444638:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746147261.444639:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8258 00000100:00100000:0.0:1746147261.444643:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465974016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.444645:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.444648:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444654:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065c00/0xb4b2209fbdad2513 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed814 expref: 9 pid: 8480 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.444654:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 17 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.444660:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147261.444661:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 17 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.444669:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465974656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 43us (949us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147261.444670:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f741600/0xb4b2209fbdad21c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed607 expref: 17 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.444674:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8257 00010000:00010000:0.0:1746147261.444677:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.444681:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8259 00000100:00100000:3.0:1746147261.444685:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967465974528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147261.444688:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465974016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (957us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147261.444689:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147261.444693:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8258 00010000:00010000:3.0:1746147261.444694:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444701:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.444701:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8260 00000100:00100000:0.0:1746147261.444704:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465974784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.444708:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444709:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f361600/0xb4b2209fbdad24d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7ea expref: 27 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.444713:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444717:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147261.444719:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.444725:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967465974528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (982us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147261.444727:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094682600/0xb4b2209fbdad212a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed5ba expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.444730:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8259 00010000:00010000:0.0:1746147261.444736:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147261.444737:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8261 00010000:00010000:0.0:1746147261.444737:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.444739:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.444740:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1958:x1830967465974912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.444744:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.444745:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444752:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746147261.444756:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147261.444759:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.444767:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad251a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed81b expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746147261.444767:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465974784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.444771:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8260 00010000:00010000:3.0:1746147261.444773:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.444783:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967465974912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.444790:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8261 00000100:00100000:0.0:1746147261.444796:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8262 00000100:00100000:3.0:1746147261.444799:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8263 00000100:00100000:0.0:1746147261.444800:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1956:x1830967465975040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147261.444803:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465975168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.444805:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444808:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.444811:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444813:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 10 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.444818:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444820:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 10 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.444826:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b485d400/0xb4b2209fbdad24c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7dc expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444828:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d3200/0xb4b2209fbdad23ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed742 expref: 10 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444835:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147261.444835:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.444837:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.444839:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.444842:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465975168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 38us (1047us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147261.444843:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.444846:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8263 00000100:00100000:3.0:1746147261.444851:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8264 00000100:00100000:3.0:1746147261.444855:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967465975296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.444859:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.444864:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 15 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444871:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 15 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444883:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3dc800/0xb4b2209fbdad2392 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed726 expref: 15 pid: 4445 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.444889:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.444890:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.444892:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.444898:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444909:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.444921:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465975040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 120us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.444925:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8262 00010000:00010000:0.0:1746147261.444957:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444963:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444973:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444978:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444983:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444987:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094422c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147261.444989:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.444995:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.445001:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.445006:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2567 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.445027:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967465972736:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14759us (15348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.445032:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16117 00000100:00100000:2.0:1746147261.445117:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465972608:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15121us (15477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.445121:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16116 00010000:00010000:1.0:1746147261.445177:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445179:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147261.445183:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.445189:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967465975296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 333us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.445194:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8264 00010000:00010000:1.0:1746147261.445194:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445198:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445203:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445207:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f890400 already unused, calling callback (ffffffffa07dcd70) 00000100:00080000:3.0:1746147261.445209:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746147261.445209:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445214:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445216:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445221:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445223:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445226:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f890400/0xb4b2209fbdad256e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445233:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445239:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.445247:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967465972864:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14890us (15541us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147261.445249:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.445252:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16118 00010000:00010000:3.0:1746147261.445254:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f065000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147261.445256:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445262:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445263:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445268:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445277:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445281:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445286:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445290:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bd600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147261.445292:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445297:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445303:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.445307:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2583 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.445321:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465973248:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 13425us (13760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.445325:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16121 00010000:00010000:3.0:1746147261.445366:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.445371:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad257c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.445399:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967465973120:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 13701us (14393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.445404:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16120 00000100:00100000:0.0:1746147261.455019:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967465974272:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10502us (11313us total) trans 17179874113 rc 0/0 00000100:00100000:0.0:1746147261.455029:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2634 00002000:00100000:0.0:1746147261.455039:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1232896->1871871) req@ffff88009f731180 x1830967465974272/t17179874113(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/448 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.455047:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967465974272 ext(1232896->1871871) 00010000:00010000:0.0:1746147261.455055:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.455067:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746147261.455073:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f731180 00000100:00100000:0.0:1746147261.457252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.457336:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975424 00000100:00100000:3.0:1746147261.457343:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975424 00010000:00010000:3.0:1746147261.457369:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.457391:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8265 00000100:00100000:3.0:1746147261.457397:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967465975424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.457413:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.457428:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.457438:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.457455:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdad24db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->1871871) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed7f1 expref: 12 pid: 8480 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.457467:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.457469:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.457472:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.457477:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.457498:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147261.457517:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457524:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.457532:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967465975424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.457537:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8265 00010000:00010000:0.0:1746147261.457539:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457545:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457551:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457557:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147261.457560:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457567:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457576:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.457581:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdad2575 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.457626:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1959:x1830967465972992:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 27156us (27884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.457632:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16119 00000100:00100000:0.0:1746147261.458813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.458848:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975680 00000100:00100000:3.0:1746147261.458851:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975680 00000100:00100000:3.0:1746147261.458871:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11563 00000100:00100000:3.0:1746147261.458874:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+18:32187:x1830967465975680:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147261.458901:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746147261.458912:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdad253d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed829 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458922:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb7c200/0xb4b2209fbdad1ea6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3f3 expref: 17 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458927:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.458929:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147261.458962:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.458970:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458975:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458981:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458987:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458992:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 34 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.458998:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459003:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 9/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.459024:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459033:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 318 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.459044:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467134976:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.459133:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 34 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459140:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 34 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.459147:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.459166:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459173:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 318 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.459179:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135232:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.459193:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459199:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 34 pid: 14049 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.459208:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.459222:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459228:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 318 pid: 14049 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.459291:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135488:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.459314:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 318 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.459321:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 318 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.459327:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135616:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.459341:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.462320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.462361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.462377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.462402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.462414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.462432:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975936 00000100:00100000:0.0:1746147261.462438:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975936 00010000:00010000:0.0:1746147261.462463:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 35 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.462482:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976448 00000100:00100000:0.0:1746147261.462484:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976448 00010000:00010000:0.0:1746147261.462495:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 319 pid: 14049 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.462504:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465975808 00000100:00100000:0.0:1746147261.462505:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465975808 00010000:00010000:0.0:1746147261.462512:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 320 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.462519:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976320 00000100:00100000:0.0:1746147261.462520:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976320 00010000:00010000:0.0:1746147261.462526:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 36 pid: 14049 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.462539:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8266 00000100:00100000:0.0:1746147261.462543:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1956:x1830967465975936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.462567:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.462572:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 36 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462580:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 36 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462597:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147261.462601:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147261.462608:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.462640:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1956:x1830967465975936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.462659:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8266 00000100:00100000:0.0:1746147261.462674:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8267 00000100:00100000:0.0:1746147261.462679:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967465976448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.462685:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.462689:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 320 pid: 14049 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462696:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 320 pid: 14049 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462710:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147261.462713:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147261.462718:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.462733:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967465976448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.462738:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8267 00000100:00100000:0.0:1746147261.462766:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8268 00000100:00100000:0.0:1746147261.462771:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967465975808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.462776:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.462780:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 319 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462786:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 319 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462795:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147261.462798:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147261.462803:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.462815:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967465975808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.462820:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8268 00000100:00100000:0.0:1746147261.462829:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8269 00000100:00100000:0.0:1746147261.462833:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967465976320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.462840:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.462844:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 35 pid: 14049 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462850:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 35 pid: 14049 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.462857:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:0.0:1746147261.462860:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147261.462864:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.462877:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967465976320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 43us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.462882:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8269 00000100:00100000:0.0:1746147261.462924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.462963:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976576 00000100:00100000:0.0:1746147261.462966:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976576 00010000:00010000:0.0:1746147261.462977:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 319 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.462996:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8270 00000100:00100000:2.0:1746147261.463001:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976192 00000100:00100000:0.0:1746147261.463001:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967465976576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.463007:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147261.463008:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976192 00010000:00010000:0.0:1746147261.463010:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 320 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.463016:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 320 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.463025:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00000100:00100000:2.0:1746147261.463026:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4857 00010000:00010000:0.0:1746147261.463028:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147261.463031:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:7641:x1830967465976192:12345-192.168.203.36@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746147261.463032:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147261.463045:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967465976576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.463049:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8270 00010000:00010000:3.0:1746147261.463126:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad20ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed56d expref: 319 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.463187:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:7641:x1830967465976192:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 155us (873us total) trans 8589945592 rc 0/0 00000100:00100000:2.0:1746147261.463192:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4857 00000100:00100000:3.0:1746147261.463254:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467134976:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.463272:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f891800/0xb4b2209fbdad206d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed551 expref: 34 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.463280:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135104:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.463288:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135232:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.463294:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ade00/0xb4b2209fbdad1e9f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3ec expref: 33 pid: 14049 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.463302:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.463309:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093782c00/0xb4b2209fbdad1e98 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3e5 expref: 318 pid: 14049 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.463317:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135488:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.463324:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3dd600/0xb4b2209fbdad1e8a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed3de expref: 317 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.463332:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467135616:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.463352:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147261.468452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.468706:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976704 00000100:00100000:3.0:1746147261.468713:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976704 00010000:00010000:3.0:1746147261.468741:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 317 pid: 23726 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.468780:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8271 00000100:00100000:3.0:1746147261.468787:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967465976704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.468798:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.468803:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 317 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.468812:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 317 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.468829:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad1f78 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed47f expref: 317 pid: 23726 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.468846:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.468851:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.468857:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.468862:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.468889:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147261.468912:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147261.468919:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147261.468934:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967465976704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 147us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.468957:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8271 00000040:00080000:0.0:1746147261.469642:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3459, 88 off289888 00000004:00080000:0.0:1746147261.469649:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648456711784ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.469689:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3451, 88 off289184 00000004:00080000:0.0:1746147261.469693:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648456755344ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.469712:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3452, 88 off289272 00000004:00080000:0.0:1746147261.469714:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648456777202ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.469851:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3460, 88 off289976 00000004:00080000:0.0:1746147261.469855:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648456918178ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.469874:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3461, 88 off290064 00000004:00080000:0.0:1746147261.469876:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648456939192ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.469882:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3453, 88 off289360 00000004:00080000:0.0:1746147261.469883:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648456946278ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.470377:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3454, 88 off289448 00000004:00080000:0.0:1746147261.470382:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648457444622ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.470388:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3455, 88 off289536 00000004:00080000:0.0:1746147261.470391:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648457454115ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.470397:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3462, 88 off290152 00000004:00080000:0.0:1746147261.470399:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648457462141ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.470420:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3456, 88 off289624 00000004:00080000:0.0:1746147261.470424:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648457486460ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.470430:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3463, 88 off290240 00000004:00080000:0.0:1746147261.470432:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648457495088ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.470438:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3457, 88 off289712 00000004:00080000:0.0:1746147261.470440:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648457503168ns, next at 607576201812ns, rc = 0 00000040:00080000:0.0:1746147261.470446:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3464, 88 off290328 00000004:00080000:0.0:1746147261.470448:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648457511088ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.470454:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3465, 88 off290416 00000004:00080000:0.0:1746147261.470456:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648457518505ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.470461:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3466, 88 off290504 00000004:00080000:0.0:1746147261.470463:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648457526288ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.470469:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3467, 88 off290592 00000004:00080000:0.0:1746147261.470471:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648457533670ns, next at 592568729900ns, rc = 0 00000040:00080000:0.0:1746147261.470477:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3458, 88 off289800 00000004:00080000:0.0:1746147261.470480:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648457542811ns, next at 607576201812ns, rc = 0 00000001:00080000:1.0:1746147261.492740:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945593 is committed 00000004:00080000:1.0:1746147261.492749:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2584 committed 00000004:00080000:1.0:1746147261.492756:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2589 committed 00000004:00080000:1.0:1746147261.492762:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2588 committed 00000004:00080000:1.0:1746147261.492763:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2587 committed 00000004:00080000:1.0:1746147261.492764:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2586 committed 00000004:00080000:1.0:1746147261.492766:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2583 committed 00000004:00080000:1.0:1746147261.492767:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2585 committed 00000004:00080000:1.0:1746147261.492769:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2582 committed 00000004:00080000:1.0:1746147261.492770:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2584 committed 00000004:00080000:1.0:1746147261.492771:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2581 committed 00000004:00080000:1.0:1746147261.492773:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2580 committed 00000004:00080000:1.0:1746147261.492774:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2579 committed 00000004:00080000:1.0:1746147261.492775:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2583 committed 00000004:00080000:1.0:1746147261.492777:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2582 committed 00000004:00080000:1.0:1746147261.492779:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2578 committed 00000004:00080000:1.0:1746147261.492781:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2577 committed 00000004:00080000:1.0:1746147261.492782:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2581 committed 00000001:00080000:1.0:1746147261.492790:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945584 is committed 00000001:00080000:1.0:1746147261.492804:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945589 is committed 00000001:00080000:1.0:1746147261.492808:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945588 is committed 00000001:00080000:1.0:1746147261.492834:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945592 is committed 00000100:00100000:1.0:1746147261.493030:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467135744:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746147261.493068:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800936de300 reply state ffff8800a5157800 transno 8589945593 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147261.493100:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147261.493120:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467136128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.493165:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.493194:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467136640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.493206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.493227:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136128 00000100:00100000:0.0:1746147261.493228:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136640 00000100:00100000:2.0:1746147261.493233:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136128 00000100:00100000:0.0:1746147261.493233:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136640 00000100:00100000:3.0:1746147261.493337:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467135872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.493358:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.493371:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467136000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.493377:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467136384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.493385:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.493401:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467136512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.493462:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467135872 00000100:00100000:2.0:1746147261.493467:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467135872 00000100:00080000:2.0:1746147261.493481:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147261.493489:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136000 00000100:00100000:2.0:1746147261.493491:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136000 00000100:00100000:1.0:1746147261.493558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147261.493558:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16122 00000100:00100000:0.0:1746147261.493565:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967467136128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.493583:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467137024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.493595:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.493604:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136512 00000100:00100000:1.0:1746147261.493606:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136512 00000100:00100000:3.0:1746147261.493610:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467136896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.493622:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.493622:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136384 00000100:00100000:1.0:1746147261.493623:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136384 00000100:00100000:3.0:1746147261.493629:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467137408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.493631:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136896 00000100:00100000:1.0:1746147261.493633:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136896 00000100:00100000:3.0:1746147261.493641:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.493647:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137408 00000100:00100000:1.0:1746147261.493648:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137408 00000100:00100000:1.0:1746147261.493655:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16123 00000100:00100000:3.0:1746147261.493660:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16124 00000100:00100000:1.0:1746147261.493660:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1830967467136640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.493666:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3294:x1830967467136512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.493693:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16125 00000100:00100000:1.0:1746147261.493697:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1830967467136384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.494006:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16126 00000100:00100000:1.0:1746147261.494013:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3293:x1830967467136896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.494073:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16127 00000100:00100000:0.0:1746147261.494088:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3293:x1830967467137408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.494135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.494142:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467136896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (517us total) trans 17179874114 rc 0/0 00000100:00100000:1.0:1746147261.494148:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16126 00000100:00100000:3.0:1746147261.494154:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467137536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.494163:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137024 00000100:00100000:1.0:1746147261.494165:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137024 00000100:00100000:0.0:1746147261.494170:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467137408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (528us total) trans 17179874115 rc 0/0 00000100:00100000:3.0:1746147261.494171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.494173:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137536 00000100:00100000:1.0:1746147261.494175:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137536 00000100:00100000:0.0:1746147261.494176:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16127 00000100:00100000:1.0:1746147261.494182:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16128 00000100:00100000:1.0:1746147261.494185:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967467137024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.494187:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16129 00000100:00100000:0.0:1746147261.494191:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967467137536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.494197:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874096 gen 2 00000004:00080000:3.0:1746147261.494200:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b209500, transno 17179874059 00000004:00080000:3.0:1746147261.494204:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b209880, transno 17179874060 00000004:00080000:3.0:1746147261.494206:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20a300, transno 17179874061 00000004:00080000:3.0:1746147261.494208:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20b480, transno 17179874062 00000004:00080000:3.0:1746147261.494210:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20b100, transno 17179874063 00000004:00080000:3.0:1746147261.494212:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20ad80, transno 17179874064 00000004:00080000:3.0:1746147261.494213:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b209180, transno 17179874065 00000100:00100000:1.0:1746147261.494213:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147261.494215:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b20a680, transno 17179874066 00000004:00080000:3.0:1746147261.494217:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3800, transno 17179874067 00000004:00080000:3.0:1746147261.494219:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a044aa00, transno 17179874068 00000004:00080000:3.0:1746147261.494221:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448e00, transno 17179874069 00000004:00080000:3.0:1746147261.494222:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448000, transno 17179874070 00000004:00080000:3.0:1746147261.494224:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0449f80, transno 17179874071 00000004:00080000:3.0:1746147261.494225:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498000, transno 17179874072 00000100:00100000:1.0:1746147261.494226:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467136256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.494227:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050a300, transno 17179874073 00000004:00080000:3.0:1746147261.494229:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b800, transno 17179874074 00000004:00080000:3.0:1746147261.494231:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a044b100, transno 17179874075 00000004:00080000:3.0:1746147261.494232:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b480, transno 17179874076 00000004:00080000:3.0:1746147261.494234:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e681880, transno 17179874079 00000004:00080000:3.0:1746147261.494236:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f0000, transno 17179874080 00000004:00080000:3.0:1746147261.494238:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e680e00, transno 17179874081 00000004:00080000:3.0:1746147261.494239:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f1c00, transno 17179874082 00000100:00100000:1.0:1746147261.494240:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147261.494241:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090509c00, transno 17179874083 00000004:00080000:3.0:1746147261.494243:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e681180, transno 17179874084 00000004:00080000:3.0:1746147261.494245:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e682a00, transno 17179874085 00000004:00080000:3.0:1746147261.494247:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3480, transno 17179874086 00000004:00080000:3.0:1746147261.494248:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094400a80, transno 17179874087 00000004:00080000:3.0:1746147261.494250:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1880, transno 17179874088 00000004:00080000:3.0:1746147261.494252:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2300, transno 17179874089 00000004:00080000:3.0:1746147261.494253:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1500, transno 17179874090 00000004:00080000:3.0:1746147261.494255:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c3800, transno 17179874091 00000004:00080000:3.0:1746147261.494257:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2a00, transno 17179874092 00000004:00080000:3.0:1746147261.494258:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1f80, transno 17179874093 00000004:00080000:3.0:1746147261.494260:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094402d80, transno 17179874094 00000004:00080000:3.0:1746147261.494262:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c0a80, transno 17179874095 00000004:00080000:3.0:1746147261.494264:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bfe3480, transno 17179874096 00000100:00100000:3.0:1746147261.494268:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a0448700 x1830967467136896/t17179874114(17179874114) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147277 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746147261.494276:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448700/2, rc 0, transno 17179874114 00000100:00100000:0.0:1746147261.494277:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1830967467137536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (104us total) trans 17179874116 rc 0/0 00000100:00100000:3.0:1746147261.494280:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467136896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.494282:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16129 00000100:00100000:0.0:1746147261.494291:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467135744 00000100:00100000:0.0:1746147261.494294:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467135744 00000100:00100000:0.0:1746147261.494303:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136256 00000100:00100000:0.0:1746147261.494305:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136256 00000100:00100000:0.0:1746147261.494311:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16130 00000100:00100000:0.0:1746147261.494315:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3296:x1830967467135744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.494349:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967467136128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 786us (1183us total) trans 21474841463 rc 0/0 00000100:00100000:0.0:1746147261.494354:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16122 00000100:00100000:0.0:1746147261.494361:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16131 00000100:00100000:0.0:1746147261.494365:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3296:x1830967467136256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.494438:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16132 00000100:00100000:0.0:1746147261.494440:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3296:x1830967467136256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (199us total) trans 21474841466 rc 0/0 00000100:00100000:2.0:1746147261.494444:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3294:x1830967467136000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.494445:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16131 00000100:00100000:2.0:1746147261.494527:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967467136000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1140us total) trans 21474841467 rc 0/0 00000100:00100000:2.0:1746147261.494532:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16132 00000100:00080000:2.0:1746147261.494544:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147261.494824:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467137152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.494844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.494850:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467136768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.494857:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467137664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.494869:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.494881:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137152 00000100:00100000:1.0:1746147261.494882:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467137280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.494883:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137152 00000100:00100000:2.0:1746147261.494890:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467136768 00000100:00100000:2.0:1746147261.494892:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467136768 00000100:00100000:1.0:1746147261.494893:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.494897:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137280 00000100:00100000:2.0:1746147261.494898:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137280 00000100:00100000:1.0:1746147261.494904:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841451 gen 2 00000100:00100000:2.0:1746147261.494905:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16133 00000004:00080000:1.0:1746147261.494907:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090508000, transno 21474841418 00000100:00100000:2.0:1746147261.494909:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967467135872:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147261.494911:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094402300, transno 21474841419 00000100:00100000:0.0:1746147261.494912:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16134 00000004:00080000:1.0:1746147261.494914:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094403100, transno 21474841420 00000004:00080000:1.0:1746147261.494916:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094403800, transno 21474841421 00000004:00080000:1.0:1746147261.494917:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050a680, transno 21474841422 00000100:00100000:0.0:1746147261.494917:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1830967467137152:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147261.494919:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094403480, transno 21474841423 00000004:00080000:1.0:1746147261.494921:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090509180, transno 21474841424 00000004:00080000:1.0:1746147261.494923:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094403b80, transno 21474841425 00000004:00080000:1.0:1746147261.494925:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094400700, transno 21474841426 00000004:00080000:1.0:1746147261.494927:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401c00, transno 21474841427 00000004:00080000:1.0:1746147261.494929:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401f80, transno 21474841428 00000004:00080000:1.0:1746147261.494931:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094402a00, transno 21474841429 00000004:00080000:1.0:1746147261.494932:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094402680, transno 21474841430 00000004:00080000:1.0:1746147261.494934:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401880, transno 21474841431 00000004:00080000:1.0:1746147261.494954:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094401180, transno 21474841432 00000004:00080000:1.0:1746147261.494956:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094400e00, transno 21474841433 00000004:00080000:1.0:1746147261.494958:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050ad80, transno 21474841436 00000004:00080000:1.0:1746147261.494960:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f33b80, transno 21474841437 00000004:00080000:1.0:1746147261.494962:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f32300, transno 21474841438 00000004:00080000:1.0:1746147261.494965:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f30a80, transno 21474841439 00000004:00080000:1.0:1746147261.494966:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f30e00, transno 21474841440 00000004:00080000:1.0:1746147261.494968:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f32680, transno 21474841441 00000004:00080000:1.0:1746147261.494970:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f30700, transno 21474841442 00000004:00080000:1.0:1746147261.494971:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050aa00, transno 21474841443 00000004:00080000:1.0:1746147261.494973:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f731f80, transno 21474841444 00000004:00080000:1.0:1746147261.494975:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f730a80, transno 21474841445 00000004:00080000:1.0:1746147261.494977:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f044000, transno 21474841446 00000004:00080000:1.0:1746147261.494979:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046300, transno 21474841447 00000004:00080000:1.0:1746147261.494981:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4fae680, transno 21474841448 00000004:00080000:1.0:1746147261.494983:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046680, transno 21474841449 00000004:00080000:1.0:1746147261.494985:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f733b80, transno 21474841450 00000004:00080000:1.0:1746147261.494987:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047800, transno 21474841451 00000100:00100000:1.0:1746147261.494991:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009fb73100 x1830967467136256/t21474841466(21474841466) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147277 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147261.494998:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb73100/2, rc 0, transno 21474841466 00000100:00100000:1.0:1746147261.495001:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467136256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.495009:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3293:x1830967467135872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1650us total) trans 21474841468 rc 0/0 00000100:00100000:2.0:1746147261.495015:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16133 00000100:00100000:1.0:1746147261.495018:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16135 00000100:00100000:0.0:1746147261.495019:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967467137152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (173us total) trans 17179874117 rc 0/0 00000100:00100000:2.0:1746147261.495024:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16136 00000100:00100000:1.0:1746147261.495024:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467136768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.495034:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16134 00000004:00080000:3.0:1746147261.495100:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a044b480/2, rc 0, transno 17179874115 00000100:00100000:3.0:1746147261.495104:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467137408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147261.495112:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb70700/2, rc 0, transno 21474841468 00000100:00100000:3.0:1746147261.495114:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467135872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.495140:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467137280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147261.495219:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00000100:00100000:2.0:1746147261.495221:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467137280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (327us total) trans 17179874118 rc 0/0 00002000:00010000:0.0:1746147261.495222:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147261.495224:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147261.495225:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00000100:00100000:2.0:1746147261.495226:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16136 00002000:00010000:0.0:1746147261.495227:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147261.495248:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3293:x1830967467136384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1550us (1653us total) trans 21474841469 rc 0/0 00000100:00100000:0.0:1746147261.495253:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16125 00000100:00100000:0.0:1746147261.495295:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967467136512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1630us (1737us total) trans 21474841464 rc 0/0 00000100:00100000:0.0:1746147261.495300:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16124 00000004:00080000:3.0:1746147261.495335:0:14094:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 36 done 00000004:00080000:3.0:1746147261.495368:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb70380/2, rc 0, transno 21474841467 00000100:00100000:3.0:1746147261.495371:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467136000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.495377:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb71c00/2, rc 0, transno 21474841464 00000100:00100000:3.0:1746147261.495380:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467136512:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.495386:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448380/2, rc 0, transno 17179874116 00000100:00100000:3.0:1746147261.495389:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467137536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147261.495401:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb72680/2, rc 0, transno 21474841469 00000100:00100000:3.0:1746147261.495403:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467136384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.495407:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467136640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1746us (2199us total) trans 21474841465 rc 0/0 00000100:00100000:0.0:1746147261.495412:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16123 00010000:00080000:2.0:1746147261.495471:0:14125:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147261.495485:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32187:x1830967465975680:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 36607us (36673us total) trans 8589945593 rc 0/0 00000100:00100000:2.0:1746147261.495491:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11563 00010000:00010000:3.0:1746147261.495496:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.495503:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.495509:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147261.495511:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467135744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1194us (1296us total) trans 21474841470 rc 0/0 00010000:00010000:3.0:1746147261.495513:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bcc00 already unused, calling callback (ffffffffa136d690) 00000100:00100000:0.0:1746147261.495515:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16130 00010000:00010000:3.0:1746147261.495516:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.495522:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147261.495527:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147261.495534:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.495536:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147261.495539:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.495544:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bcc00/0xb4b2209fbdad258a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000004:00080000:2.0:1746147261.495548:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb72d80/2, rc 0, transno 21474841463 00000100:00100000:2.0:1746147261.495551:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467136128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147261.495556:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb71880/2, rc 0, transno 21474841465 00000100:00100000:2.0:1746147261.495559:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467136640:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147261.495566:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448a80/2, rc 0, transno 17179874117 00000100:00100000:2.0:1746147261.495568:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467137152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.495571:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147261.495575:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467137792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.495588:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.495601:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137664 00000100:00100000:2.0:1746147261.495604:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137664 00000100:00100000:0.0:1746147261.495604:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467137792 00000100:00100000:0.0:1746147261.495607:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467137792 00000100:00100000:2.0:1746147261.495616:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16137 00000100:00100000:2.0:1746147261.495621:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467137664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.495674:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16138 00000100:00100000:0.0:1746147261.495680:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967467137792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.495687:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3296:x1830967467136768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 663us (816us total) trans 17179874119 rc 0/0 00000100:00100000:1.0:1746147261.495693:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16135 00000100:00100000:2.0:1746147261.495706:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967467137664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (177us total) trans 17179874120 rc 0/0 00000100:00100000:2.0:1746147261.495711:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16137 00000004:00080000:3.0:1746147261.495714:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0449c00/2, rc 0, transno 17179874120 00000100:00100000:3.0:1746147261.495717:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467137664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.495766:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967467137792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (176us total) trans 17179874121 rc 0/0 00000100:00100000:0.0:1746147261.495771:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16138 00000004:00080000:3.0:1746147261.495773:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f152d80/2, rc 0, transno 17179874121 00000100:00100000:3.0:1746147261.495775:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467137792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147261.495878:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 1 in flight, 32 done 00000100:00100000:1.0:1746147261.496178:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967467137024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1991us (2042us total) trans 17179874122 rc 0/0 00000100:00100000:1.0:1746147261.496184:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16128 00000004:00080000:3.0:1746147261.496242:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0449500/2, rc 0, transno 17179874122 00000100:00100000:3.0:1746147261.496246:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467137024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147261.496444:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a044ad80/2, rc 0, transno 17179874119 00000100:00100000:2.0:1746147261.496448:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467136768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147261.496454:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0449880/2, rc 0, transno 17179874118 00000100:00100000:2.0:1746147261.496455:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467137280:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147261.496462:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb73b80/2, rc 0, transno 21474841470 00000100:00100000:2.0:1746147261.496464:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467135744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.498466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.498519:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976832 00000100:00100000:3.0:1746147261.498526:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976832 00000100:00100000:3.0:1746147261.498621:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11564 00000100:00100000:3.0:1746147261.498629:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32187:x1830967465976832:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147261.498646:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.498659:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed83e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.498701:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.498712:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.498725:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.498728:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147261.498731:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f446a00, rc 0) 00000100:00100000:3.0:1746147261.498781:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32187:x1830967465976832:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 153us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.498787:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11564 00000100:00100000:0.0:1746147261.500843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.500915:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465976960 00000100:00100000:3.0:1746147261.500921:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465976960 00000100:00100000:3.0:1746147261.501508:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11565 00000100:00100000:3.0:1746147261.501516:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32187:x1830967465976960:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147261.501532:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.501547:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad2598 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed845 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.501607:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad259f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.501622:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad259f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.501630:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad259f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147261.501650:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147261.501653:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147261.501664:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad259f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.501683:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9200/0xb4b2209fbdad2598 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed845 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.501705:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad259f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed845 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.501711:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.501714:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147261.501716:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b9c00, rc 0) 00000100:00100000:3.0:1746147261.501765:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32187:x1830967465976960:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 248us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.501771:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11565 00000100:00100000:0.0:1746147261.503785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.503817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.503846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.503863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.503886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.503961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.503967:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977088 00000100:00100000:2.0:1746147261.503975:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977088 00000100:00100000:0.0:1746147261.503991:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977216 00000100:00100000:0.0:1746147261.503994:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977216 00000100:00100000:2.0:1746147261.504004:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977344 00000100:00100000:2.0:1746147261.504006:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977344 00000100:00100000:0.0:1746147261.504011:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977472 00000100:00100000:0.0:1746147261.504013:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977472 00000100:00100000:2.0:1746147261.504016:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977600 00000100:00100000:2.0:1746147261.504018:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977600 00000100:00100000:0.0:1746147261.504022:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977728 00000100:00100000:0.0:1746147261.504023:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977728 00000100:00100000:2.0:1746147261.504028:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16139 00000100:00100000:2.0:1746147261.504034:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465977088:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147261.504048:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.504063:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed84c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147261.504098:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417bb, atime: 0x681417bb, ctime: 0x681417bb, blocks: 0x81f 00010000:00010000:2.0:1746147261.504112:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.504114:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.504121:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.504133:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.504141:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f21200, rc 0) 00000100:00100000:2.0:1746147261.504172:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465977088:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.504264:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16140 00000100:00100000:0.0:1746147261.504270:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465977216:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147261.504277:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.504285:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed853 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147261.504298:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417bb, atime: 0x681417bb, ctime: 0x681417bb, blocks: 0x821 00010000:00010000:0.0:1746147261.504307:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.504308:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147261.504312:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16141 00010000:00010000:0.0:1746147261.504312:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147261.504319:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16142 00000100:00100000:1.0:1746147261.504320:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465977344:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147261.504322:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147261.504323:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16139 00000100:00100000:3.0:1746147261.504325:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465977472:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147261.504327:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.504328:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5c200, rc 0) 00010000:00010000:3.0:1746147261.504331:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147261.504335:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16143 00010000:00010000:1.0:1746147261.504336:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed85a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.504339:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed861 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.504339:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465977600:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147261.504343:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147261.504345:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465977216:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 75us (527us total) trans 0 rc 0/0 00002000:00010000:1.0:1746147261.504347:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417bc, atime: 0x681417ba, ctime: 0x681417bc, blocks: 0x81d 00010000:00010000:2.0:1746147261.504348:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed868 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147261.504350:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x821 00000100:00100000:0.0:1746147261.504350:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16140 00010000:00010000:1.0:1746147261.504355:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746147261.504356:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x163f 00010000:00010000:1.0:1746147261.504356:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.504358:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.504359:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.504361:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.504361:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147261.504361:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16144 00010000:00010000:2.0:1746147261.504362:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.504363:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.504365:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147261.504366:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465977728:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147261.504370:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 9 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.504372:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.504372:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.504372:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.504377:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094841c00, rc 0) 00010000:00010000:3.0:1746147261.504378:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8b8e00, rc 0) 00010000:00010000:2.0:1746147261.504378:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20c00, rc 0) 00010000:00010000:0.0:1746147261.504378:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed86f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147261.504387:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417bc, atime: 0x681417bb, ctime: 0x681417bc, blocks: 0x102b 00000100:00100000:2.0:1746147261.504392:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465977600:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 52us (505us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147261.504393:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.504394:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147261.504396:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16143 00000100:00100000:3.0:1746147261.504397:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465977472:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 73us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.504397:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465977344:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 78us (550us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147261.504397:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147261.504401:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16142 00010000:00010000:0.0:1746147261.504404:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147261.504409:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16141 00010000:00010000:0.0:1746147261.504410:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5da00, rc 0) 00000100:00100000:0.0:1746147261.504424:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465977728:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 58us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.504429:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16144 00000100:00100000:0.0:1746147261.514295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.514376:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465977984 00000100:00100000:2.0:1746147261.514386:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465977984 00000100:00100000:2.0:1746147261.514456:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7699 00000100:00100000:2.0:1746147261.514464:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465977984:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147261.514492:0:26114:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.514502:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.514503:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.514507:0:26114:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.514517:0:26114:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.519506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.519543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.519570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.519608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.519661:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465978240 00000100:00100000:2.0:1746147261.519671:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465978240 00000100:00100000:3.0:1746147261.519674:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465978496 00000100:00100000:3.0:1746147261.519678:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465978496 00000100:00100000:2.0:1746147261.519717:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465978752 00000100:00100000:2.0:1746147261.519719:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465978752 00000100:00100000:3.0:1746147261.519811:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465979008 00000100:00100000:3.0:1746147261.519815:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465979008 00000100:00100000:2.0:1746147261.519821:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7700 00000100:00100000:2.0:1746147261.519828:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465978240:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:0.0:1746147261.519828:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7701 00000100:00100000:0.0:1746147261.519838:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465978496:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147261.519857:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.519858:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.519868:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.519868:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.519870:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.519870:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.519873:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.519874:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.519883:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.519883:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.519909:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7702 00000100:00100000:3.0:1746147261.519916:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465978752:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147261.519932:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.519964:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.519966:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.519969:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.519978:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.520068:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7703 00000100:00100000:3.0:1746147261.520074:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465979008:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147261.520103:0:8486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.520110:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.520111:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.520114:0:8486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.520120:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.521113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.521141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.521162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.521175:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465979264 00000100:00100000:1.0:1746147261.521178:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465979264 00000100:00100000:1.0:1746147261.521198:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465979520 00000100:00100000:1.0:1746147261.521200:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465979520 00000100:00100000:1.0:1746147261.521210:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465979776 00000100:00100000:1.0:1746147261.521212:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465979776 00000100:00100000:1.0:1746147261.521223:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7704 00000100:00100000:1.0:1746147261.521229:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465979264:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147261.521242:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.521249:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.521251:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.521253:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.521260:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.521358:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7705 00000100:00100000:0.0:1746147261.521364:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465979520:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147261.521377:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.521383:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.521385:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.521387:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.521394:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.521489:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7706 00000100:00100000:2.0:1746147261.521496:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465979776:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147261.521509:0:21472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.521516:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.521518:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.521520:0:21472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.521527:0:21472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524530:0:26114:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524549:0:26114:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524555:0:26114:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524560:0:26114:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147261.524563:0:26114:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524570:0:26114:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524583:0:26114:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.524588:0:26114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20a00/0xb4b2209fbdad25d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.524649:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465977984:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 10183us (10360us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.524657:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7699 00010000:00010000:2.0:1746147261.531019:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.531033:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.531045:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.531050:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b95a000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147261.531053:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.531059:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.531072:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.531091:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdad25de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.531158:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967465978496:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 11318us (11610us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.531166:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7701 00010000:00010000:3.0:1746147261.539511:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.539525:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.539533:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.539539:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bda00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147261.539543:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.539550:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.539564:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.539569:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad25d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.539653:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967465978240:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 19822us (20153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.539662:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7700 00010000:00010000:1.0:1746147261.543863:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.543875:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.543883:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.543894:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094840600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147261.543897:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.543904:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.543918:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.543923:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094840600/0xb4b2209fbdad25f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.544029:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465979264:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 22795us (22913us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147261.544039:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7704 00010000:00010000:3.0:1746147261.548564:0:21472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.548579:0:21472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.548586:0:21472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.548593:0:21472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d59c400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147261.548596:0:21472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.548603:0:21472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.548618:0:21472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.548624:0:21472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d59c400/0xb4b2209fbdad2601 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.549398:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465979776:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 27898us (28230us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.549406:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7706 00010000:00010000:3.0:1746147261.551015:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.551026:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.551032:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.551037:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b9800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147261.551040:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.551045:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.551057:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.551066:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b9800/0xb4b2209fbdad25e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.551121:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465978752:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 31205us (31548us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.551127:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7702 00010000:00010000:3.0:1746147261.557675:0:8486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.557689:0:8486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.557696:0:8486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.557701:0:8486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f447400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147261.557704:0:8486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.557710:0:8486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.557725:0:8486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.557729:0:8486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f447400/0xb4b2209fbdad25ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.557801:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465979008:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 37722us (38188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.557809:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7703 00010000:00010000:2.0:1746147261.559801:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.559813:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.559819:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.559825:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b95b800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147261.559828:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.559835:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.559848:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.559854:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b95b800/0xb4b2209fbdad25fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.559933:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465979520:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 38566us (38788us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.559977:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7705 00000100:00100000:0.0:1746147261.564707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.564790:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980032 00000100:00100000:3.0:1746147261.564799:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980032 00000100:00100000:3.0:1746147261.564851:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11566 00000100:00100000:3.0:1746147261.564858:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32187:x1830967465980032:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147261.564895:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.564914:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b9c00/0xb4b2209fbdad259f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed845 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.564928:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.564932:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147261.564994:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.565004:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.565011:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00010000:3.0:1746147261.565145:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e6f1880 reply state ffff88009d0d3000 transno 8589945594 ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147261.565151:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147261.565216:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32187:x1830967465980032:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 358us (514us total) trans 8589945594 rc 0/0 00000100:00100000:3.0:1746147261.565224:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11566 00010000:00010000:3.0:1746147261.568560:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147261.568566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.568570:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.568576:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.568581:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094840a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147261.568584:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.568590:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147261.568599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.568601:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.568604:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147261.568607:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147261.568612:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094840a00/0xb4b2209fbdad2608 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147261.568622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.568636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.568641:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980288 00000100:00100000:1.0:1746147261.568647:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.568648:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980288 00000100:00100000:1.0:1746147261.568659:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980160 00000100:00100000:1.0:1746147261.568663:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980160 00000100:00100000:2.0:1746147261.568665:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980544 00000100:00100000:2.0:1746147261.568668:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980544 00000100:00100000:0.0:1746147261.568679:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980416 00000100:00100000:0.0:1746147261.568682:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980416 00000100:00100000:1.0:1746147261.568684:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980800 00000100:00100000:1.0:1746147261.568686:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980800 00000100:00100000:2.0:1746147261.568699:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16145 00000100:00100000:2.0:1746147261.568705:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465980288:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:0.0:1746147261.568705:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16146 00000100:00100000:0.0:1746147261.568710:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465980160:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:1.0:1746147261.568713:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16147 00000100:00100000:1.0:1746147261.568717:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465980544:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:3.0:1746147261.568739:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16148 00000100:00100000:3.0:1746147261.568745:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465980416:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:1.0:1746147261.568754:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16149 00000100:00100000:1.0:1746147261.568758:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465980800:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147261.568838:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147261.568838:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147261.568841:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147260 -> 1746147261 00002000:00010000:0.0:1746147261.568841:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147259 -> 1746147261 00002000:00010000:3.0:1746147261.568843:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147258 -> 1746147261 00002000:00010000:0.0:1746147261.568843:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147259 -> 1746147261 00002000:00010000:3.0:1746147261.568845:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147260 -> 1746147261 00002000:00010000:0.0:1746147261.568845:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147259 -> 1746147261 00002000:00010000:0.0:1746147261.568846:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:3.0:1746147261.568847:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:2.0:1746147261.568855:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147261.568855:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147261.568857:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147260 -> 1746147261 00002000:00010000:1.0:1746147261.568857:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147261.568859:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147259 -> 1746147261 00002000:00010000:1.0:1746147261.568859:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147261.568861:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147260 -> 1746147261 00002000:00010000:1.0:1746147261.568861:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147261.568863:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:1.0:1746147261.568863:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147261.568877:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967465980416:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 132us (239us total) trans 21474841472 rc 0/0 00000100:00100000:0.0:1746147261.568877:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465980160:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 166us (277us total) trans 17179874123 rc 0/0 00000100:00100000:2.0:1746147261.568880:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967465980800:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 121us (230us total) trans 21474841471 rc 0/0 00000100:00100000:1.0:1746147261.568880:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967465980544:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 161us (257us total) trans 17179874124 rc 0/0 00000100:00100000:0.0:1746147261.568882:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16146 00000100:00100000:3.0:1746147261.568884:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16148 00000100:00100000:2.0:1746147261.568887:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16149 00000100:00100000:1.0:1746147261.568889:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16147 00002000:00010000:2.0:1746147261.568917:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147261.568919:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147259 -> 1746147261 00002000:00010000:2.0:1746147261.568921:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147259 -> 1746147261 00002000:00010000:2.0:1746147261.568922:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147259 -> 1746147261 00002000:00010000:2.0:1746147261.568924:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147261.568953:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967465980288:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 248us (389us total) trans 21474841473 rc 0/0 00000100:00100000:2.0:1746147261.568958:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16145 00000100:00100000:0.0:1746147261.568998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.569010:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465980672 00000100:00100000:2.0:1746147261.569012:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465980672 00000100:00100000:2.0:1746147261.569027:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16150 00000100:00100000:2.0:1746147261.569031:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465980672:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:2.0:1746147261.569100:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:2.0:1746147261.569102:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147261.569104:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147261.569106:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147261.569107:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:2.0:1746147261.569132:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465980672:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 100us (134us total) trans 17179874125 rc 0/0 00000100:00100000:2.0:1746147261.569138:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16150 00000100:00100000:0.0:1746147261.572804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.572892:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465981056 00000100:00100000:2.0:1746147261.572899:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465981056 00000100:00100000:2.0:1746147261.572930:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4858 00000100:00100000:2.0:1746147261.572954:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32187:x1830967465981056:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:2.0:1746147261.572997:0:14051:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x39b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad2552 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed837 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.573032:0:14051:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14051 initiator: MDT0 00010000:00010000:2.0:1746147261.573042:0:14051:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.573048:0:14051:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14051 initiator: MDT0 00010000:00010000:2.0:1746147261.573072:0:14051:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.573094:0:14051:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 9 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.573478:0:14051:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14051:1830967467137920:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.573557:0:14051:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.574925:0:14051:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14051:1830967467137920:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.574928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147261.574953:0:14051:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000100:00100000:3.0:1746147261.574984:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465981184 00000100:00100000:3.0:1746147261.574990:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465981184 00010000:00010000:3.0:1746147261.575010:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.575040:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8272 00000100:00100000:3.0:1746147261.575047:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967465981184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.575056:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.575060:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.575069:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.575092:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad2591 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed83e expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.575103:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.575107:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147261.575113:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147261.575117:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147261.575130:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.575154:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967465981184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.575160:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8272 00010000:00010000:2.0:1746147261.575217:0:14051:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00010000:00010000:2.0:1746147261.575223:0:14051:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000040:00080000:2.0:1746147261.575700:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3468, 88 off290680 00000004:00080000:2.0:1746147261.575706:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562767951ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575745:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3459, 88 off289888 00000004:00080000:2.0:1746147261.575748:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562810784ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575770:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3460, 88 off289976 00000004:00080000:2.0:1746147261.575773:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562835374ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575780:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3469, 88 off290768 00000004:00080000:2.0:1746147261.575782:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562844754ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575787:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3470, 88 off290856 00000004:00080000:2.0:1746147261.575789:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562852334ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575795:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3461, 88 off290064 00000004:00080000:2.0:1746147261.575798:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562860352ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575803:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3462, 88 off290152 00000004:00080000:2.0:1746147261.575805:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562867944ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575811:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3463, 88 off290240 00000004:00080000:2.0:1746147261.575813:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562875584ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575819:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3471, 88 off290944 00000004:00080000:2.0:1746147261.575821:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562883536ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575826:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3464, 88 off290328 00000004:00080000:2.0:1746147261.575828:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562890942ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575833:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3472, 88 off291032 00000004:00080000:2.0:1746147261.575835:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562897934ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575840:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3465, 88 off290416 00000004:00080000:2.0:1746147261.575842:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562904584ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.575846:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3473, 88 off291120 00000004:00080000:2.0:1746147261.575848:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562910909ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575854:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3474, 88 off291208 00000004:00080000:2.0:1746147261.575855:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562918342ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575861:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3475, 88 off291296 00000004:00080000:2.0:1746147261.575864:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562926451ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575869:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3476, 88 off291384 00000004:00080000:2.0:1746147261.575871:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648562934256ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.575878:0:14051:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3466, 88 off290504 00000004:00080000:2.0:1746147261.575880:0:14051:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648562942601ns, next at 607576201812ns, rc = 0 00000004:00010000:3.0:1746147261.594907:0:14051:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009edc9500 reply state ffff88009b3e2000 transno 8589945595 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14051 initiator: MDT0 00000100:00100000:3.0:1746147261.594920:0:14051:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746147261.594924:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945595 is committed 00000004:00080000:1.0:1746147261.594929:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2592 committed 00010000:00010000:3.0:1746147261.594930:0:14051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.594932:0:14051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1746147261.594950:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2598 committed 00010000:00010000:3.0:1746147261.594955:0:14051:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065a00/0xb4b2209fbdad2552 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed837 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147261.594955:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2597 committed 00000004:00080000:1.0:1746147261.594956:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2596 committed 00000004:00080000:1.0:1746147261.594958:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2595 committed 00000004:00080000:1.0:1746147261.594959:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2591 committed 00000004:00080000:1.0:1746147261.594960:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2594 committed 00000004:00080000:1.0:1746147261.594962:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2590 committed 00000004:00080000:1.0:1746147261.594963:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2593 committed 00000004:00080000:1.0:1746147261.594964:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2589 committed 00000004:00080000:1.0:1746147261.594966:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2588 committed 00000004:00080000:1.0:1746147261.594967:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2587 committed 00000004:00080000:1.0:1746147261.594968:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2592 committed 00000004:00080000:1.0:1746147261.594970:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2591 committed 00000004:00080000:1.0:1746147261.594971:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2586 committed 00010000:00080000:3.0:1746147261.595036:0:14051:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147261.595045:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32187:x1830967465981056:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 22108us (22248us total) trans 8589945595 rc 0/0 00000100:00100000:3.0:1746147261.595052:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4858 00000004:00080000:1.0:1746147261.595171:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2585 committed 00000004:00080000:1.0:1746147261.595178:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2590 committed 00000100:00100000:2.0:1746147261.595205:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467138176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.595242:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147261.595264:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147261.595272:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147261.595278:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14051 initiator: MDT0 00000100:00100000:2.0:1746147261.595278:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467138688:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147261.595282:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d59dc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147261.595286:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14051 initiator: MDT0 00000100:00100000:2.0:1746147261.595293:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147261.595295:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14051 initiator: MDT0 00010000:00010000:3.0:1746147261.595305:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff880092d76e00) 00010000:00010000:3.0:1746147261.595307:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147261.595307:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467139200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.595308:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138176 00010000:00010000:3.0:1746147261.595310:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14051 initiator: MDT0 00000100:00100000:0.0:1746147261.595313:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138176 00010000:00010000:3.0:1746147261.595314:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad260f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14051 initiator: MDT0 00000100:00100000:2.0:1746147261.595320:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595329:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467139712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.595334:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467138048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.595335:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138688 00000100:00100000:0.0:1746147261.595336:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138688 00000100:00100000:2.0:1746147261.595339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147261.595347:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139200 00000100:00100000:0.0:1746147261.595348:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139200 00000100:00100000:3.0:1746147261.595354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595356:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e91ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467138432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.595360:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139712 00000100:00100000:0.0:1746147261.595362:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139712 00000100:00100000:3.0:1746147261.595370:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467138560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.595370:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138048 00000100:00100000:2.0:1746147261.595371:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147261.595371:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138048 00000100:00100000:0.0:1746147261.595377:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138432 00000100:00100000:0.0:1746147261.595379:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138432 00000100:00100000:2.0:1746147261.595380:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467138944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.595384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147261.595386:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16151 00000100:00100000:0.0:1746147261.595391:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967467138176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.595392:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467139072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.595392:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595399:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467139456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.595405:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595410:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.595413:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467139584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.595417:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467139968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.595425:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595431:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138560 00000100:00100000:2.0:1746147261.595434:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138560 00000100:00100000:2.0:1746147261.595443:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138944 00000100:00100000:3.0:1746147261.595445:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467138304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.595445:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138944 00000100:00100000:2.0:1746147261.595450:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139072 00000100:00100000:2.0:1746147261.595451:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139072 00000100:00100000:2.0:1746147261.595456:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139456 00000100:00100000:2.0:1746147261.595457:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139456 00000100:00100000:3.0:1746147261.595458:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595462:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139584 00000100:00100000:2.0:1746147261.595463:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139584 00000100:00100000:3.0:1746147261.595464:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467138816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.595467:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138304 00000100:00100000:2.0:1746147261.595469:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138304 00000100:00100000:3.0:1746147261.595473:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.595475:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16152 00000100:00100000:2.0:1746147261.595478:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967467138688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.595479:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467139328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.595490:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.595496:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467139840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.595507:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147261.595515:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467138816 00000100:00100000:3.0:1746147261.595522:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139328 00000100:00100000:3.0:1746147261.595525:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139328 00000100:00100000:3.0:1746147261.595535:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139840 00000100:00100000:3.0:1746147261.595536:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139840 00000100:00100000:3.0:1746147261.595543:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16153 00000100:00100000:3.0:1746147261.595547:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967467139200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147261.595641:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147261.595644:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.595646:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.595648:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.595649:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746147261.595671:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967467139200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (350us total) trans 21474841474 rc 0/0 00000100:00100000:3.0:1746147261.595676:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16153 00000100:00100000:3.0:1746147261.595688:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16154 00000100:00100000:3.0:1746147261.595692:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967467139712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147261.595754:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:3.0:1746147261.595757:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147261.595758:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147261.595760:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147261.595761:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:3.0:1746147261.595996:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967467139712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (437us total) trans 21474841475 rc 0/0 00000100:00100000:3.0:1746147261.596001:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16154 00000100:00100000:3.0:1746147261.596012:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16155 00000100:00100000:3.0:1746147261.596017:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967467138048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.596170:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467138816 00000100:00100000:0.0:1746147261.596181:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16156 00000100:00100000:0.0:1746147261.596186:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830967467138432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.596197:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16157 00000100:00100000:0.0:1746147261.596201:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467138560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147261.596219:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147261.596221:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.596223:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.596225:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.596226:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147261.596245:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16158 00000100:00100000:0.0:1746147261.596248:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967467138176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 856us (1005us total) trans 17179874126 rc 0/0 00000100:00100000:3.0:1746147261.596251:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967467138944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.596253:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16151 00000100:00100000:3.0:1746147261.596263:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16159 00000100:00100000:3.0:1746147261.596266:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3293:x1830967467139072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.596309:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3294:x1830967467138688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 829us (1014us total) trans 17179874127 rc 0/0 00002000:00010000:3.0:1746147261.596335:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147261.596338:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.596339:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.596341:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.596343:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147261.596366:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967467139072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (959us total) trans 21474841476 rc 0/0 00000100:00100000:0.0:1746147261.596773:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16160 00000100:00100000:0.0:1746147261.596778:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967467139456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.596856:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967467139456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1445us total) trans 21474841477 rc 0/0 00000100:00100000:0.0:1746147261.596861:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16160 00000100:00100000:0.0:1746147261.596870:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16161 00000100:00100000:0.0:1746147261.596873:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967467139584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.596931:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967467139584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1505us total) trans 21474841478 rc 0/0 00000100:00100000:0.0:1746147261.596949:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16161 00000100:00100000:0.0:1746147261.596964:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16162 00000100:00100000:0.0:1746147261.596968:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967467138304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147261.597023:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147261.597026:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.597027:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.597029:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.597031:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:0.0:1746147261.597047:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967467138304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1588us total) trans 17179874129 rc 0/0 00000100:00100000:0.0:1746147261.597051:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16162 00000100:00100000:0.0:1746147261.597057:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16163 00000100:00100000:0.0:1746147261.597061:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967467139328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147261.597137:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147261.597139:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.597141:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.597142:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.597144:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746147261.597161:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467139328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1669us total) trans 21474841479 rc 0/0 00000100:00100000:0.0:1746147261.597165:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16163 00000100:00100000:0.0:1746147261.597174:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16164 00000100:00100000:0.0:1746147261.597178:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967467139840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.597228:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16152 00000100:00100000:3.0:1746147261.597248:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16159 00000100:00100000:0.0:1746147261.597249:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967467139840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1740us total) trans 21474841480 rc 0/0 00000100:00100000:2.0:1746147261.597256:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16165 00000100:00100000:2.0:1746147261.597263:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1830967467138816:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147261.597281:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5e680/2, rc 0, transno 17179874129 00000100:00100000:3.0:1746147261.597287:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467138304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147261.597294:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd500/2, rc 0, transno 21474841479 00000100:00100000:3.0:1746147261.597296:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467139328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.597299:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dea00/2, rc 0, transno 21474841480 00000100:00100000:3.0:1746147261.597301:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467139840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.597327:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467140096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.597347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.597351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.597355:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967467138816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1880us total) trans 17179874130 rc 0/0 00000100:00100000:2.0:1746147261.597361:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16165 00000004:00080000:3.0:1746147261.597369:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4671880/2, rc 0, transno 21474841476 00000100:00100000:2.0:1746147261.597369:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467140096 00000100:00100000:1.0:1746147261.597370:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465981312 00000100:00100000:2.0:1746147261.597372:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467140096 00000100:00100000:3.0:1746147261.597373:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467139072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.597373:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465981312 00000004:00080000:3.0:1746147261.597381:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddf80/2, rc 0, transno 21474841478 00000100:00100000:3.0:1746147261.597383:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467139584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.597383:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16166 00000100:00100000:2.0:1746147261.597387:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467140096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.597393:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11567 00000004:00080000:3.0:1746147261.597398:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919500/2, rc 0, transno 17179874130 00000100:00100000:1.0:1746147261.597398:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:32187:x1830967465981312:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147261.597401:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467138816:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147261.597409:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1746147261.597413:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4673b80/2, rc 0, transno 21474841474 00000100:00100000:3.0:1746147261.597415:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467139200:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.597421:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc700/2, rc 0, transno 21474841475 00010000:00010000:1.0:1746147261.597421:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed876 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.597423:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467139712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.597429:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5d880/2, rc 0, transno 17179874126 00000100:00100000:3.0:1746147261.597431:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467138176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147261.597436:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919880/2, rc 0, transno 17179874127 00000100:00100000:3.0:1746147261.597437:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467138688:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147261.597461:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.597462:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3293:x1830967467140096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (114us total) trans 17179874131 rc 0/0 00000100:00100000:2.0:1746147261.597467:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16166 00010000:00010000:1.0:1746147261.597472:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147261.597473:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448000/2, rc 0, transno 17179874131 00000100:00100000:3.0:1746147261.597476:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467140096:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147261.597484:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147261.597487:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147261.597489:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1c00, rc 0) 00000100:00100000:1.0:1746147261.597513:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32187:x1830967465981312:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 114us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.597518:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11567 00000100:00100000:2.0:1746147261.597529:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147261.597553:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddc00/2, rc 0, transno 21474841477 00000100:00100000:2.0:1746147261.597556:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467139456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.597569:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467139968 00000100:00100000:2.0:1746147261.597571:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467139968 00000100:00100000:2.0:1746147261.597583:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16167 00000100:00100000:3.0:1746147261.597586:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3293:x1830967467138560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1383us (2200us total) trans 17179874132 rc 0/0 00000100:00100000:2.0:1746147261.597587:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967467139968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.597592:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16157 00000004:00080000:3.0:1746147261.597611:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e919180/2, rc 0, transno 17179874132 00000100:00100000:3.0:1746147261.597614:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467138560:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147261.597643:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147261.597645:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.597647:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.597648:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.597650:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147261.597664:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967467139968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (135us total) trans 21474841481 rc 0/0 00000100:00100000:3.0:1746147261.597671:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467138048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1655us (2316us total) trans 17179874128 rc 0/0 00000100:00100000:2.0:1746147261.597671:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16167 00000100:00100000:3.0:1746147261.597676:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16155 00000100:00100000:0.0:1746147261.597698:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16164 00000100:00100000:2.0:1746147261.597741:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830967467138432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1554us (2369us total) trans 17179874133 rc 0/0 00000100:00100000:2.0:1746147261.597746:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16156 00000004:00080000:2.0:1746147261.597761:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e91ad80/2, rc 0, transno 17179874133 00000100:00100000:2.0:1746147261.597764:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e91ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467138432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.597771:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3296:x1830967467138944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1520us (2377us total) trans 17179874134 rc 0/0 00000004:00080000:2.0:1746147261.597771:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0c380/2, rc 0, transno 17179874134 00000100:00100000:2.0:1746147261.597773:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467138944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.597777:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16158 00000004:00080000:2.0:1746147261.597778:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4fae680/2, rc 0, transno 21474841481 00000100:00100000:2.0:1746147261.597781:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467139968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.597797:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5c700/2, rc 0, transno 17179874128 00000100:00100000:3.0:1746147261.597800:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467138048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.602020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.602045:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465981568 00000100:00100000:3.0:1746147261.602052:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465981568 00000100:00100000:3.0:1746147261.602098:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4859 00000100:00100000:3.0:1746147261.602103:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32187:x1830967465981568:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147261.602286:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32187:x1830967465981568:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 181us (273us total) trans 8589945596 rc 0/0 00000100:00100000:3.0:1746147261.602292:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4859 00000100:00100000:0.0:1746147261.612291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.612338:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465981824 00000100:00100000:1.0:1746147261.612345:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465981824 00000100:00100000:1.0:1746147261.612383:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11568 00000100:00100000:1.0:1746147261.612388:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+300:32199:x1830967465981824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.612405:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.612417:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad261d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed87d expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.612487:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612495:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612502:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612509:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612512:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612515:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612598:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612604:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612610:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147261.612616:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147261.612677:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612683:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612692:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612696:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e28e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147261.612699:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612704:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612711:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147261.612713:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147261.612716:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612720:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28e00/0xb4b2209fbdad2624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612748:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612752:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612756:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612759:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e29600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147261.612761:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612765:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612772:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a56de100) 00010000:00010000:1.0:1746147261.612774:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147261.612776:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612779:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad262b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.612804:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad261d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.612812:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.612817:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147261.612819:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147261.612820:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e28c00, rc 0) 00000100:00100000:1.0:1746147261.612853:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32199:x1830967465981824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 464us (568us total) trans 8589945597 rc 0/0 00000100:00100000:1.0:1746147261.612858:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11568 00000100:00100000:1.0:1746147261.615003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.615041:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465982080 00000100:00100000:2.0:1746147261.615048:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465982080 00000100:00100000:2.0:1746147261.615089:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11569 00000100:00100000:2.0:1746147261.615095:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+6:32200:x1830967465982080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.615110:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.615123:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed884 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.615196:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615205:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615213:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615222:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615227:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615231:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615301:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615307:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615311:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147261.615317:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147261.615371:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615377:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615384:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615388:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130aeb800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147261.615391:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615395:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615403:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147261.615406:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147261.615409:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615413:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad2647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615421:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615425:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615430:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615433:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130aeba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147261.615435:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615440:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615448:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76e00) 00010000:00010000:2.0:1746147261.615449:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147261.615451:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615455:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad264e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147261.615478:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.615487:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.615492:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147261.615493:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147261.615495:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aea400, rc 0) 00000100:00100000:2.0:1746147261.615535:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32200:x1830967465982080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 441us (537us total) trans 8589945598 rc 0/0 00000100:00100000:2.0:1746147261.615541:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11569 00000100:00100000:0.0:1746147261.616199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.616283:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465982208 00000100:00100000:3.0:1746147261.616287:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465982208 00000100:00100000:3.0:1746147261.616321:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16168 00000100:00100000:3.0:1746147261.616326:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:32199:x1830967465982208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147261.616333:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.616343:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed88b expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.616355:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.616357:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.616364:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.616373:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.616381:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85ade00, rc 0) 00000100:00100000:3.0:1746147261.616414:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32199:x1830967465982208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.616420:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16168 00000100:00100000:0.0:1746147261.618478:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.618523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.618546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.618584:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465982464 00000100:00100000:1.0:1746147261.618591:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465982464 00000100:00100000:1.0:1746147261.618618:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465982848 00000100:00100000:1.0:1746147261.618620:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465982848 00000100:00100000:2.0:1746147261.618621:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465982592 00000100:00100000:2.0:1746147261.618625:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465982592 00000100:00100000:1.0:1746147261.618636:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11570 00000100:00100000:1.0:1746147261.618641:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32197:x1830967465982464:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147261.618646:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16169 00000100:00100000:2.0:1746147261.618651:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32200:x1830967465982592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.618656:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.618659:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.618668:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed899 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.618669:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099e11e00/0xb4b2209fbdad2671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed892 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.618688:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.618690:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.618696:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.618706:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.618712:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aeb200, rc 0) 00000100:00100000:3.0:1746147261.618713:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11571 00000100:00100000:3.0:1746147261.618720:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32196:x1830967465982848:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.618731:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.618737:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad2678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8a0 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.618739:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147261.618746:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32200:x1830967465982592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 95us (222us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147261.618748:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.618751:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16169 00010000:00010000:1.0:1746147261.618755:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.618761:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147261.618763:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147261.618768:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147261.618782:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147261.618790:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.618799:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 9 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.618810:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467140224:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147261.618888:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.618896:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 303 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.619001:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467140352:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147261.619102:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.619387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.619434:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465983104 00000100:00100000:2.0:1746147261.619437:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465983104 00002000:00100000:2.0:1746147261.619459:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880099f6a300 x1830967465983104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.619467:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967465983104 ext(0->1048575) 00002000:00010000:2.0:1746147261.619471:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:2.0:1746147261.619491:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7707 00000100:00100000:2.0:1746147261.619496:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465983104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147261.620090:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467140224:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147261.620099:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467140352:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.620101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147261.620112:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:3.0:1746147261.620155:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465983232 00000100:00100000:3.0:1746147261.620159:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465983232 00010000:00010000:3.0:1746147261.620173:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.620194:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8273 00000100:00100000:3.0:1746147261.620200:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465983232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.620207:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.620212:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.620219:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.620232:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad2655 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed884 expref: 10 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.620246:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147261.620249:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147261.620255:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147261.620259:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.620284:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967465983232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.620289:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8273 00000100:00100000:0.0:1746147261.620654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.620714:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465983360 00000100:00100000:3.0:1746147261.620718:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465983360 00010000:00010000:3.0:1746147261.620729:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.620752:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8274 00000100:00100000:3.0:1746147261.620757:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967465983360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.620763:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.620767:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.620775:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.620784:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e28c00/0xb4b2209fbdad2632 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed87d expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.620795:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147261.620798:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147261.620803:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147261.620807:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147261.620812:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147261.620816:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147261.620819:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147261.620860:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147261.620866:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147261.620878:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147261.620978:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad2678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.620991:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.620996:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147261.620998:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147261.621000:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e29600, rc 0) 00000100:00100000:0.0:1746147261.621018:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32196:x1830967465982848:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2299us (2471us total) trans 8589945599 rc 0/0 00000100:00100000:0.0:1746147261.621022:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11571 00010000:00010000:3.0:1746147261.621127:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.621148:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967465983360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 390us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.621154:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8274 00010000:00010000:1.0:1746147261.621237:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147261.621243:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147261.621252:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147261.621304:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099e11e00/0xb4b2209fbdad2671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 304 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.621330:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.621336:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147261.621337:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147261.621339:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f614a00, rc 0) 00000100:00100000:1.0:1746147261.621356:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32197:x1830967465982464:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2715us (2884us total) trans 8589945600 rc 0/0 00000100:00100000:1.0:1746147261.621361:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11570 00000100:00100000:0.0:1746147261.624236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.624328:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465983616 00000100:00100000:3.0:1746147261.624335:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465983616 00002000:00100000:3.0:1746147261.624365:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b209880 x1830967465983616/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.624375:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209880 with x1830967465983616 ext(0->1048575) 00002000:00010000:3.0:1746147261.624379:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b209880 00000100:00100000:3.0:1746147261.624406:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7708 00000100:00100000:3.0:1746147261.624421:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465983616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.633149:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967465983104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13644us (13753us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.633158:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7707 00002000:00100000:2.0:1746147261.633168:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880099f6a300 x1830967465983104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.633182:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967465983104 ext(0->1048575) 00002000:00010000:2.0:1746147261.633187:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:2.0:1746147261.645626:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465983616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21205us (21387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.645637:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7708 00002000:00100000:2.0:1746147261.645646:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b209880 x1830967465983616/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.645655:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209880 with x1830967465983616 ext(0->1048575) 00002000:00010000:2.0:1746147261.645659:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b209880 00000100:00100000:1.0:1746147261.645725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.645762:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465983744 00000100:00100000:2.0:1746147261.645768:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465983744 00000100:00100000:2.0:1746147261.645795:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16170 00000100:00100000:2.0:1746147261.645801:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+14:32199:x1830967465983744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.645811:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.645825:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8a7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.645843:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.645845:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.645851:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.645863:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.645875:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aea200, rc 0) 00000100:00100000:2.0:1746147261.645906:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32199:x1830967465983744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 105us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.645911:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16170 00000100:00100000:0.0:1746147261.648052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.648114:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465983872 00000100:00100000:1.0:1746147261.648121:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465983872 00000100:00100000:1.0:1746147261.648162:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11572 00000100:00100000:1.0:1746147261.648168:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32199:x1830967465983872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.648183:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.648196:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8ae expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.648239:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 304 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.648250:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 304 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.648262:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147261.648265:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147261.648267:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ec800, rc 0) 00000100:00100000:1.0:1746147261.648314:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32199:x1830967465983872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.648319:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11572 00000100:00100000:0.0:1746147261.658346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.658434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.658529:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465984000 00000100:00100000:2.0:1746147261.658537:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465984000 00000100:00100000:2.0:1746147261.658571:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16171 00000100:00100000:2.0:1746147261.658578:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32200:x1830967465984000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.658592:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.658605:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8b5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.658623:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.658625:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.658631:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.658642:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.658658:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aeb800, rc 0) 00000100:00100000:2.0:1746147261.658711:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32200:x1830967465984000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.658717:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16171 00000100:00100000:3.0:1746147261.658788:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465984256 00000100:00100000:3.0:1746147261.658793:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465984256 00002000:00100000:3.0:1746147261.658817:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b20b100 x1830967465984256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.658824:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967465984256 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.658828:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20b100 00000100:00100000:3.0:1746147261.658841:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7709 00000100:00100000:3.0:1746147261.658846:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465984256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.666817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.667102:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465984384 00000100:00100000:1.0:1746147261.667110:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465984384 00000100:00100000:1.0:1746147261.667154:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11573 00000100:00100000:1.0:1746147261.667161:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32200:x1830967465984384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.667179:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.667193:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad26b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8bc expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.667236:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad26b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8bc expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.667246:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad26b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8bc expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.667259:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147261.667261:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147261.667264:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ecc00, rc 0) 00000100:00100000:1.0:1746147261.667309:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32200:x1830967465984384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.667314:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11573 00000100:00100000:3.0:1746147261.671975:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967465984256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13121us (13533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.671985:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7709 00002000:00100000:3.0:1746147261.671994:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b20b100 x1830967465984256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.672004:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967465984256 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.672008:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20b100 00000100:00100000:0.0:1746147261.677049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.677148:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465984512 00000100:00100000:2.0:1746147261.677156:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465984512 00000100:00100000:2.0:1746147261.677191:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16172 00000100:00100000:2.0:1746147261.677199:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32199:x1830967465984512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.677216:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.677230:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8c3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.677254:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.677256:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.677262:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.677273:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.677282:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422400, rc 0) 00000100:00100000:2.0:1746147261.677327:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:32199:x1830967465984512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.677333:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16172 00000100:00100000:0.0:1746147261.680237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.680280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.680353:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465984896 00000100:00100000:2.0:1746147261.680360:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465984896 00002000:00100000:2.0:1746147261.680393:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b20a680 x1830967465984896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.680402:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967465984896 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.680406:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:2.0:1746147261.680418:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985024 00000100:00100000:2.0:1746147261.680420:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985024 00002000:00100000:2.0:1746147261.680429:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b20aa00 x1830967465985024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.680437:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20aa00 with x1830967465985024 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.680439:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20aa00 00000100:00100000:2.0:1746147261.680449:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7710 00000100:00100000:2.0:1746147261.680455:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465984896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.681571:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7711 00000100:00100000:2.0:1746147261.681579:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967465985024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.696198:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967465984896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15735us (15960us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.696208:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7710 00002000:00100000:2.0:1746147261.696217:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b20a680 x1830967465984896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.696226:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967465984896 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.696231:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:2.0:1746147261.697048:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967465985024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15469us (16766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.697054:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7711 00002000:00100000:2.0:1746147261.697059:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b20aa00 x1830967465985024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.697066:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20aa00 with x1830967465985024 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.697069:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20aa00 00000100:00100000:0.0:1746147261.701753:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.702978:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985152 00000100:00100000:2.0:1746147261.702989:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985152 00000100:00100000:2.0:1746147261.703038:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16173 00000100:00100000:2.0:1746147261.703047:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32200:x1830967465985152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.703065:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.703094:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8ca expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.703119:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.703120:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.703128:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.703142:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.703153:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423800, rc 0) 00000100:00100000:2.0:1746147261.703234:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32200:x1830967465985152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 187us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.703240:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16173 00000100:00100000:0.0:1746147261.703466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.703611:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985280 00000100:00100000:2.0:1746147261.703616:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985280 00000100:00100000:2.0:1746147261.703882:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16174 00000100:00100000:2.0:1746147261.703890:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32199:x1830967465985280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.703900:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.703912:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8d1 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.703925:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.703927:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.703932:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.703985:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704051:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423600, rc 0) 00000100:00100000:2.0:1746147261.704094:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32199:x1830967465985280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 205us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.704099:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16174 00000100:00100000:1.0:1746147261.704137:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.704211:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985536 00000100:00100000:2.0:1746147261.704214:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985536 00000100:00100000:2.0:1746147261.704244:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11574 00000100:00100000:2.0:1746147261.704249:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32196:x1830967465985536:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147261.704257:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.704259:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147261.704274:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad26b0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8bc expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704299:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147261.704303:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147261.704310:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad26cc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8d8 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704344:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147261.704353:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704360:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704365:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147261.704430:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704439:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 303 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.704448:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467140480:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.704894:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.704903:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 7 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.704910:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467140608:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.704966:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.705225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.705281:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985664 00000100:00100000:1.0:1746147261.705285:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985664 00000100:00100000:1.0:1746147261.705309:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11575 00000100:00100000:1.0:1746147261.705313:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32200:x1830967465985664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.705320:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.705326:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8df expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.705350:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147261.705356:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.705364:0:14047:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147261.705371:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.705383:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147261.705385:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147261.705387:0:14047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147261.705391:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094df6c00, rc 0) 00000100:00100000:1.0:1746147261.705408:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32200:x1830967465985664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 94us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.705412:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11575 00000100:00100000:0.0:1746147261.706821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.706854:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467140480:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.707715:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985792 00000100:00100000:3.0:1746147261.707721:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985792 00010000:00010000:3.0:1746147261.707745:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.707767:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8275 00000100:00100000:3.0:1746147261.707773:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1958:x1830967465985792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.707783:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.707787:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.707796:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.707812:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec800/0xb4b2209fbdad26a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ae expref: 304 pid: 14047 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.707918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.707978:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467140608:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.707997:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147261.708021:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465985920 00000100:00100000:2.0:1746147261.708024:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465985920 00010000:00010000:2.0:1746147261.708034:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 8 pid: 14125 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.708053:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8276 00000100:00100000:2.0:1746147261.708058:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967465985920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.708064:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.708067:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 8 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.708085:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 8 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.708096:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdad2616 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed876 expref: 8 pid: 14125 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.708106:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147261.708110:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147261.708118:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147261.708124:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147261.708130:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 11 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.708147:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.708174:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1956:x1830967465985920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.708179:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8276 00010000:00010000:2.0:1746147261.708194:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147261.708199:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00000040:00080000:2.0:1746147261.708656:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3477, 88 off291472 00000004:00080000:2.0:1746147261.708661:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648695723062ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.708690:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3467, 88 off290592 00000004:00080000:2.0:1746147261.708692:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648695754952ns, next at 607576201812ns, rc = 0 00000100:00100000:0.0:1746147261.708830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147261.709030:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147261.709035:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 11 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.709041:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.709059:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1958:x1830967465985792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1287us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.709067:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8275 00000100:00100000:3.0:1746147261.709136:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465986176 00000100:00100000:3.0:1746147261.709144:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465986176 00002000:00100000:3.0:1746147261.709166:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134ed5500 x1830967465986176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.709174:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5500 with x1830967465986176 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.709177:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed5500 00000100:00100000:3.0:1746147261.709189:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7712 00000100:00100000:3.0:1746147261.709193:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465986176:12345-192.168.203.36@tcp:3:cat.0 00000040:00080000:2.0:1746147261.709336:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3468, 88 off290680 00000004:00080000:2.0:1746147261.709342:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696404462ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.709351:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3478, 88 off291560 00000004:00080000:2.0:1746147261.709354:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696417100ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709364:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3479, 88 off291648 00000004:00080000:2.0:1746147261.709366:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696429247ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709373:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3469, 88 off290768 00000004:00080000:2.0:1746147261.709375:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696437692ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.709381:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3470, 88 off290856 00000004:00080000:2.0:1746147261.709384:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696446484ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.709390:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3471, 88 off290944 00000004:00080000:2.0:1746147261.709392:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696454974ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.709398:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3480, 88 off291736 00000004:00080000:2.0:1746147261.709401:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696464197ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709408:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3472, 88 off291032 00000004:00080000:2.0:1746147261.709410:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696472977ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.709416:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3481, 88 off291824 00000004:00080000:2.0:1746147261.709418:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696481193ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709424:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3473, 88 off291120 00000004:00080000:2.0:1746147261.709427:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696489353ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147261.709432:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3482, 88 off291912 00000004:00080000:2.0:1746147261.709434:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696497280ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709440:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3483, 88 off292000 00000004:00080000:2.0:1746147261.709442:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696505174ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709448:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3484, 88 off292088 00000004:00080000:2.0:1746147261.709450:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696513032ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709456:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3485, 88 off292176 00000004:00080000:2.0:1746147261.709458:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648696520782ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147261.709464:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3474, 88 off291208 00000004:00080000:2.0:1746147261.709466:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648696528988ns, next at 607576201812ns, rc = 0 00000100:00100000:3.0:1746147261.717399:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465986176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8195us (8559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.717410:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7712 00002000:00100000:3.0:1746147261.717419:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134ed5500 x1830967465986176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.717428:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5500 with x1830967465986176 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.717433:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed5500 00000100:00100000:2.0:1746147261.723637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.723686:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465986304 00000100:00100000:0.0:1746147261.723693:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465986304 00000100:00100000:0.0:1746147261.723718:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11576 00000100:00100000:0.0:1746147261.723722:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32199:x1830967465986304:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147261.723734:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.723745:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8e6 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.723781:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 304 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.723788:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 304 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.723796:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147261.723798:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147261.723800:0:14047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 12 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.723807:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5600, rc 0) 00000100:00100000:0.0:1746147261.723834:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32199:x1830967465986304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 112us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.723838:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11576 00000001:00080000:1.0:1746147261.725018:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945599 is committed 00000001:00080000:1.0:1746147261.725026:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945600 is committed 00000001:00080000:1.0:1746147261.725030:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945601 is committed 00000004:00080000:1.0:1746147261.725033:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2600 committed 00000004:00080000:1.0:1746147261.725038:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2607 committed 00000004:00080000:1.0:1746147261.725041:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2606 committed 00000004:00080000:1.0:1746147261.725043:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2605 committed 00000004:00080000:1.0:1746147261.725044:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2604 committed 00000004:00080000:1.0:1746147261.725045:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2599 committed 00000004:00080000:1.0:1746147261.725046:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2603 committed 00000004:00080000:1.0:1746147261.725047:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2598 committed 00000004:00080000:1.0:1746147261.725048:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2602 committed 00000004:00080000:1.0:1746147261.725048:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2597 committed 00000004:00080000:1.0:1746147261.725049:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2596 committed 00000004:00080000:1.0:1746147261.725050:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2595 committed 00000004:00080000:1.0:1746147261.725052:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2601 committed 00000004:00080000:1.0:1746147261.725053:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2600 committed 00000004:00080000:1.0:1746147261.725054:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2594 committed 00000004:00080000:1.0:1746147261.725055:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2593 committed 00000004:00080000:1.0:1746147261.725056:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2599 committed 00000001:00080000:1.0:1746147261.725061:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945596 is committed 00000100:00100000:1.0:1746147261.725119:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467140864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.725146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.725160:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467140736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.725167:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467141376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.725175:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.725184:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.725187:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467141888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.725196:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.725201:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467141248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.725203:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467142400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.725213:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.725220:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467141120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.725222:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746147261.725225:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467140992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.725233:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.725238:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467140864 00000100:00100000:1.0:1746147261.725241:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467140864 00000100:00100000:3.0:1746147261.725248:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467141632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.725256:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141376 00000100:00100000:1.0:1746147261.725257:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141376 00000100:00100000:3.0:1746147261.725261:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.725262:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467140736 00000100:00100000:1.0:1746147261.725264:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467140736 00000100:00100000:1.0:1746147261.725270:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141888 00000100:00100000:3.0:1746147261.725271:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467142144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.725271:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141888 00000100:00100000:1.0:1746147261.725275:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142400 00000100:00100000:1.0:1746147261.725276:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142400 00000100:00100000:1.0:1746147261.725279:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141120 00000100:00100000:1.0:1746147261.725280:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141120 00000100:00100000:3.0:1746147261.725281:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.725284:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141632 00000100:00100000:1.0:1746147261.725285:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141632 00000100:00100000:3.0:1746147261.725288:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467142656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.725288:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142144 00000100:00100000:1.0:1746147261.725289:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142144 00000100:00100000:1.0:1746147261.725294:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16175 00000100:00100000:3.0:1746147261.725297:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.725297:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967467140864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.725313:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142656 00000100:00100000:3.0:1746147261.725316:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142656 00000100:00100000:3.0:1746147261.725330:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16176 00000100:00100000:3.0:1746147261.725335:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967467141376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147261.725397:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147261.725399:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.725401:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.725402:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.725403:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147261.725419:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3295:x1830967467140864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (272us total) trans 21474841482 rc 0/0 00000100:00100000:1.0:1746147261.725422:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16175 00000100:00100000:3.0:1746147261.725426:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3295:x1830967467141376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (248us total) trans 21474841483 rc 0/0 00000100:00100000:1.0:1746147261.725431:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16177 00000100:00100000:3.0:1746147261.725434:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16176 00000100:00100000:1.0:1746147261.725434:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3294:x1830967467140736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.725445:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16178 00000100:00100000:3.0:1746147261.725450:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1830967467141888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147261.725496:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147261.725497:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.725498:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.725500:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.725501:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147261.725512:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967467140736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (328us total) trans 17179874135 rc 0/0 00000100:00100000:1.0:1746147261.725515:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16177 00002000:00010000:3.0:1746147261.725516:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147261.725518:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.725520:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00000100:00100000:1.0:1746147261.725520:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16179 00002000:00010000:3.0:1746147261.725521:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.725523:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147261.725523:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967467142400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.725541:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967467141888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (343us total) trans 17179874136 rc 0/0 00000100:00100000:3.0:1746147261.725546:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16178 00000100:00100000:3.0:1746147261.725556:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16180 00000100:00100000:3.0:1746147261.725560:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3293:x1830967467141120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147261.725569:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967467142400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (355us total) trans 17179874137 rc 0/0 00000100:00100000:1.0:1746147261.725572:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16179 00000100:00100000:1.0:1746147261.725578:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16181 00000100:00100000:1.0:1746147261.725581:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3293:x1830967467141632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147261.725622:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147261.725625:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.725626:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.725628:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147261.725629:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746147261.725631:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3293:x1830967467141632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (369us total) trans 21474841485 rc 0/0 00000100:00100000:1.0:1746147261.725634:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16181 00000100:00100000:1.0:1746147261.725640:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16182 00000100:00100000:1.0:1746147261.725642:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3293:x1830967467142144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.725648:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3293:x1830967467141120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (413us total) trans 21474841484 rc 0/0 00000100:00100000:3.0:1746147261.725652:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16180 00000100:00100000:3.0:1746147261.725662:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16183 00000100:00100000:3.0:1746147261.725666:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3293:x1830967467142656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.725690:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3293:x1830967467142144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (408us total) trans 17179874138 rc 0/0 00000100:00100000:1.0:1746147261.725693:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16182 00000100:00100000:1.0:1746147261.725712:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.725720:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467141504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.725742:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3293:x1830967467142656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (442us total) trans 17179874139 rc 0/0 00000100:00100000:1.0:1746147261.725745:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467140992 00000100:00100000:3.0:1746147261.725746:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16183 00000100:00100000:1.0:1746147261.725746:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467140992 00000100:00100000:3.0:1746147261.725764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147261.725777:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467141760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.725779:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141248 00000100:00100000:2.0:1746147261.725781:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141248 00000100:00100000:3.0:1746147261.725792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.725792:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16184 00000100:00100000:2.0:1746147261.725798:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967467141248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147261.725802:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467142272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.725815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147261.725825:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141760 00000100:00100000:0.0:1746147261.725830:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141760 00000004:00080000:3.0:1746147261.725838:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dfb80/2, rc 0, transno 17179874135 00000100:00100000:0.0:1746147261.725844:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142272 00000100:00100000:3.0:1746147261.725845:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467140736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147261.725845:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142272 00000100:00100000:0.0:1746147261.725854:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16185 00000100:00100000:0.0:1746147261.725858:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967467141760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147261.725861:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967467141248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (96us total) trans 21474841486 rc 0/0 00000100:00100000:3.0:1746147261.725864:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16186 00000100:00100000:3.0:1746147261.725869:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967467142272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.725873:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16184 00000100:00100000:0.0:1746147261.725958:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967467141760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (165us total) trans 21474841487 rc 0/0 00000100:00100000:0.0:1746147261.725964:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16185 00000100:00100000:3.0:1746147261.725966:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967467142272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (149us total) trans 17179874140 rc 0/0 00000100:00100000:3.0:1746147261.725971:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16186 00010000:00010000:2.0:1746147261.725983:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.725993:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00000004:00080000:3.0:1746147261.725994:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046680/2, rc 0, transno 21474841484 00010000:00010000:2.0:1746147261.725994:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147261.725997:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.725998:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467141120:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147261.726002:0:14048:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147261.726004:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9f80/2, rc 0, transno 21474841485 00010000:00010000:2.0:1746147261.726006:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.726007:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467141632:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147261.726010:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 301 pid: 14047 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147261.726013:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df480/2, rc 0, transno 17179874138 00010000:00010000:2.0:1746147261.726013:0:14048:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 301 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.726015:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467142144:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147261.726017:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 301 pid: 14047 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147261.726020:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e681180/2, rc 0, transno 17179874139 00000100:00100000:3.0:1746147261.726023:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467142656:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147261.726029:0:14048:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 301 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.726034:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467142784:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147261.726045:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746147261.726050:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467142912:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147261.726063:0:14048:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.726065:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147261.726070:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467143040:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147261.726091:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.726094:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142912 00000100:00100000:3.0:1746147261.726097:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142912 00000100:00100000:3.0:1746147261.726120:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16187 00000100:00100000:3.0:1746147261.726124:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3293:x1830967467142912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.726203:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967467142912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (136us total) trans 17179874141 rc 0/0 00000100:00100000:3.0:1746147261.726208:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16187 00000004:00080000:3.0:1746147261.726226:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047800/2, rc 0, transno 21474841486 00000100:00100000:3.0:1746147261.726229:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467141248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.726234:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c8000/2, rc 0, transno 21474841487 00000100:00100000:3.0:1746147261.726236:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467141760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147261.726242:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcaa00/2, rc 0, transno 17179874140 00000100:00100000:3.0:1746147261.726244:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467142272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147261.726290:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c2300/2, rc 0, transno 17179874141 00000100:00100000:2.0:1746147261.726293:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467142912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.726407:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16188 00000100:00100000:1.0:1746147261.726411:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3295:x1830967467140992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147261.726464:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147261.726466:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.726467:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.726468:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147261.726470:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147261.726483:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967467140992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (770us total) trans 21474841488 rc 0/0 00000100:00100000:1.0:1746147261.726486:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16188 00000100:00100000:1.0:1746147261.726500:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.726763:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467142016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.726774:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147261.726790:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467142528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147261.726798:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147261.726816:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd880/2, rc 0, transno 17179874136 00000100:00100000:1.0:1746147261.726818:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467141888:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147261.726822:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e681880/2, rc 0, transno 17179874137 00000100:00100000:1.0:1746147261.726823:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467142400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147261.726828:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044000/2, rc 0, transno 21474841482 00000100:00100000:1.0:1746147261.726829:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467140864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147261.726833:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f733b80/2, rc 0, transno 21474841483 00000100:00100000:1.0:1746147261.726834:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467141376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147261.726838:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 21474841488 00000100:00100000:1.0:1746147261.726839:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467140992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147261.726878:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467141504 00000100:00100000:0.0:1746147261.726880:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467141504 00000100:00100000:0.0:1746147261.726890:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142016 00000100:00100000:0.0:1746147261.726891:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142016 00000100:00100000:0.0:1746147261.726897:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467142528 00000100:00100000:0.0:1746147261.726898:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467142528 00000100:00100000:0.0:1746147261.726903:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16189 00000100:00100000:0.0:1746147261.726906:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967467141504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147261.726969:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147261.726971:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147261.726972:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147261.726973:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147261.726974:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147261.726990:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830967467141504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (489us total) trans 21474841489 rc 0/0 00000100:00100000:0.0:1746147261.726993:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16189 00000100:00100000:0.0:1746147261.726999:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16190 00000100:00100000:0.0:1746147261.727002:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967467142016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147261.727047:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:0.0:1746147261.727048:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.727049:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.727050:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147261.727051:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:0.0:1746147261.727062:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467142016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (287us total) trans 17179874142 rc 0/0 00000100:00100000:0.0:1746147261.727064:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16190 00000100:00100000:3.0:1746147261.727070:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16191 00000100:00100000:3.0:1746147261.727089:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967467142528:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147261.727118:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9180/2, rc 0, transno 21474841489 00000100:00100000:1.0:1746147261.727122:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467141504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147261.727128:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd180/2, rc 0, transno 17179874142 00000100:00100000:1.0:1746147261.727131:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467142016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147261.727190:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967467142528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (390us total) trans 17179874143 rc 0/0 00000100:00100000:3.0:1746147261.727195:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16191 00000004:00080000:1.0:1746147261.727250:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e680e00/2, rc 0, transno 17179874143 00000100:00100000:1.0:1746147261.727253:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467142528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147261.727853:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467142784:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147261.727861:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467143040:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.727885:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad26cc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 10 pid: 14048 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147261.727898:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.727917:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423a00, rc 0) 00000100:00100000:2.0:1746147261.727952:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32196:x1830967465985536:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 23702us (23814us total) trans 8589945601 rc 0/0 00000100:00100000:2.0:1746147261.727957:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11574 00000100:00100000:0.0:1746147261.728324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.728379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.728397:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465986432 00000100:00100000:2.0:1746147261.728401:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465986432 00000100:00100000:2.0:1746147261.728427:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465986560 00000100:00100000:2.0:1746147261.728428:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465986560 00000100:00100000:2.0:1746147261.728442:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4860 00000100:00100000:0.0:1746147261.728446:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4861 00000100:00100000:2.0:1746147261.728447:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32199:x1830967465986432:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147261.728450:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32200:x1830967465986560:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:2.0:1746147261.728503:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32199:x1830967465986432:12345-192.168.203.36@tcp:49:cat.0 Request processed in 56us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.728503:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32200:x1830967465986560:12345-192.168.203.36@tcp:49:cat.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147261.728509:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4861 00000100:00100000:2.0:1746147261.728511:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4860 00000100:00100000:0.0:1746147261.730328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.730411:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465986688 00000100:00100000:2.0:1746147261.730418:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465986688 00000100:00100000:2.0:1746147261.730449:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4862 00000100:00100000:2.0:1746147261.730455:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32196:x1830967465986688:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:2.0:1746147261.731020:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32196:x1830967465986688:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 563us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.731027:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4862 00000100:00100000:0.0:1746147261.737150:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.737316:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465986816 00000100:00100000:3.0:1746147261.737325:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465986816 00000100:00100000:3.0:1746147261.737359:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16192 00000100:00100000:3.0:1746147261.737365:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32196:x1830967465986816:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.737378:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.737392:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8ed expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.737414:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.737420:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.737422:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.737424:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3854336->4194303] (req 3854336->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.737446:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.737456:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 10 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.737467:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467143168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.737547:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.748750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.748843:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467143168:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.748846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147261.748866:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3854336->4194303] (req 3854336->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.748883:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbf000, rc 0) 00000100:00100000:2.0:1746147261.748922:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32196:x1830967465986816:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11558us (11781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.748928:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16192 00000100:00100000:3.0:1746147261.749086:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987072 00000100:00100000:3.0:1746147261.749092:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987072 00002000:00100000:3.0:1746147261.749120:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134ed6d80 x1830967465987072/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.749129:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6d80 with x1830967465987072 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.749133:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ed6d80 00000100:00100000:3.0:1746147261.749156:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7713 00000100:00100000:3.0:1746147261.749163:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465987072:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147261.753113:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987200 00000100:00100000:3.0:1746147261.753123:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987200 00010000:00010000:3.0:1746147261.753154:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 11 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.753182:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8277 00000100:00100000:3.0:1746147261.753187:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465987200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.753198:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.753216:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 11 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.753225:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 11 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.753242:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20c00/0xb4b2209fbdad25c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed868 expref: 11 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.753276:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.753278:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.753282:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.753289:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.753312:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.753321:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467143296:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147261.753677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.754465:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987328 00000100:00100000:2.0:1746147261.754470:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987328 00000100:00100000:2.0:1746147261.754496:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16193 00000100:00100000:2.0:1746147261.754501:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32199:x1830967465987328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.754513:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.754524:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8f4 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.754541:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.754547:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.754548:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.754551:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.754566:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.754576:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.754585:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467143424:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.754625:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.755672:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.761798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.761955:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987456 00000100:00100000:0.0:1746147261.761965:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987456 00000100:00100000:0.0:1746147261.762008:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16194 00000100:00100000:0.0:1746147261.762016:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32197:x1830967465987456:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147261.762030:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.762043:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed8fb expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.762068:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.762089:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.762096:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.762101:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.762103:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.762106:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [778240->1048575] (req 778240->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.762130:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.762140:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 31 pid: 8478 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.762151:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467143552:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147261.762229:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.762238:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.762247:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467143680:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147261.762270:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147261.762277:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 10 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746147261.762284:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467143808:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147261.762299:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.762381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.762523:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987712 00000100:00100000:2.0:1746147261.762526:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987712 00002000:00100000:2.0:1746147261.762548:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3854336->3858431) req@ffff880134ed4000 x1830967465987712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.762555:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed4000 with x1830967465987712 ext(3854336->3858431) 00010000:00010000:2.0:1746147261.762560:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.762568:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:2.0:1746147261.762577:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed4000 00000100:00100000:2.0:1746147261.762588:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2635 00000100:00100000:2.0:1746147261.762594:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465987712:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147261.762734:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465987712:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 140us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147261.762739:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2635 00002000:00100000:2.0:1746147261.762744:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3854336->3858431) req@ffff880134ed4000 x1830967465987712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.762750:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed4000 with x1830967465987712 ext(3854336->3858431) 00010000:00010000:2.0:1746147261.762754:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.762761:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:2.0:1746147261.762766:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed4000 00000100:00100000:3.0:1746147261.763094:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467143296:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147261.763106:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.763124:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465987200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9937us (14278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.763130:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8277 00000100:00100000:2.0:1746147261.763364:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1956:x1830967465987072:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14201us (14621us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.763369:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7713 00002000:00100000:2.0:1746147261.763373:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880134ed6d80 x1830967465987072/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.763380:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6d80 with x1830967465987072 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.763383:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ed6d80 00000100:00100000:2.0:1746147261.763400:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467143424:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.763412:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.763420:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59c600, rc 0) 00000100:00100000:2.0:1746147261.763431:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32199:x1830967465987328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8930us (9755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.763435:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16193 00000100:00100000:1.0:1746147261.766505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.766541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.767736:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987968 00000100:00100000:3.0:1746147261.767745:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987968 00010000:00010000:3.0:1746147261.767773:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 10 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.767794:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465987840 00000100:00100000:3.0:1746147261.767795:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465987840 00010000:00010000:3.0:1746147261.767802:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 31 pid: 8478 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.767822:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8278 00000100:00100000:3.0:1746147261.767827:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465987968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.767837:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.767851:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 10 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.767860:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 10 pid: 4445 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.767878:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.767911:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967465987968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.767916:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8278 00000100:00100000:3.0:1746147261.767926:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8279 00000100:00100000:3.0:1746147261.767930:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465987840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.767953:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.767958:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 31 pid: 8478 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.767964:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 31 pid: 8478 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.767972:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.767983:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967465987840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.767987:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8279 00000100:00100000:3.0:1746147261.768322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147261.768444:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85ade00/0xb4b2209fbdad2663 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed88b expref: 30 pid: 8478 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.768882:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465988096 00000100:00100000:0.0:1746147261.768885:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465988096 00010000:00010000:0.0:1746147261.768900:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.768913:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8280 00000100:00100000:0.0:1746147261.768917:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465988096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147261.768922:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147261.768930:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.768952:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746147261.768963:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.768964:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147261.768969:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.768975:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147261.768996:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.769005:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467143936:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147261.769052:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.769099:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467143552:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.769112:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130aeb200/0xb4b2209fbdad266a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed899 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.769120:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467143680:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.769128:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f21200/0xb4b2209fbdad25a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed84c expref: 9 pid: 4445 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.769133:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467143808:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.769154:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.769161:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b1c00, rc 0) 00000100:00100000:2.0:1746147261.769176:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32197:x1830967465987456:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7163us (7386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.769182:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16194 00000100:00100000:0.0:1746147261.772612:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.772635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.772660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.772732:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465988224 00000100:00100000:3.0:1746147261.772740:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465988224 00000100:00100000:3.0:1746147261.772772:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465988608 00000100:00100000:3.0:1746147261.772773:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465988608 00000100:00100000:3.0:1746147261.772786:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16195 00000100:00100000:3.0:1746147261.772792:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32200:x1830967465988224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147261.772806:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.772819:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed902 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.772840:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.772841:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.772847:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.772859:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.772867:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbfa00, rc 0) 00000100:00100000:3.0:1746147261.772905:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32200:x1830967465988224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 112us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.772910:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16195 00000100:00100000:3.0:1746147261.772922:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16196 00000100:00100000:3.0:1746147261.772926:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32196:x1830967465988608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.772956:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.772965:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed909 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.772978:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.772983:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.772984:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.772987:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.773025:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465988480 00000100:00100000:1.0:1746147261.773028:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465988480 00002000:00100000:1.0:1746147261.773046:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3854336->4194303) req@ffff880134ed7480 x1830967465988480/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147261.773060:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7480 with x1830967465988480 ext(3854336->4194303) 00010000:00010000:1.0:1746147261.773066:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 14 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.773085:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 14 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746147261.773091:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed7480 00000100:00100000:1.0:1746147261.773104:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2636 00000100:00100000:1.0:1746147261.773108:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465988480:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:3.0:1746147261.773584:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.773593:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 11 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.773603:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144064:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.774693:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.777013:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467143936:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.777034:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.778104:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465988096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9180us (9776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.778115:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8280 00000100:00100000:0.0:1746147261.782986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.785659:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465988992 00000100:00100000:2.0:1746147261.785669:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465988992 00002000:00100000:2.0:1746147261.785706:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134ed6a00 x1830967465988992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.785715:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6a00 with x1830967465988992 ext(1048576->2097151) 00002000:00010000:2.0:1746147261.785720:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed6a00 00000100:00100000:0.0:1746147261.786093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.788108:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465988480:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 14992us (15464us total) trans 17179874144 rc 0/0 00000100:00100000:1.0:1746147261.788117:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2636 00002000:00100000:1.0:1746147261.788126:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3854336->4194303) req@ffff880134ed7480 x1830967465988480/t17179874144(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/448 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147261.788135:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7480 with x1830967465988480 ext(3854336->4194303) 00010000:00010000:1.0:1746147261.788143:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 16 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.788153:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 16 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746147261.788159:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed7480 00000100:00100000:0.0:1746147261.788626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.788961:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465989120 00000100:00100000:2.0:1746147261.788968:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465989120 00002000:00100000:2.0:1746147261.788992:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (778240->782335) req@ffff880134ed5c00 x1830967465989120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.789000:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5c00 with x1830967465989120 ext(778240->782335) 00002000:00010000:2.0:1746147261.789003:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed5c00 00000100:00100000:2.0:1746147261.789019:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7714 00000100:00100000:2.0:1746147261.789024:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465988992:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147261.789929:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465989248 00000100:00100000:2.0:1746147261.789933:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465989248 00010000:00010000:2.0:1746147261.789973:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 12 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746147261.789999:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8281 00000100:00100000:2.0:1746147261.790004:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967465989248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.790011:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.790024:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 12 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.790033:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 12 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746147261.790050:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.790052:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.790057:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.790064:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.790101:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.790111:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467144192:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147261.790149:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.790764:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7715 00000100:00100000:0.0:1746147261.790771:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465989120:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147261.790859:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465989120:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 89us (4767us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147261.790865:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7715 00002000:00100000:0.0:1746147261.790871:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (778240->782335) req@ffff880134ed5c00 x1830967465989120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.790878:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5c00 with x1830967465989120 ext(778240->782335) 00002000:00010000:0.0:1746147261.790882:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed5c00 00010000:00010000:3.0:1746147261.791262:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5da00/0xb4b2209fbdad25c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed86f expref: 12 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.791281:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144064:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.791301:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.791314:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbee00, rc 0) 00000100:00100000:3.0:1746147261.791335:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32196:x1830967465988608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 18408us (18674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.791341:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16196 00000100:00100000:2.0:1746147261.795361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.795409:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465989376 00000100:00100000:1.0:1746147261.795416:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465989376 00010000:00010000:1.0:1746147261.795444:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 17 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.795481:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8282 00000100:00100000:1.0:1746147261.795488:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1959:x1830967465989376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147261.795499:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147261.795516:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 17 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.795526:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 17 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.795545:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf000/0xb4b2209fbdad26e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ed expref: 17 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.795568:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.795570:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.795576:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.795583:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.795609:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147261.795619:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467144320:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147261.795685:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.799719:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467144192:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.799739:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.799774:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967465989248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9768us (11148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.799783:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8281 00000100:00100000:3.0:1746147261.799808:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465988992:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10781us (16826us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.799815:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7714 00002000:00100000:3.0:1746147261.799823:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880134ed6a00 x1830967465988992/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.799833:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6a00 with x1830967465988992 ext(1048576->2097151) 00002000:00010000:3.0:1746147261.799836:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed6a00 00000100:00100000:0.0:1746147261.800475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.800545:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465989632 00000100:00100000:3.0:1746147261.800550:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465989632 00002000:00100000:3.0:1746147261.800574:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3403776->3407871) req@ffff880134ed7800 x1830967465989632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.800581:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7800 with x1830967465989632 ext(3403776->3407871) 00002000:00010000:3.0:1746147261.800583:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ed7800 00000100:00100000:3.0:1746147261.800670:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7716 00000100:00100000:3.0:1746147261.800677:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465989632:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147261.801461:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465989632:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 783us (986us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147261.801467:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7716 00002000:00100000:3.0:1746147261.801472:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3403776->3407871) req@ffff880134ed7800 x1830967465989632/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.801479:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7800 with x1830967465989632 ext(3403776->3407871) 00002000:00010000:3.0:1746147261.801482:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ed7800 00000100:00100000:0.0:1746147261.803168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.803278:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465989760 00000100:00100000:3.0:1746147261.803283:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465989760 00000100:00100000:3.0:1746147261.803308:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16197 00000100:00100000:3.0:1746147261.803313:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:32197:x1830967465989760:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147261.803325:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.803337:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed910 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.803358:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.803365:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.803371:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.803375:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.803377:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.803380:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1048576->1581055] (req 1048576->1581055) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.803402:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 17 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.803411:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 17 pid: 8478 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.803421:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144448:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.803489:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.803497:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.803503:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.803525:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.803532:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.803538:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144704:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147261.803551:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147261.803619:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467144320:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147261.803632:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147261.803650:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967465989376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8162us (8296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.803656:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8282 00000100:00100000:0.0:1746147261.810372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.810411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.810675:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990016 00000100:00100000:2.0:1746147261.810683:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990016 00002000:00100000:2.0:1746147261.810719:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134ed6300 x1830967465990016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.810727:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6300 with x1830967465990016 ext(2097152->3145727) 00002000:00010000:2.0:1746147261.810731:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed6300 00000100:00100000:2.0:1746147261.810747:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7717 00000100:00100000:2.0:1746147261.810753:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465990016:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147261.810916:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990144 00000100:00100000:1.0:1746147261.810920:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990144 00000100:00100000:1.0:1746147261.810963:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16198 00000100:00100000:1.0:1746147261.810968:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32200:x1830967465990144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147261.810976:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.810988:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed917 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.811005:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.811006:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147261.811012:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 15 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.811024:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 15 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.811032:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568a00, rc 0) 00000100:00100000:1.0:1746147261.811068:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32200:x1830967465990144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 99us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.811083:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16198 00000100:00100000:0.0:1746147261.811087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.811102:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990272 00000100:00100000:1.0:1746147261.811105:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990272 00010000:00010000:1.0:1746147261.811118:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 18 pid: 8478 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746147261.811135:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8283 00000100:00100000:0.0:1746147261.811135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.811139:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967465990272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147261.811148:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147261.811162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147261.811163:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 18 pid: 8478 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.811172:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 18 pid: 8478 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746147261.811185:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.811231:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990528 00000100:00100000:3.0:1746147261.811234:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990528 00010000:00010000:3.0:1746147261.811247:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 11 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.811283:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990400 00000100:00100000:3.0:1746147261.811285:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990400 00010000:00010000:3.0:1746147261.811295:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.811306:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8284 00000100:00100000:3.0:1746147261.811310:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465990528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.811316:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.811324:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 11 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.811332:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 11 pid: 6881 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746147261.811347:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.811366:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967465990528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.811371:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8284 00000100:00100000:3.0:1746147261.811381:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8285 00000100:00100000:3.0:1746147261.811385:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967465990400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147261.811390:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147261.811397:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.811407:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.811416:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.811417:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147261.811421:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.811427:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.811449:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.811458:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467144832:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147261.811498:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147261.811524:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130aea200/0xb4b2209fbdad269b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a7 expref: 18 pid: 8478 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.811536:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144448:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.811544:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130aeb800/0xb4b2209fbdad26a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8b5 expref: 12 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746147261.811551:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.811558:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad25ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed853 expref: 10 pid: 6881 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746147261.811565:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467144704:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147261.811585:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147261.811592:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbf600, rc 0) 00000100:00100000:3.0:1746147261.811607:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:32197:x1830967465989760:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8293us (8443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.811612:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16197 00000100:00100000:1.0:1746147261.812242:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465990272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1100us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147261.812248:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8283 00000100:00100000:3.0:1746147261.814262:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467144832:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147261.814930:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147261.815014:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465990400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3626us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147261.815022:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8285 00000100:00100000:0.0:1746147261.820810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.821171:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990784 00000100:00100000:2.0:1746147261.821181:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990784 00002000:00100000:2.0:1746147261.821226:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1576960->1581055) req@ffff88009f669880 x1830967465990784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.821236:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669880 with x1830967465990784 ext(1576960->1581055) 00000100:00100000:3.0:1746147261.821281:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465990016:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10521us (10909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.821291:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7717 00002000:00100000:3.0:1746147261.821299:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134ed6300 x1830967465990016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.821308:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6300 with x1830967465990016 ext(2097152->3145727) 00002000:00010000:3.0:1746147261.821313:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ed6300 00002000:00010000:2.0:1746147261.821344:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669880 00000100:00100000:2.0:1746147261.821367:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7718 00000100:00100000:2.0:1746147261.821374:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465990784:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147261.821550:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967465990784:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 175us (750us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147261.821557:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7718 00002000:00100000:2.0:1746147261.821562:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1576960->1581055) req@ffff88009f669880 x1830967465990784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.821570:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669880 with x1830967465990784 ext(1576960->1581055) 00002000:00010000:2.0:1746147261.821572:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669880 00000100:00100000:0.0:1746147261.836260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.836845:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465990912 00000100:00100000:2.0:1746147261.836855:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465990912 00000100:00100000:0.0:1746147261.836901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.836966:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465991424 00000100:00100000:3.0:1746147261.836971:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465991424 00002000:00100000:3.0:1746147261.837005:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3407872->4194303) req@ffff88009f66bb80 x1830967465991424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147261.837013:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16199 00002000:00100000:3.0:1746147261.837017:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66bb80 with x1830967465991424 ext(3407872->4194303) 00000100:00100000:2.0:1746147261.837021:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+16:32199:x1830967465990912:12345-192.168.203.36@tcp:101:cat.0 00002000:00010000:3.0:1746147261.837023:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66bb80 00010000:00010000:2.0:1746147261.837037:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147261.837039:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7719 00000100:00100000:3.0:1746147261.837045:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967465991424:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147261.837053:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed91e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.837086:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.837094:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.837096:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.837099:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.837131:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.837143:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 11 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.837155:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467144960:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147261.838742:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.839915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.839964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.840002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.840029:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465991680 00000100:00100000:2.0:1746147261.840037:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465991680 00002000:00100000:2.0:1746147261.840089:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8801312a4700 x1830967465991680/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.840099:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4700 with x1830967465991680 ext(2097152->3145727) 00002000:00010000:2.0:1746147261.840103:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4700 00000100:00100000:2.0:1746147261.840121:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465991296 00000100:00100000:2.0:1746147261.840123:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465991296 00002000:00100000:2.0:1746147261.840135:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8801312a5500 x1830967465991296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.840140:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5500 with x1830967465991296 ext(2097152->3145727) 00010000:00010000:2.0:1746147261.840147:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746147261.840151:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465991808 00000100:00100000:0.0:1746147261.840156:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465991808 00010000:00010000:2.0:1746147261.840159:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:2.0:1746147261.840165:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a5500 00002000:00100000:0.0:1746147261.840174:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8801312a6300 x1830967465991808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147261.840177:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2637 00002000:00100000:0.0:1746147261.840182:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6300 with x1830967465991808 ext(3145728->4194303) 00000100:00100000:2.0:1746147261.840183:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465991296:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:0.0:1746147261.840186:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a6300 00000100:00100000:0.0:1746147261.840205:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7720 00000100:00100000:2.0:1746147261.840210:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7721 00000100:00100000:0.0:1746147261.840210:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465991680:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.840214:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465991808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.843518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.844590:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465992064 00000100:00100000:3.0:1746147261.844600:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465992064 00002000:00100000:3.0:1746147261.844642:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3407871) req@ffff88009f668700 x1830967465992064/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.844651:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668700 with x1830967465992064 ext(3145728->3407871) 00010000:00010000:3.0:1746147261.844661:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 15 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.844675:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 15 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.844682:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f668700 00000100:00100000:3.0:1746147261.844704:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2638 00000100:00100000:3.0:1746147261.844712:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465992064:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147261.844859:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467144960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147261.844888:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.844904:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59de00, rc 0) 00000100:00100000:2.0:1746147261.844954:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:32199:x1830967465990912:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7916us (8686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.844962:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16199 00000100:00100000:2.0:1746147261.845326:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465991424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8281us (8426us total) trans 0 rc 786432/786432 00000100:00100000:2.0:1746147261.845333:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7719 00002000:00100000:2.0:1746147261.845340:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3407872->4194303) req@ffff88009f66bb80 x1830967465991424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.845348:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66bb80 with x1830967465991424 ext(3407872->4194303) 00010000:00010000:2.0:1746147261.845354:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 15 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.845366:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 15 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:2.0:1746147261.845371:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f66bb80 00000100:00100000:1.0:1746147261.854048:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967465991680:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13826us (14125us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147261.854062:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7720 00002000:00100000:1.0:1746147261.854088:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8801312a4700 x1830967465991680/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147261.854097:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4700 with x1830967465991680 ext(2097152->3145727) 00002000:00010000:1.0:1746147261.854103:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4700 00000100:00100000:3.0:1746147261.857660:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465992064:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12935us (14141us total) trans 21474841490 rc 0/0 00000100:00100000:3.0:1746147261.857674:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2638 00002000:00100000:3.0:1746147261.857687:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->3407871) req@ffff88009f668700 x1830967465992064/t21474841490(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/448 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.857702:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668700 with x1830967465992064 ext(3145728->3407871) 00010000:00010000:3.0:1746147261.857712:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 15 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.857726:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 15 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.857734:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f668700 00000100:00100000:3.0:1746147261.858667:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465991296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18480us (18699us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.858673:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2637 00002000:00100000:3.0:1746147261.858679:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8801312a5500 x1830967465991296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.858685:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5500 with x1830967465991296 ext(2097152->3145727) 00010000:00010000:3.0:1746147261.858690:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746147261.858699:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 13 pid: 6881 timeout: 748 lvb_type: 0 00002000:00010000:3.0:1746147261.858705:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a5500 00000100:00100000:0.0:1746147261.862934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.863247:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465992192 00000100:00100000:2.0:1746147261.863257:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465992192 00000100:00100000:2.0:1746147261.863317:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16200 00000100:00100000:2.0:1746147261.863325:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32200:x1830967465992192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.863346:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.863365:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed925 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.863393:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147261.863399:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.863411:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.863421:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59d800, rc 0) 00000100:00100000:2.0:1746147261.863469:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32200:x1830967465992192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.863476:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16200 00000100:00100000:3.0:1746147261.864253:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465991808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24036us (24249us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.864262:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7721 00002000:00100000:3.0:1746147261.864271:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8801312a6300 x1830967465991808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.864280:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6300 with x1830967465991808 ext(3145728->4194303) 00002000:00010000:3.0:1746147261.864284:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a6300 00000100:00100000:1.0:1746147261.868839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.869092:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465992320 00000100:00100000:2.0:1746147261.869101:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465992320 00010000:00010000:2.0:1746147261.869133:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 14 pid: 6881 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746147261.869167:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8286 00000100:00100000:2.0:1746147261.869173:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465992320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147261.869186:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147261.869204:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 14 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.869215:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 14 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.869238:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbee00/0xb4b2209fbdad2704 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed909 expref: 14 pid: 6881 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746147261.869252:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.869253:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.869259:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.869265:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.869271:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.869272:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147261.869275:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.869280:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147261.869306:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.869316:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467145088:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.869393:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.869405:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467145216:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147261.869422:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.878011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147261.878106:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465992576 00000100:00100000:3.0:1746147261.878118:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465992576 00002000:00100000:3.0:1746147261.878158:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f66ad80 x1830967465992576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.878168:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66ad80 with x1830967465992576 ext(2097152->3145727) 00002000:00010000:3.0:1746147261.878173:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66ad80 00000100:00100000:3.0:1746147261.878197:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7722 00000100:00100000:3.0:1746147261.878204:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967465992576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.878239:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467145088:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147261.878249:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467145216:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147261.878272:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147261.878311:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967465992320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9138us (9481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147261.878321:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8286 00000100:00100000:0.0:1746147261.878865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.879335:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465992832 00000100:00100000:2.0:1746147261.879341:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465992832 00002000:00100000:2.0:1746147261.879367:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f669500 x1830967465992832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.879376:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669500 with x1830967465992832 ext(3145728->4194303) 00002000:00010000:2.0:1746147261.879381:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669500 00000100:00100000:2.0:1746147261.879400:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7723 00000100:00100000:2.0:1746147261.879406:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465992832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147261.890027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.890064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.890096:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465993216 00000100:00100000:0.0:1746147261.890099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.890102:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465993216 00002000:00100000:2.0:1746147261.890132:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009f66aa00 x1830967465993216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.890139:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66aa00 with x1830967465993216 ext(3145728->4194303) 00002000:00010000:2.0:1746147261.890143:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66aa00 00000100:00100000:1.0:1746147261.890374:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465993472 00000100:00100000:2.0:1746147261.890375:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465993344 00000100:00100000:1.0:1746147261.890378:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465993472 00000100:00100000:2.0:1746147261.890379:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465993344 00000100:00100000:3.0:1746147261.890384:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7724 00002000:00100000:1.0:1746147261.890391:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f66a680 x1830967465993472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147261.890392:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465993216:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:2.0:1746147261.890392:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f668a80 x1830967465993344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147261.890397:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66a680 with x1830967465993472 ext(3145728->4194303) 00002000:00100000:2.0:1746147261.890398:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668a80 with x1830967465993344 ext(2097152->3145727) 00002000:00010000:1.0:1746147261.890399:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66a680 00002000:00010000:2.0:1746147261.890400:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f668a80 00000100:00100000:1.0:1746147261.890586:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7725 00000100:00100000:1.0:1746147261.890592:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967465993472:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147261.890596:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7726 00000100:00100000:2.0:1746147261.890603:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967465993344:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147261.890673:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465992576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12469us (12672us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.890680:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7722 00002000:00100000:3.0:1746147261.890686:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f66ad80 x1830967465992576/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.890693:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66ad80 with x1830967465992576 ext(2097152->3145727) 00002000:00010000:3.0:1746147261.890697:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66ad80 00000100:00100000:3.0:1746147261.893137:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465992832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13721us (14262us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147261.893151:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7723 00002000:00100000:3.0:1746147261.893160:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f669500 x1830967465992832/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147261.893168:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669500 with x1830967465992832 ext(3145728->4194303) 00002000:00010000:3.0:1746147261.893173:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669500 00000100:00100000:2.0:1746147261.900410:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967465993344:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9799us (10301us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147261.900420:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7726 00002000:00100000:2.0:1746147261.900431:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009f668a80 x1830967465993344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.900440:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668a80 with x1830967465993344 ext(2097152->3145727) 00002000:00010000:2.0:1746147261.900445:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f668a80 00000100:00100000:0.0:1746147261.905005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.905035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.905063:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465993728 00000100:00100000:2.0:1746147261.905071:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465993728 00000100:00100000:2.0:1746147261.905115:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465993856 00000100:00100000:2.0:1746147261.905117:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465993856 00000100:00100000:2.0:1746147261.905131:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16201 00000100:00100000:2.0:1746147261.905137:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465993728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.905150:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.905162:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d59d200/0xb4b2209fbdad2727 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed92c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.905200:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467145344:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147261.905259:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147261.905273:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16202 00000100:00100000:2.0:1746147261.905282:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465993856:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.905289:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147261.905297:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad272e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed933 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.905316:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467145472:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147261.905331:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147261.905444:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967465993216:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 15052us (15423us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147261.905452:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7724 00002000:00100000:0.0:1746147261.905460:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009f66aa00 x1830967465993216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.905472:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66aa00 with x1830967465993216 ext(3145728->4194303) 00002000:00010000:0.0:1746147261.905476:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66aa00 00000100:00100000:2.0:1746147261.910855:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467145344:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147261.910891:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d59d200/0xb4b2209fbdad2727 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed92c expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.910903:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d59d200/0xb4b2209fbdad2727 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed92c expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.910921:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59d200, rc 0) 00000100:00100000:2.0:1746147261.910968:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967465993728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5830us (5968us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147261.910975:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16201 00000100:00100000:0.0:1746147261.911667:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967465993472:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 21074us (21601us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147261.911674:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7725 00002000:00100000:0.0:1746147261.911681:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009f66a680 x1830967465993472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147261.911688:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66a680 with x1830967465993472 ext(3145728->4194303) 00002000:00010000:0.0:1746147261.911691:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66a680 00000100:00100000:3.0:1746147261.911975:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467145472:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147261.911993:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad272e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed933 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.912002:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdad272e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed933 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.912022:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5c200, rc 0) 00000100:00100000:3.0:1746147261.912042:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967465993856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6763us (7005us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147261.912046:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16202 00000100:00100000:0.0:1746147261.919635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.919683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.919854:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465994112 00000100:00100000:2.0:1746147261.919862:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465994112 00002000:00100000:2.0:1746147261.919895:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880132e11880 x1830967465994112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.919904:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11880 with x1830967465994112 ext(4194304->4976639) 00002000:00010000:2.0:1746147261.919908:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e11880 00000100:00100000:2.0:1746147261.920055:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465994368 00000100:00100000:2.0:1746147261.920057:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465994368 00002000:00100000:2.0:1746147261.920068:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880132e13480 x1830967465994368/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/0 e 0 to 0 dl 1746147272 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.920088:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13480 with x1830967465994368 ext(4194304->4976639) 00002000:00010000:2.0:1746147261.920091:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13480 00000100:00100000:1.0:1746147261.920173:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7727 00000100:00100000:1.0:1746147261.920180:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465994112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.920687:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7728 00000100:00100000:2.0:1746147261.920693:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465994368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147261.931456:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465994368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10755us (11763us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147261.931466:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7728 00002000:00100000:2.0:1746147261.931477:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880132e13480 x1830967465994368/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.931485:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13480 with x1830967465994368 ext(4194304->4976639) 00002000:00010000:2.0:1746147261.931491:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13480 00000100:00100000:2.0:1746147261.935051:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465994112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14865us (15417us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147261.935061:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7727 00002000:00100000:2.0:1746147261.935070:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff880132e11880 x1830967465994112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:637/0 lens 488/440 e 0 to 0 dl 1746147272 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147261.935087:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11880 with x1830967465994112 ext(4194304->4976639) 00002000:00010000:2.0:1746147261.935093:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e11880 00000100:00100000:0.0:1746147261.935340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.935432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.935454:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465994496 00000100:00100000:0.0:1746147261.935460:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465994496 00000100:00100000:0.0:1746147261.935482:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465994624 00000100:00100000:0.0:1746147261.935483:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465994624 00000100:00100000:0.0:1746147261.937185:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16203 00000100:00100000:0.0:1746147261.937198:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465994496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147261.937214:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147261.937229:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31ce00/0xb4b2209fbdad2735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed93a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147261.937272:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467145600:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147261.937426:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16204 00000100:00100000:3.0:1746147261.937434:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465994624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147261.937442:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147261.937451:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537ea00/0xb4b2209fbdad273c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed941 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147261.937473:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467145728:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147261.938092:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147261.938312:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147261.940886:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467145728:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147261.940891:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467145600:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147261.940912:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537ea00/0xb4b2209fbdad273c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed941 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.940912:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31ce00/0xb4b2209fbdad2735 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed93a expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.940924:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537ea00/0xb4b2209fbdad273c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed941 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.940924:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31ce00/0xb4b2209fbdad2735 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed93a expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147261.940957:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537ea00, rc 0) 00010000:00010000:1.0:1746147261.940958:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31ce00, rc 0) 00000100:00100000:3.0:1746147261.940990:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967465994624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3557us (5557us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147261.940990:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465994496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3797us (5652us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147261.940997:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16203 00000100:00100000:3.0:1746147261.941005:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16204 00000100:00100000:2.0:1746147261.947271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.947389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147261.947426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147261.947471:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465995008 00000100:00100000:0.0:1746147261.947478:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465995008 00000100:00100000:0.0:1746147261.947518:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4863 00000100:00100000:0.0:1746147261.947524:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32199:x1830967465995008:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147261.947672:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465994752 00000100:00100000:1.0:1746147261.947676:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465994752 00000100:00100000:1.0:1746147261.947696:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465995136 00000100:00100000:1.0:1746147261.947699:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465995136 00000100:00100000:2.0:1746147261.947709:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16205 00000100:00100000:2.0:1746147261.947717:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465994752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.947726:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147261.947728:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16206 00000100:00100000:1.0:1746147261.947735:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465995136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147261.947739:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad2743 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed948 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147261.947742:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147261.947752:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d42a00/0xb4b2209fbdad274a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed94f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147261.947778:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467145856:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147261.947778:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467145984:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147261.947835:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147261.947990:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32199:x1830967465995008:12345-192.168.203.36@tcp:35:cat.0 Request processed in 465us (726us total) trans 8589945602 rc 0/0 00000100:00100000:1.0:1746147261.947996:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4863 00000100:00100000:2.0:1746147261.948046:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147261.949035:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467145984:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147261.949053:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d42a00/0xb4b2209fbdad274a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed94f expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.949064:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d42a00/0xb4b2209fbdad274a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed94f expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147261.949090:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d42a00, rc 0) 00000100:00100000:1.0:1746147261.949119:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1958:x1830967465995136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1385us (1693us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147261.949125:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16206 00000100:00100000:2.0:1746147261.950633:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467145856:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147261.950666:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad2743 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed948 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.950677:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094422800/0xb4b2209fbdad2743 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed948 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147261.950695:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422800, rc 0) 00000100:00100000:2.0:1746147261.950836:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967465994752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3019us (3345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147261.950845:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16205 00000100:00100000:0.0:1746147261.953759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147261.954104:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465995392 00000100:00100000:1.0:1746147261.954112:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465995392 00000100:00100000:1.0:1746147261.954160:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4864 00000100:00100000:1.0:1746147261.954167:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32200:x1830967465995392:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147261.954356:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32200:x1830967465995392:12345-192.168.203.36@tcp:35:cat.0 Request processed in 189us (602us total) trans 8589945603 rc 0/0 00000100:00100000:1.0:1746147261.954363:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4864 00010000:00010000:3.0:1746147262.019364:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147262.024989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.025578:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465995648 00000100:00100000:2.0:1746147262.025593:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465995648 00000100:00080000:0.0:1746147262.025654:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147262.025669:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11577 00000100:00100000:2.0:1746147262.025678:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32206:x1830967465995648:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.025697:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.025711:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed956 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.026010:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026022:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026030:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026040:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026046:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026051:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026144:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026151:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026156:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147262.026163:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147262.026227:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026233:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026240:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026245:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.026248:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026254:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026263:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.026266:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.026268:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026273:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad2758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026301:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026305:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026309:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026314:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.026316:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026320:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026329:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76d00) 00010000:00010000:2.0:1746147262.026331:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.026333:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026337:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423c00/0xb4b2209fbdad275f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.026366:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 13 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.026376:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.026382:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.026384:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147262.026386:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422c00, rc 0) 00000100:00100000:2.0:1746147262.026439:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32206:x1830967465995648:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 763us (1503us total) trans 8589945604 rc 0/0 00000100:00100000:2.0:1746147262.026445:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11577 00000100:00100000:0.0:1746147262.027911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.028060:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465995904 00000100:00100000:2.0:1746147262.028069:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465995904 00000100:00100000:2.0:1746147262.028113:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4865 00000100:00100000:2.0:1746147262.028119:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32206:x1830967465995904:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147262.028261:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32206:x1830967465995904:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 141us (357us total) trans 8589945605 rc 0/0 00000100:00100000:2.0:1746147262.028267:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4865 00000100:00100000:2.0:1746147262.048081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.048085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.048132:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465996160 00000100:00100000:2.0:1746147262.048140:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465996160 00000100:00100000:3.0:1746147262.048173:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465996288 00000100:00100000:3.0:1746147262.048183:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465996288 00000100:00080000:0.0:1746147262.048185:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147262.048194:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11578 00000100:00100000:2.0:1746147262.048200:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32208:x1830967465996160:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.048221:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.048236:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad2774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed95d expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.048252:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16207 00000100:00100000:3.0:1746147262.048260:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32206:x1830967465996288:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.048275:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.048289:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed964 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.048333:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048343:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048351:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048359:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048362:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048365:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.048401:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.048410:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.048415:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.048418:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.048421:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3166208->3530751] (req 3166208->3530751) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.048445:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.048447:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048453:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.048456:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.048456:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147262.048463:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:3.0:1746147262.048466:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.048531:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048535:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048539:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048542:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.048545:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048549:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048555:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.048557:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.048559:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048562:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad2782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048572:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048574:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048577:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048583:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094422600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.048584:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048587:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048590:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76f00) 00010000:00010000:2.0:1746147262.048591:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.048592:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048594:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad2789 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.048619:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad2774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.048626:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.048629:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.048630:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147262.048631:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423e00, rc 0) 00000100:00100000:2.0:1746147262.048668:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32208:x1830967465996160:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 469us (605us total) trans 8589945606 rc 0/0 00000100:00100000:2.0:1746147262.048673:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11578 00010000:00010000:3.0:1746147262.049291:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.049301:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 28 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.049309:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146240:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.049351:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.051414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.051490:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465996544 00000100:00100000:1.0:1746147262.051500:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465996544 00000100:00100000:1.0:1746147262.051544:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4866 00000100:00100000:1.0:1746147262.051551:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32208:x1830967465996544:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147262.051748:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32208:x1830967465996544:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 192us (335us total) trans 8589945607 rc 0/0 00000100:00100000:1.0:1746147262.051754:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4866 00000100:00100000:3.0:1746147262.052259:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.052270:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146240:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.052298:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3166208->3530751] (req 3166208->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.052313:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537f000, rc 0) 00000100:00100000:3.0:1746147262.052355:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32206:x1830967465996288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4095us (4286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.052361:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16207 00000100:00100000:0.0:1746147262.056324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.056534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.057043:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465996672 00000100:00100000:2.0:1746147262.057050:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465996672 00010000:00010000:2.0:1746147262.057094:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 29 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.057115:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465996800 00000100:00100000:2.0:1746147262.057118:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465996800 00010000:00010000:2.0:1746147262.057127:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.057152:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8287 00000100:00100000:2.0:1746147262.057158:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465996672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.057168:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.057185:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 29 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.057194:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 29 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.057212:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d59c600/0xb4b2209fbdad26ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8f4 expref: 29 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.057223:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.057254:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967465996672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.057260:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8287 00000100:00100000:2.0:1746147262.057272:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8288 00000100:00100000:2.0:1746147262.057277:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967465996800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.057282:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.057288:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.057296:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.057306:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f568a00/0xb4b2209fbdad2712 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed917 expref: 16 pid: 4444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.057313:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.057315:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.057320:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.057328:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.057351:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.057361:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467146368:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.057397:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00080000:0.0:1746147262.057667:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147262.060048:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467146368:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.060086:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.060137:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465996800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2853us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.060148:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8288 00000100:00100000:0.0:1746147262.063800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.065125:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465997056 00000100:00100000:2.0:1746147262.065138:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465997056 00002000:00100000:2.0:1746147262.065193:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3166208->3170303) req@ffff880132e12680 x1830967465997056/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.065203:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967465997056 ext(3166208->3170303) 00002000:00010000:2.0:1746147262.065209:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:2.0:1746147262.065245:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7729 00000100:00100000:2.0:1746147262.065253:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465997056:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.065453:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967465997056:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 200us (1661us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147262.065461:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7729 00002000:00100000:2.0:1746147262.065466:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3166208->3170303) req@ffff880132e12680 x1830967465997056/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.065473:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967465997056 ext(3166208->3170303) 00002000:00010000:2.0:1746147262.065476:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147262.072629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.073095:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465997312 00000100:00100000:2.0:1746147262.073106:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465997312 00002000:00100000:2.0:1746147262.073157:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3526656->3530751) req@ffff880132e10380 x1830967465997312/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.073167:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10380 with x1830967465997312 ext(3526656->3530751) 00002000:00010000:2.0:1746147262.073172:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e10380 00000100:00100000:2.0:1746147262.073208:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7730 00000100:00100000:2.0:1746147262.073216:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465997312:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.073423:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465997312:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 207us (803us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147262.073431:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7730 00002000:00100000:2.0:1746147262.073437:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3526656->3530751) req@ffff880132e10380 x1830967465997312/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.073444:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10380 with x1830967465997312 ext(3526656->3530751) 00002000:00010000:2.0:1746147262.073447:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e10380 00000100:00100000:0.0:1746147262.088042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.089450:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465997568 00000100:00100000:2.0:1746147262.089462:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465997568 00000100:00100000:2.0:1746147262.089526:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11579 00000100:00100000:2.0:1746147262.089534:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32211:x1830967465997568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.089559:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.089576:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad279e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed96b expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.089684:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089696:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089706:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089718:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089724:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089729:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089827:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad27b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089835:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad27b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089841:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad27b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147262.089849:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147262.089923:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089929:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089974:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089981:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094422200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.089984:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.089990:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090000:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.090003:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.090007:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090012:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422200/0xb4b2209fbdad27a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090030:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090035:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090040:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090044:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.090046:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090050:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090055:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76600) 00010000:00010000:2.0:1746147262.090057:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.090059:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090064:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423200/0xb4b2209fbdad27ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.090107:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422a00/0xb4b2209fbdad279e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed96b expref: 309 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.090116:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad27b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed96b expref: 308 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.090122:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.090125:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147262.090127:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423400, rc 0) 00000100:00100000:2.0:1746147262.090189:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32211:x1830967465997568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 656us (2157us total) trans 8589945608 rc 0/0 00000100:00100000:2.0:1746147262.090196:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11579 00000100:00100000:0.0:1746147262.098490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.099140:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.100105:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465997824 00000100:00100000:3.0:1746147262.100115:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465997824 00000100:00100000:3.0:1746147262.100158:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16208 00000100:00100000:3.0:1746147262.100165:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465997824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.100184:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.100202:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537ea00/0xb4b2209fbdad27c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed972 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.100258:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146496:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147262.100361:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.100418:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465997696 00000100:00100000:2.0:1746147262.100422:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465997696 00000100:00100000:2.0:1746147262.100454:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 794 00000100:00100000:2.0:1746147262.100459:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1958:x1830967465997696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.100469:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.100489:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423400/0xb4b2209fbdad27b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed96b expref: 308 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.100507:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.100511:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.100534:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1958:x1830967465997696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 75us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.100541:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 794 00000100:00100000:3.0:1746147262.102223:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146496:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147262.102257:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537ea00/0xb4b2209fbdad27c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed972 expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.102270:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537ea00/0xb4b2209fbdad27c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed972 expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.103407:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537ea00, rc 0) 00000100:00100000:3.0:1746147262.103466:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967465997824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3299us (4329us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147262.103476:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16208 00000100:00100000:0.0:1746147262.113676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.113715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.113740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.113773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.113783:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465998208 00000100:00100000:3.0:1746147262.113794:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465998208 00000100:00100000:0.0:1746147262.113807:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465998336 00000100:00100000:0.0:1746147262.113811:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465998336 00002000:00100000:3.0:1746147262.113842:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->778239) req@ffff880094d7b800 x1830967465998208/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.113852:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1581056->2097151) req@ffff880094d79880 x1830967465998336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.113853:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b800 with x1830967465998208 ext(0->778239) 00002000:00010000:3.0:1746147262.113859:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7b800 00002000:00100000:0.0:1746147262.113860:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79880 with x1830967465998336 ext(1581056->2097151) 00002000:00010000:0.0:1746147262.113863:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d79880 00000100:00100000:3.0:1746147262.113877:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465998592 00000100:00100000:3.0:1746147262.113879:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465998592 00002000:00100000:3.0:1746147262.113888:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880094d7b480 x1830967465998592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.113895:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b480 with x1830967465998592 ext(1048576->2097151) 00002000:00010000:3.0:1746147262.113898:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7b480 00000100:00080000:1.0:1746147262.113916:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147262.113973:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465998848 00000100:00100000:0.0:1746147262.113977:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465998848 00002000:00100000:0.0:1746147262.113990:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880094d78380 x1830967465998848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.113997:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78380 with x1830967465998848 ext(1048576->2097151) 00002000:00010000:0.0:1746147262.114000:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d78380 00000100:00100000:0.0:1746147262.114012:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7731 00000100:00100000:0.0:1746147262.114018:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967465998208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.114023:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7732 00000100:00100000:2.0:1746147262.114030:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967465998336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.114053:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7733 00000100:00100000:3.0:1746147262.114059:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967465998592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147262.114445:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7734 00000100:00100000:0.0:1746147262.114452:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465998848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147262.118389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.122588:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465998976 00000100:00100000:3.0:1746147262.122603:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465998976 00000100:00100000:3.0:1746147262.122650:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16209 00000100:00100000:3.0:1746147262.122659:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:32208:x1830967465998976:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.122676:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.122693:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed979 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.122723:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.122732:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.122739:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.122746:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.122748:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.122751:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1576960->2097151] (req 1576960->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.122782:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.122794:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 32 pid: 8478 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.122807:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967465998848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8352us (9029us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.122808:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146624:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.122817:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7734 00002000:00100000:1.0:1746147262.122828:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff880094d78380 x1830967465998848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.122837:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d78380 with x1830967465998848 ext(1048576->2097151) 00010000:00010000:1.0:1746147262.122843:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 32 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.122854:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 32 pid: 8478 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.122859:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d78380 00010000:00010000:3.0:1746147262.122868:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.122876:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.122883:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146752:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.122908:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.122915:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 8 pid: 17548 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.122928:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146880:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.123000:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.124443:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967465998208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10418us (10771us total) trans 0 rc 778240/778240 00000100:00100000:3.0:1746147262.124453:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7731 00002000:00100000:3.0:1746147262.124461:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->778239) req@ffff880094d7b800 x1830967465998208/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.124470:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b800 with x1830967465998208 ext(0->778239) 00002000:00010000:3.0:1746147262.124475:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7b800 00000100:00100000:2.0:1746147262.126185:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146624:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.126199:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146752:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.126207:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467146880:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.126242:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [1576960->2097151] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.126265:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537e000, rc 0) 00000100:00100000:2.0:1746147262.126323:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32208:x1830967465998976:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3664us (7943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.126331:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16209 00000100:00100000:3.0:1746147262.126404:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967465998336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12373us (12686us total) trans 0 rc 516096/516096 00000100:00100000:3.0:1746147262.126413:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7732 00002000:00100000:3.0:1746147262.126423:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1581056->2097151) req@ffff880094d79880 x1830967465998336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 516096/516096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.126432:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d79880 with x1830967465998336 ext(1581056->2097151) 00002000:00010000:3.0:1746147262.126437:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d79880 00000100:00100000:0.0:1746147262.127238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.127283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.128058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.128375:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465999104 00000100:00100000:1.0:1746147262.128385:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465999104 00010000:00010000:1.0:1746147262.128443:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 9 pid: 17548 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.128490:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465999232 00000100:00100000:1.0:1746147262.128494:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465999232 00010000:00010000:1.0:1746147262.128510:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 15 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.128529:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8289 00000100:00100000:1.0:1746147262.128536:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967465999104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.128551:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.128574:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 9 pid: 17548 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.128585:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 9 pid: 17548 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.128609:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8e00/0xb4b2209fbdad25bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed861 expref: 9 pid: 17548 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.128637:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.128679:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967465999104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 143us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.128685:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8289 00000100:00100000:1.0:1746147262.128703:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8290 00000100:00100000:1.0:1746147262.128708:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967465999232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.128717:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147262.129151:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465999360 00000100:00100000:3.0:1746147262.129156:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465999360 00010000:00010000:3.0:1746147262.129171:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 29 pid: 8478 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.129191:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8291 00000100:00100000:3.0:1746147262.129197:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967465999360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.129204:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.129213:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 29 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.129221:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 29 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.129234:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423600/0xb4b2209fbdad26c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d1 expref: 29 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.129253:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.129287:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967465999360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.129294:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8291 00010000:00010000:1.0:1746147262.129351:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 15 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.129360:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 15 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.129377:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbfa00/0xb4b2209fbdad26fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed902 expref: 15 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.129386:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.129389:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.129396:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.129404:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.129436:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147262.129450:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467147008:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147262.129500:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00080000:1.0:1746147262.129512:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147262.129923:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967465998592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15862us (16180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.129932:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7733 00002000:00100000:2.0:1746147262.129959:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff880094d7b480 x1830967465998592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.129968:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7b480 with x1830967465998592 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.129973:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7b480 00000100:00100000:1.0:1746147262.133011:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467147008:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147262.133035:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.133097:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967465999232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4388us (5813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.133111:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8290 00000100:00100000:0.0:1746147262.133437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.133483:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465999616 00000100:00100000:2.0:1746147262.133491:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465999616 00002000:00100000:2.0:1746147262.133533:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1576960->1581055) req@ffff880134f85880 x1830967465999616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.133542:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85880 with x1830967465999616 ext(1576960->1581055) 00002000:00010000:2.0:1746147262.133546:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f85880 00000100:00100000:2.0:1746147262.133817:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7735 00000100:00100000:2.0:1746147262.133824:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465999616:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.134024:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967465999616:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 199us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147262.134030:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7735 00002000:00100000:2.0:1746147262.134035:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1576960->1581055) req@ffff880134f85880 x1830967465999616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.134043:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f85880 with x1830967465999616 ext(1576960->1581055) 00002000:00010000:2.0:1746147262.134046:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f85880 00000100:00100000:0.0:1746147262.140540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.140625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.140648:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967465999872 00000100:00100000:3.0:1746147262.140706:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466000000 00000100:00100000:3.0:1746147262.140710:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466000000 00000100:00100000:3.0:1746147262.140765:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16210 00000100:00100000:3.0:1746147262.140773:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32208:x1830967466000000:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.140793:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.140812:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed980 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.140841:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.140848:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.140850:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.140853:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->2166783] (req 2097152->2166783) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.140886:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.140898:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 13 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.140910:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467147136:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.141036:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.141098:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967465999872 00002000:00100000:2.0:1746147262.141129:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1576959) req@ffff880134f84a80 x1830967465999872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.141137:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84a80 with x1830967465999872 ext(1048576->1576959) 00002000:00010000:2.0:1746147262.141142:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84a80 00000100:00100000:2.0:1746147262.141154:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7736 00000100:00100000:2.0:1746147262.141159:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967465999872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147262.143684:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467147136:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.143713:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->2166783] (req 2097152->2166783) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.143727:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5da00, rc 0) 00000100:00100000:3.0:1746147262.143773:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:32208:x1830967466000000:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3000us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.143790:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16210 00000100:00100000:0.0:1746147262.145162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.145422:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466000128 00000100:00100000:3.0:1746147262.145430:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466000128 00002000:00100000:3.0:1746147262.145462:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3166208->3530751) req@ffff88009b6b9880 x1830967466000128/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.145471:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967466000128 ext(3166208->3530751) 00010000:00010000:3.0:1746147262.145478:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 14 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.145494:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 14 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.145501:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b9880 00000100:00100000:2.0:1746147262.145505:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967465999872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 4342us (4969us total) trans 0 rc 528384/528384 00000100:00100000:2.0:1746147262.145515:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7736 00002000:00100000:2.0:1746147262.145525:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1576959) req@ffff880134f84a80 x1830967465999872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 528384/528384 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147262.145526:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2639 00000100:00100000:3.0:1746147262.145533:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967466000128:12345-192.168.203.36@tcp:4:multiop.0 00002000:00100000:2.0:1746147262.145534:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84a80 with x1830967465999872 ext(1048576->1576959) 00002000:00010000:2.0:1746147262.145539:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84a80 00000100:00100000:2.0:1746147262.149183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.149392:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466000256 00000100:00100000:3.0:1746147262.149402:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466000256 00000100:00100000:3.0:1746147262.149456:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16211 00000100:00100000:3.0:1746147262.149463:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32211:x1830967466000256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.149477:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.149490:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed987 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.149511:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.149515:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->2166783] (req 2097152->2166783) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.149520:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147262.149523:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.149550:0:8481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->2166783] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.149562:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.149569:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537ee00, rc 0) 00000100:00100000:3.0:1746147262.149606:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32211:x1830967466000256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.149610:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16211 00000100:00100000:3.0:1746147262.152236:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967466000128:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 6694us (7070us total) trans 17179874145 rc 0/0 00000100:00100000:3.0:1746147262.152250:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2639 00002000:00100000:3.0:1746147262.152262:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3166208->3530751) req@ffff88009b6b9880 x1830967466000128/t17179874145(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.152271:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967466000128 ext(3166208->3530751) 00010000:00010000:3.0:1746147262.152281:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.152297:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.152303:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b9880 00000100:00100000:0.0:1746147262.153769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.153858:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466000384 00000100:00100000:1.0:1746147262.153868:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466000384 00010000:00010000:1.0:1746147262.153903:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.153983:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8292 00000100:00100000:1.0:1746147262.153991:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967466000384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.154003:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.154020:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.154030:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.154046:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdad277b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3166208->3530751) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed964 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.154079:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.154081:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.154087:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.154094:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.154123:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.154133:0:7119:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 29 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.154143:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467147392:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147262.154214:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147262.157436:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467147392:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147262.157455:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.157498:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967466000384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3507us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.157507:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8292 00000100:00100000:0.0:1746147262.158089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.158154:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466000640 00000100:00100000:3.0:1746147262.158160:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466000640 00002000:00100000:3.0:1746147262.158189:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2162688->2166783) req@ffff88009b6b8e00 x1830967466000640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.158203:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8e00 with x1830967466000640 ext(2162688->2166783) 00010000:00010000:3.0:1746147262.158209:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.158220:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.158226:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b8e00 00000100:00100000:3.0:1746147262.158240:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2640 00000100:00100000:3.0:1746147262.158246:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967466000640:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.159388:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967466000640:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1139us (1297us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147262.159395:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2640 00002000:00100000:3.0:1746147262.159401:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2162688->2166783) req@ffff88009b6b8e00 x1830967466000640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.159408:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8e00 with x1830967466000640 ext(2162688->2166783) 00010000:00010000:3.0:1746147262.159413:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.159515:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.159521:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b8e00 00000100:00100000:1.0:1746147262.163230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.163610:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466000896 00000100:00100000:3.0:1746147262.163620:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466000896 00002000:00100000:3.0:1746147262.163661:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2166783) req@ffff8800b52e1880 x1830967466000896/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.163672:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967466000896 ext(2097152->2166783) 00010000:00010000:3.0:1746147262.163685:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.163699:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.163706:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e1880 00000100:00100000:3.0:1746147262.163735:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2641 00000100:00100000:3.0:1746147262.163742:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967466000896:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147262.165583:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967466000896:12345-192.168.203.36@tcp:4:cat.0 Request processed in 1836us (2360us total) trans 17179874146 rc 0/0 00000100:00100000:3.0:1746147262.165593:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2641 00002000:00100000:3.0:1746147262.165601:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2166783) req@ffff8800b52e1880 x1830967466000896/t17179874146(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.165609:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967466000896 ext(2097152->2166783) 00010000:00010000:3.0:1746147262.165617:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.165629:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.165635:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e1880 00000100:00100000:0.0:1746147262.167270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.167329:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466001024 00000100:00100000:1.0:1746147262.167339:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466001024 00010000:00010000:1.0:1746147262.167366:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.167394:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8293 00000100:00100000:1.0:1746147262.167401:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967466001024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.167414:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.167433:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.167449:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.167472:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdad27cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed980 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.167623:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.167625:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.167634:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.167642:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.167679:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147262.167692:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467147520:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147262.167771:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.170413:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467147520:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.170437:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.170478:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967466001024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3076us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.170488:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8293 00000100:00100000:0.0:1746147262.174810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.174899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.175004:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466001280 00000100:00100000:3.0:1746147262.175014:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466001280 00002000:00100000:3.0:1746147262.175060:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c55180 x1830967466001280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.175070:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55180 with x1830967466001280 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.175089:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55180 00000100:00100000:3.0:1746147262.175270:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7737 00000100:00100000:3.0:1746147262.175279:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967466001280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147262.176031:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466001536 00000100:00100000:1.0:1746147262.176037:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466001536 00002000:00100000:1.0:1746147262.176056:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c55c00 x1830967466001536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.176065:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55c00 with x1830967466001536 ext(3145728->4194303) 00002000:00010000:1.0:1746147262.176068:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55c00 00000100:00100000:1.0:1746147262.176100:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7738 00000100:00100000:1.0:1746147262.176106:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967466001536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147262.181870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.181966:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466001792 00000100:00100000:2.0:1746147262.181977:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466001792 00000100:00100000:2.0:1746147262.183065:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11580 00000100:00100000:2.0:1746147262.183085:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32216:x1830967466001792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.183113:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.183134:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad27dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed98e expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.183255:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183268:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183285:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183297:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183303:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183308:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183409:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad27f2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183418:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad27f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183423:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad27f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147262.183433:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147262.183512:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183518:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183524:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183529:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.183533:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183539:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183548:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.183550:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.183554:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.183558:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423600/0xb4b2209fbdad27e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147262.184542:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967466001536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8432us (9638us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147262.184553:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7738 00002000:00100000:1.0:1746147262.184563:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134c55c00 x1830967466001536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.184573:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55c00 with x1830967466001536 ext(3145728->4194303) 00002000:00010000:1.0:1746147262.184578:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55c00 00010000:00010000:2.0:1746147262.184670:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.184676:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.184681:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.184690:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.184693:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.184699:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.184707:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76d00) 00010000:00010000:2.0:1746147262.184709:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.184712:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.184716:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423000/0xb4b2209fbdad27eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.188245:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422800/0xb4b2209fbdad27dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed98e expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.188274:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad27f2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed98e expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.188282:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.188285:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147262.188288:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422600, rc 0) 00000100:00100000:2.0:1746147262.188354:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32216:x1830967466001792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5281us (6496us total) trans 8589945609 rc 0/0 00000100:00100000:2.0:1746147262.188363:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11580 00000100:00100000:3.0:1746147262.190477:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967466001280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15190us (15669us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.190488:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7737 00002000:00100000:3.0:1746147262.190497:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880134c55180 x1830967466001280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.190506:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55180 with x1830967466001280 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.190511:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55180 00000100:00100000:0.0:1746147262.191662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.191697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.191721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.191754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.191761:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466001920 00000100:00100000:2.0:1746147262.191770:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466001920 00000100:00100000:2.0:1746147262.191807:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002176 00000100:00100000:2.0:1746147262.191809:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002176 00000100:00100000:2.0:1746147262.191818:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002048 00000100:00100000:2.0:1746147262.191819:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002048 00000100:00100000:2.0:1746147262.191829:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002304 00000100:00100000:2.0:1746147262.191831:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002304 00000100:00100000:1.0:1746147262.191840:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16212 00000100:00100000:1.0:1746147262.191849:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466001920:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.191869:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147262.191870:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16213 00000100:00100000:2.0:1746147262.191876:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466002176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.191883:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.191885:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2800 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed995 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.191891:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad2807 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9a3 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.191953:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467147648:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147262.191953:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467147776:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147262.191990:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16214 00000100:00100000:1.0:1746147262.192010:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16215 00000100:00100000:1.0:1746147262.192016:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466002304:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147262.192018:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466002048:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147262.192019:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0403c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147262.192021:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.192028:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9aa expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.192036:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.192041:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.192043:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.192052:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdad2815 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed99c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.192052:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.192067:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.192091:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1ba00, rc 0) 00000100:00100000:3.0:1746147262.192111:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467147904:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147262.192114:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967466002304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 98us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.192120:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16215 00000100:00100000:1.0:1746147262.192139:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.192182:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.192386:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.192473:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002432 00000100:00100000:3.0:1746147262.192477:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002432 00000100:00100000:3.0:1746147262.192514:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 795 00000100:00100000:3.0:1746147262.192519:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967466002432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.192529:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.192546:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422600/0xb4b2209fbdad27f2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed98e expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.192570:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.192574:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.192593:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967466002432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.192598:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 795 00000100:00100000:2.0:1746147262.194009:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467147648:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147262.194037:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad2807 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9a3 expref: 19 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.194048:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423c00/0xb4b2209fbdad2807 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9a3 expref: 19 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.194061:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423c00, rc 0) 00000100:00100000:2.0:1746147262.194104:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466002176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2226us (2405us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147262.194110:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16213 00000100:00100000:1.0:1746147262.194202:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467147776:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147262.194203:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467147904:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147262.194220:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2800 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed995 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.194222:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdad2815 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed99c expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.194230:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2800 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed995 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.194231:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdad2815 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed99c expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.194239:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85c3000, rc 0) 00010000:00010000:1.0:1746147262.194241:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a400, rc 0) 00000100:00100000:3.0:1746147262.194255:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466002048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2254us (2533us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147262.194260:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466001920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2413us (2601us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147262.194261:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16214 00000100:00100000:1.0:1746147262.194266:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16212 00000100:00100000:0.0:1746147262.201085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.201134:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002560 00000100:00100000:1.0:1746147262.201144:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002560 00000100:00100000:1.0:1746147262.201195:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16216 00000100:00100000:1.0:1746147262.201202:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32216:x1830967466002560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.201221:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.201239:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9b1 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.201269:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.201277:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147262.201278:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147262.201282:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.201317:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.201329:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 30 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.201343:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467148032:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.201343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.201421:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.201586:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002816 00000100:00100000:3.0:1746147262.201590:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002816 00002000:00100000:3.0:1746147262.201617:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d499500 x1830967466002816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.201632:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499500 with x1830967466002816 ext(4194304->4976639) 00002000:00010000:3.0:1746147262.201637:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499500 00000100:00100000:3.0:1746147262.201656:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7739 00000100:00100000:3.0:1746147262.201661:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967466002816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147262.202928:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467148032:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.202967:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.202982:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1ae00, rc 0) 00000100:00100000:1.0:1746147262.203014:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32216:x1830967466002560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1813us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.203022:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16216 00000100:00100000:0.0:1746147262.204015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.204083:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466002944 00000100:00100000:1.0:1746147262.204088:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466002944 00002000:00100000:1.0:1746147262.204116:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (778240->1048575) req@ffff88012d499f80 x1830967466002944/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.204125:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499f80 with x1830967466002944 ext(778240->1048575) 00010000:00010000:1.0:1746147262.204132:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.204145:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.204152:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d499f80 00000100:00100000:1.0:1746147262.204178:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2642 00000100:00100000:1.0:1746147262.204184:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967466002944:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147262.211672:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967466002816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9997us (10315us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147262.211687:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7739 00002000:00100000:3.0:1746147262.211700:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d499500 x1830967466002816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.211711:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499500 with x1830967466002816 ext(4194304->4976639) 00002000:00010000:3.0:1746147262.211716:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499500 00000100:00100000:2.0:1746147262.214202:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967466002944:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10009us (10179us total) trans 17179874147 rc 0/0 00000100:00100000:2.0:1746147262.214215:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2642 00002000:00100000:2.0:1746147262.214226:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (778240->1048575) req@ffff88012d499f80 x1830967466002944/t17179874147(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.214235:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499f80 with x1830967466002944 ext(778240->1048575) 00010000:00010000:2.0:1746147262.214246:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.214263:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.214271:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d499f80 00000100:00100000:0.0:1746147262.215616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.215892:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466003072 00000100:00100000:2.0:1746147262.215901:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466003072 00000100:00100000:2.0:1746147262.216006:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16217 00000100:00100000:2.0:1746147262.216013:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967466003072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.216030:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.216048:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdad2823 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9b8 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.216114:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467148160:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147262.216386:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0403c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147262.217675:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime: 1746147261 -> 1746147262 00000100:00100000:2.0:1746147262.217697:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467148160:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147262.217723:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdad2823 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b8 expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.217739:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdad2823 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b8 expref: 34 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147262.217775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147262.217853:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486c00, rc 0) 00000100:00100000:2.0:1746147262.217892:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967466003072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1879us (2280us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147262.217899:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16217 00000100:00100000:3.0:1746147262.217996:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466003200 00000100:00100000:3.0:1746147262.218001:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466003200 00010000:00010000:3.0:1746147262.218022:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.218046:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8294 00000100:00100000:3.0:1746147262.218303:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967466003200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.218314:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.218324:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.218334:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.218350:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b1c00/0xb4b2209fbdad26f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8fb expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.218373:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.218375:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.218382:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.218389:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.218410:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.218418:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467148288:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.218467:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.220907:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467148288:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.220933:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.221685:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967466003200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3628us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.221696:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8294 00000100:00100000:2.0:1746147262.222395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.222436:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466003328 00000100:00100000:3.0:1746147262.222444:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466003328 00000100:00100000:3.0:1746147262.222478:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16218 00000100:00100000:3.0:1746147262.222483:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967466003328:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147262.222485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.222504:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147262.222507:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466003584 00000100:00100000:2.0:1746147262.222510:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466003584 00010000:00010000:3.0:1746147262.222519:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9bf expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147262.222540:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8801312a4000 x1830967466003584/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147262.222541:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.222543:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746147262.222550:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967466003584 ext(0->1048575) 00010000:00010000:3.0:1746147262.222551:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 33 pid: 6881 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746147262.222554:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4000 00010000:00010000:3.0:1746147262.222566:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 33 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147262.222569:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7740 00010000:00010000:3.0:1746147262.222575:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85c3800, rc 0) 00000100:00100000:2.0:1746147262.222575:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967466003584:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.222599:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967466003328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 115us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.222604:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16218 00000100:00100000:0.0:1746147262.228351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.228450:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466003840 00000100:00100000:1.0:1746147262.228462:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466003840 00000100:00100000:1.0:1746147262.228524:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4867 00000100:00100000:1.0:1746147262.228532:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:32211:x1830967466003840:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147262.228764:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32211:x1830967466003840:12345-192.168.203.36@tcp:35:cat.0 Request processed in 232us (424us total) trans 8589945610 rc 0/0 00000100:00100000:1.0:1746147262.228771:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4867 00000100:00100000:3.0:1746147262.229877:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967466003584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7299us (7390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.229889:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7740 00002000:00100000:3.0:1746147262.229897:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8801312a4000 x1830967466003584/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.229905:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967466003584 ext(0->1048575) 00002000:00010000:3.0:1746147262.229911:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4000 00000100:00100000:1.0:1746147262.236083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.236163:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466003968 00000100:00100000:3.0:1746147262.236173:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466003968 00000100:00100000:3.0:1746147262.236214:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16219 00000100:00100000:3.0:1746147262.236221:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32216:x1830967466003968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.236240:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.236257:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9c6 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.236285:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.236291:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.236292:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.236294:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.236320:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.236327:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 16 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.236337:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467148416:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.236598:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.240776:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467148416:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.240814:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.240832:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85c3c00, rc 0) 00000100:00100000:3.0:1746147262.240891:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32216:x1830967466003968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4670us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.240901:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16219 00000100:00100000:2.0:1746147262.240986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.241274:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466004096 00000100:00100000:3.0:1746147262.241281:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466004096 00002000:00100000:3.0:1746147262.241315:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1581055) req@ffff88009f66a300 x1830967466004096/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.241323:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66a300 with x1830967466004096 ext(1048576->1581055) 00010000:00010000:3.0:1746147262.241330:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 17 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.241341:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 17 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.241348:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f66a300 00000100:00100000:3.0:1746147262.241371:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2643 00000100:00100000:3.0:1746147262.241378:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967466004096:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147262.251377:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466004096:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9988us (10380us total) trans 21474841491 rc 0/0 00000100:00100000:3.0:1746147262.251391:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2643 00002000:00100000:3.0:1746147262.251403:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1581055) req@ffff88009f66a300 x1830967466004096/t21474841491(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.251412:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66a300 with x1830967466004096 ext(1048576->1581055) 00010000:00010000:3.0:1746147262.251423:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.251444:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.251452:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f66a300 00000100:00100000:2.0:1746147262.255578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.255793:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466004224 00000100:00100000:3.0:1746147262.255803:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466004224 00010000:00010000:3.0:1746147262.255840:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.255875:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8295 00000100:00100000:3.0:1746147262.255883:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967466004224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.255898:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.255919:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.255930:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.255966:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad270b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed910 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.255993:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.255995:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.256002:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.256014:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.256429:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.256445:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467148544:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.256656:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.260667:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467148544:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.260696:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.260743:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967466004224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4860us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.260753:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8295 00000100:00100000:0.0:1746147262.261308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.261502:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466004480 00000100:00100000:3.0:1746147262.261509:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466004480 00002000:00100000:3.0:1746147262.261545:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012d49b100 x1830967466004480/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.261555:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967466004480 ext(1048576->2097151) 00002000:00010000:3.0:1746147262.261560:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49b100 00000100:00100000:3.0:1746147262.262233:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7741 00000100:00100000:3.0:1746147262.262241:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466004480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.267746:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466004480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5496us (6428us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.267762:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7741 00002000:00100000:3.0:1746147262.267774:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012d49b100 x1830967466004480/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.267784:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967466004480 ext(1048576->2097151) 00002000:00010000:3.0:1746147262.267790:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49b100 00000100:00100000:0.0:1746147262.274853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.274919:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466004608 00000100:00100000:3.0:1746147262.274928:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466004608 00000100:00100000:3.0:1746147262.275606:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16220 00000100:00100000:3.0:1746147262.275615:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32216:x1830967466004608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.275632:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.275652:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9cd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.275683:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.275690:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.275692:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.275695:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.275890:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.275902:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 32 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.275921:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467148672:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.276563:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.278886:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467148672:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.278887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.278918:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.278949:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1200, rc 0) 00000100:00100000:3.0:1746147262.278997:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32216:x1830967466004608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3382us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.279005:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16220 00000100:00100000:2.0:1746147262.279062:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466004736 00000100:00100000:2.0:1746147262.279069:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466004736 00002000:00100000:2.0:1746147262.279113:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1576960->2097151) req@ffff88009b6a0000 x1830967466004736/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.279121:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0000 with x1830967466004736 ext(1576960->2097151) 00010000:00010000:2.0:1746147262.279129:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.279139:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.279145:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a0000 00000100:00100000:2.0:1746147262.279168:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2644 00000100:00100000:2.0:1746147262.279174:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967466004736:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147262.283455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.283773:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466004992 00000100:00100000:3.0:1746147262.283783:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466004992 00000100:00100000:3.0:1746147262.284097:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11581 00000100:00100000:3.0:1746147262.284106:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32219:x1830967466004992:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.284131:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.284151:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad283f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9d4 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.284257:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284270:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284280:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284299:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284305:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284310:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284417:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2854 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284425:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2854 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284431:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2854 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147262.284439:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147262.284510:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284516:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284522:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284527:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5d0400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.284531:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284537:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284548:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147262.284551:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.284555:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284559:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdad2846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284583:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284589:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284594:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284598:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b194400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.284600:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284605:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284611:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9b00) 00010000:00010000:3.0:1746147262.284612:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.284614:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284619:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad284d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.284654:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad283f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9d4 expref: 311 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.284668:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2854 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9d4 expref: 310 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.284674:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.284676:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147262.284678:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b195600, rc 0) 00000100:00100000:3.0:1746147262.284729:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32219:x1830967466004992:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 625us (1287us total) trans 8589945611 rc 0/0 00000100:00100000:3.0:1746147262.284735:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11581 00000100:00100000:2.0:1746147262.286220:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967466004736:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7041us (7335us total) trans 17179874148 rc 0/0 00000100:00100000:2.0:1746147262.286229:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2644 00002000:00100000:2.0:1746147262.286239:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1576960->2097151) req@ffff88009b6a0000 x1830967466004736/t17179874148(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.286248:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0000 with x1830967466004736 ext(1576960->2097151) 00010000:00010000:2.0:1746147262.286257:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.286270:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.286276:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a0000 00000100:00100000:0.0:1746147262.288084:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.288138:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.288200:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466005376 00000100:00100000:3.0:1746147262.288209:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466005376 00000100:00100000:2.0:1746147262.288211:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466005248 00000100:00100000:2.0:1746147262.288215:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466005248 00000100:00100000:3.0:1746147262.288260:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 796 00000100:00100000:2.0:1746147262.288260:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4868 00000100:00100000:3.0:1746147262.288267:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+311:1957:x1830967466005376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147262.288267:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32219:x1830967466005248:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:3.0:1746147262.288281:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.288304:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2854 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9d4 expref: 311 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.288323:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.288328:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.288362:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1957:x1830967466005376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.288368:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 796 00000100:00100000:2.0:1746147262.288444:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32219:x1830967466005248:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 177us (380us total) trans 8589945612 rc 0/0 00000100:00100000:2.0:1746147262.288449:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4868 00000100:00100000:0.0:1746147262.291046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.291155:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466005504 00000100:00100000:2.0:1746147262.291166:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466005504 00010000:00010000:2.0:1746147262.291201:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.291236:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8296 00000100:00100000:2.0:1746147262.291244:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967466005504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.291263:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.291289:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.291303:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.291328:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdad27c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed979 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.291522:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.291525:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.291534:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.291543:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.291588:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.291604:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467148800:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.291749:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.295543:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467148800:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.295567:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.295626:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967466005504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4381us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.295637:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8296 00000100:00100000:0.0:1746147262.297020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.297134:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466005760 00000100:00100000:2.0:1746147262.297141:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466005760 00002000:00100000:2.0:1746147262.297181:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009b6a0e00 x1830967466005760/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.297190:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0e00 with x1830967466005760 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.297195:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a0e00 00000100:00100000:2.0:1746147262.297224:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7742 00000100:00100000:2.0:1746147262.297230:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466005760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.301633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.301701:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466006016 00000100:00100000:3.0:1746147262.301711:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466006016 00000100:00100000:3.0:1746147262.301779:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11582 00000100:00100000:3.0:1746147262.301788:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32221:x1830967466006016:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.301815:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.301833:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9db expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.301965:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.301977:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.301988:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302002:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302007:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302013:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302138:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdad2877 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302148:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdad2877 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302153:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdad2877 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147262.302317:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147262.302404:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302414:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302420:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302425:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e6eb800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.302429:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302435:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302472:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147262.302474:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.302479:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.302483:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6eb800/0xb4b2209fbdad2869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147262.302524:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466005760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5292us (5508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.302534:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7742 00002000:00100000:2.0:1746147262.302544:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009b6a0e00 x1830967466005760/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.302553:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0e00 with x1830967466005760 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.302557:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a0e00 00010000:00010000:3.0:1746147262.303114:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303121:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303125:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303129:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efdd000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.303131:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303143:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303150:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9300) 00010000:00010000:3.0:1746147262.303152:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.303157:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303162:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdad2870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.303205:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b195600/0xb4b2209fbdad2862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9db expref: 17 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.303219:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdad2877 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9db expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.303225:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.303226:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147262.303228:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ca200, rc 0) 00000100:00100000:3.0:1746147262.303266:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32221:x1830967466006016:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1480us (1645us total) trans 8589945613 rc 0/0 00000100:00100000:3.0:1746147262.303272:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11582 00000100:00100000:0.0:1746147262.304732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.304813:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466006272 00000100:00100000:3.0:1746147262.304821:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466006272 00000100:00100000:3.0:1746147262.304863:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4869 00000100:00100000:3.0:1746147262.304870:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32221:x1830967466006272:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147262.305053:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32221:x1830967466006272:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 182us (325us total) trans 8589945614 rc 0/0 00000100:00100000:3.0:1746147262.305060:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4869 00000100:00100000:0.0:1746147262.305505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.306479:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466006400 00000100:00100000:2.0:1746147262.306485:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466006400 00000100:00100000:2.0:1746147262.306525:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 797 00000100:00100000:2.0:1746147262.306532:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967466006400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.306542:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.306567:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdad2877 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9db expref: 17 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.306587:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.306591:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.306628:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967466006400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.306634:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 797 00000100:00100000:1.0:1746147262.311538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.311588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.311627:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466006784 00000100:00100000:2.0:1746147262.311637:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466006784 00000100:00100000:3.0:1746147262.311648:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466006656 00000100:00100000:3.0:1746147262.311651:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466006656 00002000:00100000:3.0:1746147262.311680:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e1c00 x1830967466006656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.311680:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e2d80 x1830967466006784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.311690:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967466006784 ext(3145728->4194303) 00002000:00100000:3.0:1746147262.311691:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967466006656 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.311696:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1c00 00002000:00010000:2.0:1746147262.311696:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2d80 00000100:00100000:2.0:1746147262.311755:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7743 00000100:00100000:2.0:1746147262.311763:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466006784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.311889:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7744 00000100:00100000:3.0:1746147262.311895:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466006656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.322363:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967466006656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10455us (10761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.322376:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7744 00002000:00100000:3.0:1746147262.322389:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e1c00 x1830967466006656/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.322398:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967466006656 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.322405:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1c00 00000100:00100000:2.0:1746147262.325407:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466006784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13637us (13871us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.325420:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7743 00002000:00100000:2.0:1746147262.325432:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e2d80 x1830967466006784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.325442:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967466006784 ext(3145728->4194303) 00002000:00010000:2.0:1746147262.325447:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2d80 00000100:00100000:0.0:1746147262.329801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.330096:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466007040 00000100:00100000:3.0:1746147262.330107:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466007040 00000100:00100000:3.0:1746147262.330151:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16221 00000100:00100000:3.0:1746147262.330158:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:32219:x1830967466007040:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.330178:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.330197:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9e2 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.330232:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.330241:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.330247:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.330249:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.330252:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.330400:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.330411:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 17 pid: 4444 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.330422:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467148928:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.330534:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.330542:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.330554:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467149056:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.330574:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.332806:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467148928:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.332818:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467149056:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.332848:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.332864:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b195600, rc 0) 00000100:00100000:3.0:1746147262.332905:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:32219:x1830967466007040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2746us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.332914:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16221 00000100:00100000:0.0:1746147262.335559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.336009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.336084:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466007424 00000100:00100000:2.0:1746147262.336093:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466007424 00002000:00100000:2.0:1746147262.336139:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6a1f80 x1830967466007424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.336149:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1f80 with x1830967466007424 ext(4194304->4976639) 00010000:00010000:2.0:1746147262.336162:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.336174:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00002000:00010000:2.0:1746147262.336181:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a1f80 00000100:00100000:3.0:1746147262.336193:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466007168 00000100:00100000:3.0:1746147262.336197:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466007168 00000100:00100000:2.0:1746147262.336201:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2645 00000100:00100000:2.0:1746147262.336208:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466007424:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147262.336218:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.336244:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8297 00000100:00100000:3.0:1746147262.336249:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967466007168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.336259:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.336274:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.336286:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.336306:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537ee00/0xb4b2209fbdad27d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed987 expref: 35 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.336331:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.336373:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967466007168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.336379:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8297 00000100:00100000:2.0:1746147262.350581:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466007424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14357us (14555us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147262.350597:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2645 00002000:00100000:2.0:1746147262.350615:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6a1f80 x1830967466007424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.350631:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1f80 with x1830967466007424 ext(4194304->4976639) 00010000:00010000:2.0:1746147262.350644:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.350661:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00002000:00010000:2.0:1746147262.350668:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a1f80 00000100:00100000:0.0:1746147262.356120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.356241:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466007552 00000100:00100000:3.0:1746147262.356252:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466007552 00000100:00100000:3.0:1746147262.356315:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16222 00000100:00100000:3.0:1746147262.356324:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967466007552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.356344:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.356363:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdad288c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9e9 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.356388:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.356399:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdad288c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e9 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.356410:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdad288c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e9 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.357051:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65800, rc 0) 00000100:00100000:3.0:1746147262.357126:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967466007552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 803us (1017us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147262.357134:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16222 00000100:00100000:0.0:1746147262.360014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.360190:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466007680 00000100:00100000:3.0:1746147262.360200:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466007680 00010000:00010000:3.0:1746147262.360242:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.360626:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8298 00000100:00100000:3.0:1746147262.360634:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466007680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.360651:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.360673:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.360686:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.360710:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad280e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9aa expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.360724:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.360726:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.360734:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 33 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.360741:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 33 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.360775:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 33 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.360787:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467149184:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.360888:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.361435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.362817:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467149184:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.362827:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466007808 00000100:00100000:3.0:1746147262.362834:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466007808 00010000:00010000:2.0:1746147262.362843:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.362869:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16223 00000100:00100000:3.0:1746147262.362877:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32216:x1830967466007808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.362893:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.362909:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9f0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.362955:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 33 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.362963:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.362965:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.362968:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.362991:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 33 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.363003:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 33 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.363012:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467149312:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.363364:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967466007680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2727us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.363371:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.363372:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8298 00000100:00100000:1.0:1746147262.363608:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.363722:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008064 00000100:00100000:1.0:1746147262.363727:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008064 00002000:00100000:1.0:1746147262.363759:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3006464->3010559) req@ffff8800b52e1500 x1830967466008064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.363769:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1500 with x1830967466008064 ext(3006464->3010559) 00010000:00010000:1.0:1746147262.363776:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 34 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.363787:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 34 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.363793:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e1500 00000100:00100000:1.0:1746147262.363820:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2646 00000100:00100000:1.0:1746147262.363827:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967466008064:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147262.364317:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967466008064:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 489us (708us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147262.364324:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2646 00002000:00100000:1.0:1746147262.364330:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3006464->3010559) req@ffff8800b52e1500 x1830967466008064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.364336:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1500 with x1830967466008064 ext(3006464->3010559) 00010000:00010000:1.0:1746147262.364342:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 34 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.364351:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 34 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.364356:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e1500 00000100:00100000:3.0:1746147262.366488:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467149312:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.366519:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.366535:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64e00, rc 0) 00000100:00100000:3.0:1746147262.366619:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32216:x1830967466007808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3741us (5183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.366625:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16223 00000100:00100000:2.0:1746147262.369050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.369331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.369369:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008448 00000100:00100000:3.0:1746147262.369378:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008448 00000100:00100000:1.0:1746147262.369400:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008320 00000100:00100000:1.0:1746147262.369405:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008320 00002000:00100000:1.0:1746147262.369439:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3006464->3145727) req@ffff88009f66b800 x1830967466008320/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.369449:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b800 with x1830967466008320 ext(3006464->3145727) 00010000:00010000:1.0:1746147262.369459:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 34 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.369471:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 34 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.369478:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f66b800 00000100:00100000:1.0:1746147262.370101:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2647 00000100:00100000:1.0:1746147262.370110:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967466008320:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147262.370458:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16224 00000100:00100000:1.0:1746147262.370529:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:32219:x1830967466008448:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147262.370540:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.370557:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9f7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.370580:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.370588:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.370594:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.370596:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.370599:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->2506751] (req 2097152->2506751) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.370629:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.370639:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 13 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.370651:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467149440:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.371333:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.371342:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.371351:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467149568:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.371494:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147262.375667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.375690:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467149440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.375702:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467149568:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.375736:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->2506751] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.375753:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a600, rc 0) 00000100:00100000:2.0:1746147262.375796:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:32219:x1830967466008448:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5331us (6465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.375805:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16224 00000100:00100000:2.0:1746147262.375986:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008576 00000100:00100000:2.0:1746147262.375991:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008576 00000100:00100000:2.0:1746147262.376020:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16225 00000100:00100000:2.0:1746147262.376026:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32221:x1830967466008576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.376039:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.376052:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ed9fe expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.378404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.378526:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008704 00000100:00100000:3.0:1746147262.378532:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008704 00010000:00010000:3.0:1746147262.378554:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.378573:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8299 00000100:00100000:3.0:1746147262.378578:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466008704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.378588:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.379572:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.379585:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.379591:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [2797568->3145727] (req 2797568->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.379606:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 7 type: EXT [2797568->3145727] (req 2797568->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.379608:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.379617:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486200, rc 0) 00010000:00010000:3.0:1746147262.379620:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.379640:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d59d800/0xb4b2209fbdad2720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed925 expref: 16 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.379657:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.379923:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32221:x1830967466008576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3896us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.379923:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967466008320:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9813us (10878us total) trans 17179874149 rc 0/0 00000100:00100000:2.0:1746147262.379929:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16225 00000100:00100000:1.0:1746147262.379933:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2647 00002000:00100000:1.0:1746147262.379955:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3006464->3145727) req@ffff88009f66b800 x1830967466008320/t17179874149(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.379964:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b800 with x1830967466008320 ext(3006464->3145727) 00010000:00010000:1.0:1746147262.379973:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.379983:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.379989:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f66b800 00000100:00100000:3.0:1746147262.380096:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466008704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1516us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.380103:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8299 00000100:00100000:0.0:1746147262.380921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.381226:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008832 00000100:00100000:3.0:1746147262.381234:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008832 00010000:00010000:3.0:1746147262.381256:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.381285:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8300 00000100:00100000:3.0:1746147262.381292:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466008832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.381303:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.381322:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.381331:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.381346:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d59de00/0xb4b2209fbdad2719 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed91e expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.381357:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.381359:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.381364:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.381373:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.381380:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.381382:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.381386:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.381393:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.381421:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.381434:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467149696:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.381509:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.381517:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467149824:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.383786:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147262.384548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.384735:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466008960 00000100:00100000:0.0:1746147262.384745:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466008960 00010000:00010000:0.0:1746147262.384779:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.384818:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8301 00000100:00100000:0.0:1746147262.384825:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967466008960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.384839:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147262.384858:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147261 -> 1746147262 00002000:00010000:0.0:1746147262.384861:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147261 -> 1746147262 00010000:00010000:0.0:1746147262.384865:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.384876:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.384899:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b195600/0xb4b2209fbdad2885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9e2 expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.384925:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.384927:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.384933:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.384956:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.385216:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467149696:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147262.385440:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.385452:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467149952:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147262.389707:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.390668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.390762:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467149952:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147262.390781:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.390825:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967466008960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6000us (6282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.390836:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8301 00000100:00100000:3.0:1746147262.390920:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467149824:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.390966:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.390985:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967466008832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9694us (10066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.390992:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8300 00000100:00100000:1.0:1746147262.391206:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466009216 00000100:00100000:1.0:1746147262.391214:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466009216 00002000:00100000:1.0:1746147262.391261:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2797568->2801663) req@ffff88009b6a3480 x1830967466009216/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.391271:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3480 with x1830967466009216 ext(2797568->2801663) 00002000:00010000:1.0:1746147262.391276:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a3480 00000100:00100000:1.0:1746147262.391306:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7745 00000100:00100000:1.0:1746147262.391313:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967466009216:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147262.391476:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967466009216:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 163us (813us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147262.391482:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7745 00002000:00100000:1.0:1746147262.391487:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2797568->2801663) req@ffff88009b6a3480 x1830967466009216/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.391494:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3480 with x1830967466009216 ext(2797568->2801663) 00002000:00010000:1.0:1746147262.391497:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a3480 00000100:00100000:0.0:1746147262.392243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.394612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.394702:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466009344 00000100:00100000:2.0:1746147262.394713:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466009344 00000100:00100000:2.0:1746147262.395363:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16226 00000100:00100000:2.0:1746147262.395372:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967466009344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.395391:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.395408:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487800/0xb4b2209fbdad28a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda05 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.395464:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467150080:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147262.396097:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466009600 00000100:00100000:3.0:1746147262.396103:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466009600 00002000:00100000:3.0:1746147262.396131:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2502656->2506751) req@ffff88009b6a3800 x1830967466009600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.396145:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3800 with x1830967466009600 ext(2502656->2506751) 00002000:00010000:3.0:1746147262.396150:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a3800 00000100:00100000:3.0:1746147262.396166:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7746 00000100:00100000:3.0:1746147262.396172:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967466009600:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147262.396331:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967466009600:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 158us (1729us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147262.396338:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7746 00002000:00100000:3.0:1746147262.396343:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2502656->2506751) req@ffff88009b6a3800 x1830967466009600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.396350:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3800 with x1830967466009600 ext(2502656->2506751) 00002000:00010000:3.0:1746147262.396353:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a3800 00000100:00100000:2.0:1746147262.396985:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00002000:00010000:2.0:1746147262.406168:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147261 -> 1746147262 00002000:00010000:2.0:1746147262.406178:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147261 -> 1746147262 00002000:00010000:2.0:1746147262.406180:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147261 -> 1746147262 00000100:00100000:2.0:1746147262.406207:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467150080:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147262.406240:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487800/0xb4b2209fbdad28a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda05 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.406255:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487800/0xb4b2209fbdad28a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda05 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.406271:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487800, rc 0) 00000100:00100000:2.0:1746147262.407018:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967466009344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11645us (14773us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147262.407026:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16226 00000100:00100000:1.0:1746147262.411783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.411846:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466009856 00000100:00100000:0.0:1746147262.411855:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466009856 00002000:00100000:0.0:1746147262.411895:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff88012ecee300 x1830967466009856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.411905:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967466009856 ext(4972544->4976639) 00002000:00010000:0.0:1746147262.411910:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecee300 00000100:00100000:3.0:1746147262.412102:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7747 00000100:00100000:3.0:1746147262.412113:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466009856:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147262.412456:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466009856:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 344us (680us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147262.412463:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7747 00002000:00100000:3.0:1746147262.412469:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4972544->4976639) req@ffff88012ecee300 x1830967466009856/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.412475:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967466009856 ext(4972544->4976639) 00002000:00010000:3.0:1746147262.412478:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecee300 00000100:00100000:0.0:1746147262.419581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.419689:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466009984 00000100:00100000:2.0:1746147262.419699:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466009984 00000100:00100000:2.0:1746147262.419762:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16227 00000100:00100000:2.0:1746147262.419771:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32221:x1830967466009984:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.419790:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.419813:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda0c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.419851:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.419861:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.419863:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.419867:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->3473407] (req 3145728->3473407) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.419899:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.419911:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.419923:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467150208:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.420751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.420876:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466010240 00000100:00100000:3.0:1746147262.420881:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466010240 00000100:00100000:3.0:1746147262.420910:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4870 00000100:00100000:3.0:1746147262.420916:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32216:x1830967466010240:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147262.421046:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.421211:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32216:x1830967466010240:12345-192.168.203.36@tcp:35:cat.0 Request processed in 295us (461us total) trans 8589945615 rc 0/0 00000100:00100000:3.0:1746147262.421218:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4870 00000100:00100000:2.0:1746147262.422527:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467150208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.422554:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->3473407] (req 3145728->3473407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.422569:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487000, rc 0) 00000100:00100000:2.0:1746147262.422613:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32221:x1830967466009984:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2843us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.422619:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16227 00000100:00100000:0.0:1746147262.423485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.423733:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466010368 00000100:00100000:3.0:1746147262.423741:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466010368 00000100:00100000:3.0:1746147262.423857:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11583 00000100:00080000:1.0:1746147262.423861:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147262.423864:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:32223:x1830967466010368:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147262.423886:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.423907:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdad28b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda13 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.424086:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424099:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424110:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424124:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424130:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424135:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424254:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147262.424254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.424262:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 309 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.424270:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.424278:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 5/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.424314:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.424325:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 16 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.424338:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467150336:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.424426:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 309 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.424433:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 309 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.424440:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467150464:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.424457:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.424513:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466010496 00000100:00100000:2.0:1746147262.424519:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466010496 00010000:00010000:2.0:1746147262.424540:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.424559:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8302 00000100:00100000:2.0:1746147262.424564:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466010496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.424574:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.424594:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.424604:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.424621:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdad2893 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f0 expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.424643:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.424645:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.424651:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.424658:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.424827:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.424837:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467150592:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.424872:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.427302:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467150336:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.427316:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467150464:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.427345:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147262.427457:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467150592:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.427468:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.427545:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466010496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2979us (3289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.427555:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8302 00000100:00100000:0.0:1746147262.428907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.428966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.429003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.429057:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466010624 00000100:00100000:2.0:1746147262.429064:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466010624 00010000:00010000:2.0:1746147262.429107:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.429135:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8303 00000100:00100000:3.0:1746147262.429137:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466010880 00000100:00100000:3.0:1746147262.429142:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466010880 00000100:00100000:2.0:1746147262.429142:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466010624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.429155:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.429161:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.429171:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.429181:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4871 00000100:00100000:3.0:1746147262.429187:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:27370:x1830967466010880:12345-192.168.203.36@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746147262.429192:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e29600/0xb4b2209fbdad2686 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8a0 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.429205:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.429209:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.429217:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.429222:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.429227:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.429255:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466010624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 113us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.429260:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8303 00000100:00100000:0.0:1746147262.429325:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466011136 00000100:00100000:0.0:1746147262.429328:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466011136 00002000:00100000:0.0:1746147262.429355:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3469312->3473407) req@ffff88009b6a1500 x1830967466011136/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.429364:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1500 with x1830967466011136 ext(3469312->3473407) 00002000:00010000:0.0:1746147262.429368:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a1500 00000100:00100000:3.0:1746147262.429376:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:27370:x1830967466010880:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 189us (409us total) trans 8589945616 rc 0/0 00000100:00100000:0.0:1746147262.429381:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7748 00000100:00100000:3.0:1746147262.429382:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4871 00000100:00100000:0.0:1746147262.429386:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967466011136:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147262.429517:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967466011136:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 130us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147262.429523:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7748 00002000:00100000:0.0:1746147262.429528:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3469312->3473407) req@ffff88009b6a1500 x1830967466011136/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.429541:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1500 with x1830967466011136 ext(3469312->3473407) 00002000:00010000:0.0:1746147262.429543:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a1500 00000100:00100000:0.0:1746147262.430519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.430683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.430720:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466011264 00000100:00100000:2.0:1746147262.430724:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466011264 00010000:00010000:2.0:1746147262.430745:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 311 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.430752:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466011520 00000100:00100000:1.0:1746147262.430756:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466011520 00000100:00100000:2.0:1746147262.430764:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8304 00000100:00100000:2.0:1746147262.430769:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:1957:x1830967466011264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.430779:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.430783:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 311 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.430785:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4872 00000100:00100000:1.0:1746147262.430791:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32221:x1830967466011520:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:2.0:1746147262.430792:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 311 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.430806:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f614a00/0xb4b2209fbdad267f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed892 expref: 311 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.430819:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.430823:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.430835:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.430840:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.430862:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147262.430877:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147262.430883:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1957:x1830967466011264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 114us (365us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147262.430885:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147262.430889:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8304 00000004:00200000:3.0:1746147262.430909:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:1.0:1746147262.430910:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32221:x1830967466011520:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 119us (225us total) trans 8589945617 rc 0/0 00000004:00200000:3.0:1746147262.430912:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746147262.430917:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4872 00000004:00010000:3.0:1746147262.430921:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430928:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430934:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430953:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430960:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430964:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d64400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.430967:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430971:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430977:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147262.430979:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.430981:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430984:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64400/0xb4b2209fbdad28bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430994:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.430997:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.431000:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.431003:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d64800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.431004:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.431006:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.431012:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9b00) 00010000:00010000:3.0:1746147262.431013:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.431015:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.431017:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64800/0xb4b2209fbdad28c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.431042:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdad28b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.431050:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.431053:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.431054:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147262.431056:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65e00, rc 0) 00000100:00100000:3.0:1746147262.431104:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32223:x1830967466010368:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 7240us (7621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.431112:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11583 00000100:00100000:0.0:1746147262.435156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.435197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.435220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.435221:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466011648 00000100:00100000:2.0:1746147262.435231:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466011648 00000100:00100000:1.0:1746147262.435253:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466011904 00000100:00100000:1.0:1746147262.435257:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466011904 00000100:00100000:0.0:1746147262.435261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.435434:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466011776 00000100:00100000:2.0:1746147262.435437:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466011776 00000100:00100000:1.0:1746147262.435445:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466012032 00000100:00100000:1.0:1746147262.435447:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466012032 00000100:00100000:0.0:1746147262.435451:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16228 00000100:00100000:2.0:1746147262.435458:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16229 00000100:00100000:0.0:1746147262.435461:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466011648:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147262.435464:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466011904:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147262.435469:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16230 00000100:00100000:1.0:1746147262.435474:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466012032:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147262.435494:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147262.435494:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.435497:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.435511:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda28 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.435511:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da3de00/0xb4b2209fbdad28e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda2f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.435511:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda1a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.435532:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.435532:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.435533:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.435533:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.435541:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.435542:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.435555:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147262.435555:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147262.435560:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467150720:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147262.435564:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00010000:00010000:0.0:1746147262.435564:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009531fc00, rc 0) 00000100:00100000:2.0:1746147262.435607:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466011904:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 144us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.435612:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16229 00000100:00100000:2.0:1746147262.435645:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16231 00000100:00100000:2.0:1746147262.435650:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466011776:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147262.435657:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.435667:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda21 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.435680:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.435681:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.435685:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.435694:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.435701:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486600, rc 0) 00000100:00100000:0.0:1746147262.435708:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967466011648:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 249us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.435714:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16228 00000100:00100000:2.0:1746147262.435727:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466011776:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 66us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.435733:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16231 00000100:00100000:1.0:1746147262.435741:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00000100:00080000:1.0:1746147262.435761:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147262.437065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.437123:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466012160 00000100:00100000:0.0:1746147262.437130:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466012160 00000100:00100000:0.0:1746147262.437165:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16232 00000100:00100000:0.0:1746147262.437171:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466012160:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147262.437181:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147262.437192:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009531f600/0xb4b2209fbdad28ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda36 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.437233:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467150848:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147262.437298:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00002000:00010000:1.0:1746147262.438165:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147261 -> 1746147262 00000100:00100000:1.0:1746147262.438187:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467150720:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147262.438212:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da3de00/0xb4b2209fbdad28e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda2f expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.438224:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da3de00/0xb4b2209fbdad28e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda2f expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147262.438468:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467150848:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147262.438482:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009531f600/0xb4b2209fbdad28ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda36 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147262.438491:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009531f600/0xb4b2209fbdad28ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda36 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.438609:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da3de00, rc 0) 00010000:00010000:0.0:1746147262.438826:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009531f600, rc 0) 00000100:00100000:1.0:1746147262.438925:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466012032:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3449us (3662us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147262.438933:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16230 00000100:00100000:0.0:1746147262.439010:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466012160:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 1839us (1948us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147262.439015:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16232 00000100:00100000:0.0:1746147262.441107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.441244:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466012416 00000100:00100000:3.0:1746147262.441253:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466012416 00000100:00100000:3.0:1746147262.441292:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11584 00000100:00100000:3.0:1746147262.441298:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32223:x1830967466012416:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147262.441315:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.441330:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad28f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda3d expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.441428:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.441441:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.441448:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.441478:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.441490:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 8 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.441501:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467150976:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.441572:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.442931:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467150976:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.442969:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147262.442970:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.443021:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466012544 00000100:00100000:1.0:1746147262.443026:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466012544 00010000:00010000:1.0:1746147262.443053:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 9 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.443097:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8305 00000100:00100000:1.0:1746147262.443103:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967466012544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.443113:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.443118:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 9 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.443128:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 9 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.443149:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad28cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda13 expref: 9 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.443164:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147262.443168:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147262.443175:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147262.443182:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147262.443286:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147262.443325:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.443332:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147262.443347:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147262.443472:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b194400/0xb4b2209fbdad28f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda3d expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.443489:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda3d expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.443495:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.443498:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147262.443500:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64e00, rc 0) 00000100:00100000:1.0:1746147262.443544:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967466012544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 441us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.443551:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8305 00000100:00100000:2.0:1746147262.443967:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32223:x1830967466012416:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2668us (2864us total) trans 8589945618 rc 0/0 00000100:00100000:2.0:1746147262.443974:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11584 00000100:00100000:0.0:1746147262.446707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.446759:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466012800 00000100:00100000:2.0:1746147262.446769:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466012800 00000100:00100000:0.0:1746147262.446776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.446806:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013056 00000100:00100000:2.0:1746147262.446808:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013056 00000100:00100000:0.0:1746147262.446815:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11585 00000100:00100000:0.0:1746147262.446823:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32223:x1830967466012800:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147262.446836:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11586 00000100:00100000:2.0:1746147262.446842:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32228:x1830967466013056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147262.446845:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147262.446848:0:14047:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147262.446851:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.446867:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad290a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda4b expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.446867:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64e00/0xb4b2209fbdad28fc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda3d expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.446895:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.446899:0:14047:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147262.446905:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95ba00/0xb4b2209fbdad2911 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda44 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.446972:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147262.446983:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.446991:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.446991:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.446998:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147262.447001:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147262.447004:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447019:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447025:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447030:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.447096:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b95ba00/0xb4b2209fbdad2911 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.447107:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 9 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.447113:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.447116:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147262.447118:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009531f600, rc 0) 00010000:00010000:2.0:1746147262.447128:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447136:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447141:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147262.447146:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:0.0:1746147262.447161:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32223:x1830967466012800:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 338us (460us total) trans 8589945619 rc 0/0 00000100:00100000:0.0:1746147262.447166:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11585 00010000:00010000:2.0:1746147262.447183:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447190:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447196:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447202:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.447205:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447211:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447219:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.447221:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147262.447224:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447228:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2934 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447238:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447242:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447246:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447250:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.447251:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447255:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447259:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.447261:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.447263:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447266:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad291f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447271:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447276:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447280:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447283:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.447285:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447289:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447293:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76f00) 00010000:00010000:2.0:1746147262.447294:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.447296:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447299:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad292d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.447319:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad290a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda4b expref: 312 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.447325:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad290a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda4b expref: 312 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.447330:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487a00, rc 0) 00000100:00100000:2.0:1746147262.447362:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32228:x1830967466013056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 520us (585us total) trans 8589945620 rc 301/301 00000100:00100000:2.0:1746147262.447371:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11586 00000100:00100000:0.0:1746147262.448445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.448578:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013184 00000100:00100000:2.0:1746147262.448584:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013184 00000100:00100000:2.0:1746147262.448606:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11587 00000100:00100000:2.0:1746147262.448611:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32223:x1830967466013184:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147262.448623:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.448630:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2942 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda52 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.448663:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2942 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda52 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.448676:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2942 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda52 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.448691:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.448694:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147262.448696:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:2.0:1746147262.448764:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32223:x1830967466013184:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 151us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.448770:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11587 00000100:00100000:1.0:1746147262.448911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.448930:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013312 00000100:00100000:1.0:1746147262.448933:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013312 00000100:00100000:1.0:1746147262.448975:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16233 00000100:00100000:1.0:1746147262.448979:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967466013312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.448987:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.448997:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda59 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.449011:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.449012:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.449020:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.449030:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.449037:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da3de00, rc 0) 00000100:00100000:1.0:1746147262.449053:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466013312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.449061:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16233 00000100:00100000:1.0:1746147262.449100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.449113:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013440 00000100:00100000:1.0:1746147262.449115:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013440 00000100:00100000:1.0:1746147262.449129:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16234 00000100:00100000:1.0:1746147262.449133:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967466013440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.449140:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.449149:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda60 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.449159:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.449160:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.449165:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 36 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.449174:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 36 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.449180:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da3d000, rc 0) 00000100:00100000:1.0:1746147262.449194:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967466013440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 61us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.449199:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16234 00000100:00100000:2.0:1746147262.449253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.449281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.449367:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013568 00000100:00100000:1.0:1746147262.449371:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013568 00000100:00100000:1.0:1746147262.449507:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013696 00000100:00100000:1.0:1746147262.449510:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013696 00000100:00100000:1.0:1746147262.449527:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16235 00000100:00100000:1.0:1746147262.449531:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967466013568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.449537:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.449543:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad2957 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda67 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147262.449580:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151104:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147262.449696:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16236 00000100:00100000:2.0:1746147262.449703:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466013696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.449709:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.449717:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad295e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda6e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.449745:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467151232:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147262.449886:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.450004:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147262.450892:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151104:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147262.450895:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467151232:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147262.450911:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad295e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda6e expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.450911:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad2957 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda67 expref: 37 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.450919:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad295e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda6e expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.450920:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ecc00/0xb4b2209fbdad2957 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda67 expref: 37 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.450927:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486c00, rc 0) 00000100:00100000:2.0:1746147262.450966:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466013696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1263us (1684us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147262.450972:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16236 00010000:00010000:1.0:1746147262.450980:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ecc00, rc 0) 00000100:00100000:1.0:1746147262.450998:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967466013568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1466us (1745us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147262.451004:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16235 00000100:00100000:0.0:1746147262.451305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.451340:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013824 00000100:00100000:1.0:1746147262.451344:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013824 00000100:00100000:1.0:1746147262.451373:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16237 00000100:00100000:1.0:1746147262.451379:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466013824:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147262.451408:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.451421:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.451428:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.451435:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.451441:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.451442:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.451444:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.451464:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.451476:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.451485:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151360:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.451702:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.451711:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 10 pid: 17548 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.451719:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151488:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.451762:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.451770:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 17 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.451777:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151616:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.451799:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.451850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.451874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.451923:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466013952 00000100:00100000:2.0:1746147262.451927:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466013952 00000100:00100000:1.0:1746147262.451930:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014080 00000100:00100000:1.0:1746147262.451932:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014080 00000100:00100000:2.0:1746147262.451971:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16238 00000100:00100000:2.0:1746147262.451977:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466013952:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147262.452004:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.452016:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.452028:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.452035:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.452041:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.452042:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.452044:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.452065:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147262.452082:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16239 00010000:00010000:2.0:1746147262.452087:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 12 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.452089:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466014080:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:2.0:1746147262.452096:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467151744:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.452105:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.452117:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.452124:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.452130:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.452136:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.452137:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.452139:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.452141:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.452149:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 18 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.452156:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.452163:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467151872:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.452164:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 18 pid: 8478 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.452172:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467152000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.452193:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.452200:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.452204:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 13 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.452208:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 13 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.452216:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467152128:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.452216:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467152256:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.452238:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147262.452241:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147262.452245:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 12 pid: 8481 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.452252:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467152384:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.452269:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.453214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.453249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.453290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.453307:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014208 00000100:00100000:2.0:1746147262.453317:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014208 00000100:00100000:2.0:1746147262.453345:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014336 00000100:00100000:3.0:1746147262.453346:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014464 00000100:00100000:2.0:1746147262.453347:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014336 00000100:00100000:3.0:1746147262.453351:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014464 00000100:00100000:2.0:1746147262.453362:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16240 00000100:00100000:2.0:1746147262.453368:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466014208:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147262.453384:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16241 00000100:00100000:0.0:1746147262.453390:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466014336:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147262.453392:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16242 00000100:00100000:3.0:1746147262.453396:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1958:x1830967466014464:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147262.453396:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.453407:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.453410:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.453414:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.453417:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.453422:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147262.453423:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147262.453424:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.453424:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147262.453426:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.453431:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.453434:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.453436:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147262.453438:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147262.453439:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.453443:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.453445:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.453446:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.453448:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.453451:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 17 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.453452:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.453459:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.453460:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467152512:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.453465:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467152640:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.453469:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.453478:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 12 pid: 11147 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.453487:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467152768:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.453548:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00010000:00010000:3.0:1746147262.453550:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.453558:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.453566:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467152896:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.453586:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.453684:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151360:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.455345:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.455359:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 35 pid: 8480 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.455372:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467153024:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.455424:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.455437:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 17 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.455450:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467153152:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.455467:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.455877:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467151744:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.455998:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467151872:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.456117:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151488:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.456131:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467151616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.456162:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.460178:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467152000:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.460191:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467152256:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.460442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.460467:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014976 00000100:00100000:1.0:1746147262.460473:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014976 00010000:00010000:1.0:1746147262.460510:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.460537:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8306 00000100:00100000:1.0:1746147262.460543:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466014976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.460559:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.460583:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.460593:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.460616:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad281c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9b1 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.460630:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.460675:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1959:x1830967466014976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 131us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.460681:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8306 00000100:00100000:1.0:1746147262.460727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.460741:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014720 00000100:00100000:1.0:1746147262.460744:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014720 00010000:00010000:1.0:1746147262.460761:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 14 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.460784:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8307 00000100:00100000:1.0:1746147262.460789:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967466014720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.460798:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.460818:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 14 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.460826:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 14 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.460843:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad28e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda21 expref: 14 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.460853:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.460875:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967466014720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.460881:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8307 00000100:00100000:1.0:1746147262.460964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.460981:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015104 00000100:00100000:1.0:1746147262.460984:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015104 00010000:00010000:1.0:1746147262.460995:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 13 pid: 8481 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.461016:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8308 00000100:00100000:1.0:1746147262.461022:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967466015104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.461029:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.461038:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 13 pid: 8481 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461050:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 13 pid: 8481 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461067:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.461095:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967466015104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.461100:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8308 00000100:00100000:1.0:1746147262.461136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.461147:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014848 00000100:00100000:1.0:1746147262.461154:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014848 00010000:00010000:1.0:1746147262.461166:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 19 pid: 4444 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.461188:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8309 00000100:00100000:1.0:1746147262.461192:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466014848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.461199:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.461205:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 19 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461218:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 19 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461228:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da3de00/0xb4b2209fbdad2949 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda59 expref: 19 pid: 4444 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461246:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.461260:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967466014848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.461271:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8309 00000100:00100000:1.0:1746147262.461312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.461323:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466014592 00000100:00100000:1.0:1746147262.461333:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466014592 00010000:00010000:1.0:1746147262.461343:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 13 pid: 17548 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.461364:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8310 00000100:00100000:1.0:1746147262.461368:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466014592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.461375:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.461388:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 13 pid: 17548 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461396:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 13 pid: 17548 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461406:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009531fc00/0xb4b2209fbdad28d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda1a expref: 13 pid: 17548 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746147262.461420:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.461433:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466014592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.461448:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8310 00000100:00100000:1.0:1746147262.461571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.461586:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015232 00000100:00100000:1.0:1746147262.461590:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015232 00010000:00010000:1.0:1746147262.461601:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.461621:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8311 00000100:00100000:1.0:1746147262.461626:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967466015232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.461632:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.461640:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.461655:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.461666:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad26be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8ca expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.461679:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.461695:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967466015232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.461719:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8311 00000100:00100000:1.0:1746147262.461804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.461822:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015360 00000100:00100000:1.0:1746147262.461831:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015360 00002000:00100000:1.0:1746147262.461864:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3473407) req@ffff88009b20b480 x1830967466015360/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.461873:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967466015360 ext(3145728->3473407) 00010000:00010000:1.0:1746147262.461879:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 17 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.461888:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 17 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.461895:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20b480 00000100:00100000:1.0:1746147262.461923:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2648 00000100:00100000:1.0:1746147262.461929:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967466015360:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147262.462347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.462367:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015488 00000100:00100000:1.0:1746147262.462371:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015488 00002000:00100000:1.0:1746147262.462387:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2797568->3145727) req@ffff88009b209180 x1830967466015488/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.462401:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209180 with x1830967466015488 ext(2797568->3145727) 00010000:00010000:1.0:1746147262.462407:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.462415:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 13 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.462425:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b209180 00000100:00100000:1.0:1746147262.462442:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2649 00000100:00100000:1.0:1746147262.462452:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1956:x1830967466015488:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147262.462990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.463003:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015744 00000100:00100000:1.0:1746147262.463006:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015744 00010000:00010000:1.0:1746147262.463029:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 15 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.463052:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8312 00000100:00100000:1.0:1746147262.463058:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967466015744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.463081:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.463093:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 15 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.463108:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 15 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.463122:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.463124:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.463128:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.463142:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.463167:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.463184:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967466015744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.463203:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8312 00000100:00100000:0.0:1746147262.463256:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467152512:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.463265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.463283:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015872 00000100:00100000:1.0:1746147262.463286:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015872 00002000:00100000:1.0:1746147262.463306:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2506751) req@ffff88009b208700 x1830967466015872/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.463313:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208700 with x1830967466015872 ext(2097152->2506751) 00010000:00010000:1.0:1746147262.463318:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.463326:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.463338:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b208700 00000100:00100000:1.0:1746147262.463352:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2650 00000100:00100000:1.0:1746147262.463358:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967466015872:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147262.463366:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.463405:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094841c00/0xb4b2209fbdad25b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed85a expref: 12 pid: 8481 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746147262.463415:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967467152384:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147262.463434:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.463479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.463488:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016000 00000100:00100000:0.0:1746147262.463491:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016000 00010000:00010000:0.0:1746147262.463502:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 12 pid: 11147 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746147262.463522:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8313 00000100:00100000:0.0:1746147262.463526:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466016000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.463533:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.463545:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 12 pid: 11147 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746147262.463552:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 12 pid: 11147 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746147262.463563:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.463575:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466016000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.463579:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8313 00000100:00100000:1.0:1746147262.463892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.463906:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466015616 00000100:00100000:1.0:1746147262.463909:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466015616 00010000:00010000:1.0:1746147262.463919:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 20 pid: 8478 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.464065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.464087:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016128 00000100:00100000:0.0:1746147262.464089:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016128 00010000:00010000:0.0:1746147262.464100:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 36 pid: 8480 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.465679:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad28d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda28 expref: 11 pid: 11147 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.465695:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467152768:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.465706:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467153024:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.465715:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467153152:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.465749:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.466965:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2831 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9c6 expref: 14 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.466998:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467152128:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.467027:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.467090:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467152640:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.467100:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467152896:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.467125:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467138:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467150:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467190:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467201:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467210:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467216:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a9e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147262.467220:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467231:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467249:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.467255:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdad296c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.467343:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466013952:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15365us (15491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.467362:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16238 00000100:00100000:2.0:1746147262.468242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.468981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.470225:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016512 00000100:00100000:3.0:1746147262.470238:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016512 00010000:00010000:3.0:1746147262.470287:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.472192:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967466015360:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 10254us (10379us total) trans 17179874150 rc 0/0 00000100:00100000:2.0:1746147262.472209:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2648 00002000:00100000:2.0:1746147262.472220:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3473407) req@ffff88009b20b480 x1830967466015360/t17179874150(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.472236:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967466015360 ext(3145728->3473407) 00010000:00010000:2.0:1746147262.472246:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 20 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.472264:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 20 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.472271:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20b480 00000100:00100000:2.0:1746147262.472304:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016384 00000100:00100000:2.0:1746147262.472310:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016384 00002000:00100000:2.0:1746147262.472343:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134ed7100 x1830967466016384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.472355:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7100 with x1830967466016384 ext(0->1048575) 00010000:00010000:2.0:1746147262.472360:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 37 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.472367:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 37 pid: 6881 timeout: 749 lvb_type: 1 00002000:00010000:2.0:1746147262.472372:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed7100 00000100:00100000:2.0:1746147262.472414:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2651 00000100:00100000:2.0:1746147262.472420:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967466016384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.473292:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8314 00000100:00100000:0.0:1746147262.473304:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8315 00000100:00100000:3.0:1746147262.473305:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967466015616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147262.473314:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967466016128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.473317:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.473324:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.473340:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 20 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.473340:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 37 pid: 8480 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.473350:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 20 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.473351:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 37 pid: 8480 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.473370:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad26b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8c3 expref: 20 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.473370:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da3d000/0xb4b2209fbdad2950 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda60 expref: 37 pid: 8480 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.473387:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.473388:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147262.473389:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.473393:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473401:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.473414:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967466016128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (9350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.473421:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8315 00010000:00010000:3.0:1746147262.473427:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147262.473445:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.473448:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967466015616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 150us (9557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.473453:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8314 00010000:00010000:0.0:1746147262.473453:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.473464:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8316 00000100:00100000:3.0:1746147262.473473:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1959:x1830967466016512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.473473:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473479:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.473481:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473486:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.473488:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.473495:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a0c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147262.473499:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473502:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.473506:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473512:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdad2838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9cd expref: 19 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.473518:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.473520:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.473520:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473522:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.473526:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad2973 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473531:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473542:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.473552:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466016512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.473561:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8316 00000100:00100000:0.0:1746147262.473569:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466014080:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 21481us (21693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.473577:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16239 00010000:00010000:3.0:1746147262.473986:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.473993:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474006:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474020:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474025:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474029:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d55a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147262.474031:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474039:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474047:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.474051:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55a00/0xb4b2209fbdad297a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.474098:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466014208:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 20730us (20886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.474103:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16240 00000100:00100000:1.0:1746147262.482469:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1956:x1830967466015488:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 20010us (20111us total) trans 21474841492 rc 0/0 00000100:00100000:1.0:1746147262.482484:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2649 00002000:00100000:1.0:1746147262.482495:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2797568->3145727) req@ffff88009b209180 x1830967466015488/t21474841492(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.482505:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209180 with x1830967466015488 ext(2797568->3145727) 00010000:00010000:1.0:1746147262.482515:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.482528:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.482529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147262.482535:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b209180 00000100:00100000:1.0:1746147262.482567:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016640 00000100:00100000:1.0:1746147262.482574:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016640 00010000:00010000:1.0:1746147262.482597:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.482616:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8317 00000100:00100000:1.0:1746147262.482622:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466016640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.482633:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.482652:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.482661:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.482680:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487000/0xb4b2209fbdad28af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda0c expref: 18 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.482701:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.482703:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.482708:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.482715:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.482739:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.482756:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466016640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 135us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.482762:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8317 00010000:00010000:1.0:1746147262.483830:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483845:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483872:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483879:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483885:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483902:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009531f000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147262.483906:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483913:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483929:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.483935:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009531f000/0xb4b2209fbdad2981 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.484422:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967466016384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11999us (16184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.484438:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2651 00002000:00100000:2.0:1746147262.484446:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134ed7100 x1830967466016384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.484455:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7100 with x1830967466016384 ext(0->1048575) 00010000:00010000:2.0:1746147262.484467:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.484476:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00002000:00010000:2.0:1746147262.484482:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed7100 00000100:00100000:1.0:1746147262.484753:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466014336:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 31356us (31497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.484761:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16241 00000100:00100000:1.0:1746147262.487800:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466015872:12345-192.168.203.36@tcp:4:cat.0 Request processed in 24433us (24526us total) trans 21474841493 rc 0/0 00000100:00100000:1.0:1746147262.487815:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2650 00002000:00100000:1.0:1746147262.487826:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2506751) req@ffff88009b208700 x1830967466015872/t21474841493(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.487839:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208700 with x1830967466015872 ext(2097152->2506751) 00010000:00010000:1.0:1746147262.487849:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.487869:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.487875:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b208700 00000100:00100000:0.0:1746147262.488191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.488570:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016768 00000100:00100000:1.0:1746147262.488581:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016768 00010000:00010000:1.0:1746147262.488602:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.488819:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8318 00000100:00100000:1.0:1746147262.488826:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466016768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.488842:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.488858:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.488871:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.488892:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0xb4b2209fbdad28a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2797568->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9fe expref: 14 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.488907:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147262.491573:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466016768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2732us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.491585:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8318 00000100:00100000:0.0:1746147262.493239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.493443:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466016896 00000100:00100000:1.0:1746147262.493453:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466016896 00010000:00010000:1.0:1746147262.493491:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.493562:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8319 00000100:00100000:1.0:1746147262.493569:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466016896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147262.493589:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.493612:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.493629:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.493655:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdad289a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->2785279] (req 2097152->2506751) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9f7 expref: 19 pid: 6881 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.493673:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.493675:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.493680:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.493688:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.493726:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147262.493982:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494000:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494023:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494035:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494042:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494048:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d65e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147262.494052:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494062:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494088:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.494094:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdad2988 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147262.495011:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967466016896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1438us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.495023:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8319 00000100:00100000:3.0:1746147262.495305:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967466014464:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 41902us (42008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.495315:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16242 00000100:00100000:0.0:1746147262.497893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.498238:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466017024 00000100:00100000:3.0:1746147262.498247:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466017024 00000100:00100000:3.0:1746147262.498300:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16243 00000100:00100000:3.0:1746147262.498307:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+18:32228:x1830967466017024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.498324:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.498341:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda75 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147262.498366:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x821 00010000:00010000:3.0:1746147262.498388:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.498390:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.498398:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.498412:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.498422:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64c00, rc 0) 00000100:00100000:3.0:1746147262.498464:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+19:32228:x1830967466017024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 157us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.498471:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16243 00000100:00100000:1.0:1746147262.498566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.498745:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466017152 00000100:00100000:2.0:1746147262.498750:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466017152 00010000:00010000:2.0:1746147262.498770:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.498839:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8320 00000100:00100000:2.0:1746147262.498845:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967466017152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.498855:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.498870:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.498880:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.498897:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3800/0xb4b2209fbdad282a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed9bf expref: 35 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746147262.498917:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.498919:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.498922:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.498928:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.498965:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147262.498979:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.498990:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499009:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499016:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499022:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499029:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b49ec800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147262.499032:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499042:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499051:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.499055:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdad2965 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.499193:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967466013824:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 47813us (47887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.499200:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16237 00000100:00100000:2.0:1746147262.499226:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967466017152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 382us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.499231:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8320 00000100:00100000:0.0:1746147262.500595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.500862:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466017408 00000100:00100000:2.0:1746147262.500869:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466017408 00000100:00100000:2.0:1746147262.500913:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11588 00000100:00100000:2.0:1746147262.500920:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32223:x1830967466017408:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147262.500994:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.501016:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2942 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda52 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.501033:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.501038:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.502016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147262.502055:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147262.502247:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466017664 00000100:00100000:1.0:1746147262.502257:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466017664 00002000:00100000:1.0:1746147262.502295:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a5a0ed80 x1830967466017664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.502310:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967466017664 ext(1048576->2097151) 00002000:00010000:1.0:1746147262.502314:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:1.0:1746147262.502349:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7749 00000100:00100000:1.0:1746147262.502356:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466017664:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147262.502387:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502393:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502399:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502404:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502409:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 310 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502414:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.502445:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 310 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502455:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 310 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.502468:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153280:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.502555:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502566:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 16 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.502573:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153408:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.502593:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502599:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.502605:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153536:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.502621:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502627:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.502633:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153664:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.502653:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.502659:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 16 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.502665:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153792:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.502679:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.504751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.504775:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466017792 00000100:00100000:0.0:1746147262.504782:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466017792 00010000:00010000:0.0:1746147262.504809:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 311 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.504844:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8321 00000100:00100000:0.0:1746147262.504850:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:1958:x1830967466017792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147262.504858:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153280:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147262.504863:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.504868:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 311 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.504871:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153408:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.504892:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153536:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.504900:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153664:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147262.504955:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 311 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.504977:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2790 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed95d expref: 311 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.504993:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.504997:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.505004:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.505037:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1958:x1830967466017792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 187us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.505043:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8321 00000100:00100000:0.0:1746147262.505087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.505099:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018048 00000100:00100000:0.0:1746147262.505101:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018048 00010000:00010000:0.0:1746147262.505110:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.505122:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8322 00000100:00100000:0.0:1746147262.505126:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1958:x1830967466018048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.505132:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.505135:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505141:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505151:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5600/0xb4b2209fbdad26e1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8e6 expref: 310 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505158:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.505161:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.505166:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.505178:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1958:x1830967466018048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 52us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.505183:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8322 00000100:00100000:0.0:1746147262.505226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.505238:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466017920 00000100:00100000:0.0:1746147262.505240:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466017920 00010000:00010000:0.0:1746147262.505252:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.505263:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8323 00000100:00100000:0.0:1746147262.505267:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1958:x1830967466017920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.505273:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.505276:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505283:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505292:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2766 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed956 expref: 17 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505300:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.505302:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.505307:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.505319:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967466017920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.505323:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8323 00000100:00100000:0.0:1746147262.505351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.505360:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018176 00000100:00100000:0.0:1746147262.505363:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018176 00010000:00010000:0.0:1746147262.505370:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746147262.505381:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8324 00000100:00100000:0.0:1746147262.505385:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967466018176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.505391:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.505394:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505401:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505409:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094df6c00/0xb4b2209fbdad26da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8df expref: 16 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.505423:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.505426:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.505431:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.505442:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967466018176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.505447:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8324 00000100:00100000:0.0:1746147262.507565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.508149:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467153792:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.508238:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147262.508675:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018304 00000100:00100000:3.0:1746147262.508683:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018304 00010000:00010000:3.0:1746147262.508729:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 15 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.508769:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8325 00000100:00100000:3.0:1746147262.508783:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967466018304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.508797:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.508803:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 15 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.508819:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 15 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.508846:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423a00/0xb4b2209fbdad26d3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ed8d8 expref: 15 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.508869:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.508874:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.508882:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.508888:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.508922:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.508997:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1959:x1830967466018304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 220us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.509004:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8325 00010000:00010000:2.0:1746147262.509192:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147262.509198:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000040:00080000:2.0:1746147262.509976:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3486, 88 off292264 00000004:00080000:2.0:1746147262.509984:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497046230ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510051:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3475, 88 off291296 00000004:00080000:2.0:1746147262.510065:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497127703ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510184:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3476, 88 off291384 00000004:00080000:2.0:1746147262.510188:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497251054ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510200:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3487, 88 off292352 00000004:00080000:2.0:1746147262.510203:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497265751ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510223:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3488, 88 off292440 00000004:00080000:2.0:1746147262.510226:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497289245ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510233:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3477, 88 off291472 00000004:00080000:2.0:1746147262.510236:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497299146ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510250:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3478, 88 off291560 00000004:00080000:2.0:1746147262.510253:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497316065ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510260:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3479, 88 off291648 00000004:00080000:2.0:1746147262.510262:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497324973ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510269:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3489, 88 off292528 00000004:00080000:2.0:1746147262.510272:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497334405ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510278:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3480, 88 off291736 00000004:00080000:2.0:1746147262.510353:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497415306ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510382:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3490, 88 off292616 00000004:00080000:2.0:1746147262.510385:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497448341ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510439:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3481, 88 off291824 00000004:00080000:2.0:1746147262.510443:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497506010ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147262.510457:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3491, 88 off292704 00000004:00080000:2.0:1746147262.510460:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497522931ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510467:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3492, 88 off292792 00000004:00080000:2.0:1746147262.510469:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497531928ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510474:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3493, 88 off292880 00000004:00080000:2.0:1746147262.510476:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497539124ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510485:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3494, 88 off292968 00000004:00080000:2.0:1746147262.510487:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649497550314ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147262.510493:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3482, 88 off291912 00000004:00080000:2.0:1746147262.510495:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649497558240ns, next at 607576201812ns, rc = 0 00000100:00100000:0.0:1746147262.516967:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466017664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14603us (14946us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147262.516980:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7749 00002000:00100000:0.0:1746147262.516994:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a5a0ed80 x1830967466017664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.517003:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967466017664 ext(1048576->2097151) 00002000:00010000:0.0:1746147262.517010:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:0.0:1746147262.523695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.523907:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018432 00000100:00100000:2.0:1746147262.523917:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018432 00000100:00100000:2.0:1746147262.524021:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16244 00000100:00100000:2.0:1746147262.524034:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:32228:x1830967466018432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.524057:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.524089:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda7c expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147262.524119:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x81d 00010000:00010000:2.0:1746147262.524146:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.524148:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.524155:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.524577:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.524588:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb82800, rc 0) 00000100:00100000:2.0:1746147262.524648:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:32228:x1830967466018432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 618us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.524654:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16244 00000100:00100000:1.0:1746147262.527237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.527762:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018560 00000100:00100000:0.0:1746147262.527771:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018560 00000100:00100000:0.0:1746147262.527814:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11589 00000100:00100000:0.0:1746147262.527821:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+309:32228:x1830967466018560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147262.527845:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147262.527864:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda83 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.527922:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.527930:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 310 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.527979:0:14047:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147262.527991:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 310 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.528002:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147262.528005:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147262.528008:0:14047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 310 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.528015:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948f5c00, rc 0) 00000100:00100000:0.0:1746147262.528062:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32228:x1830967466018560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 241us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.528068:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11589 00000100:00100000:0.0:1746147262.537008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.537701:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018816 00000100:00100000:2.0:1746147262.537842:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018816 00000100:00100000:2.0:1746147262.538245:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11590 00000100:00100000:2.0:1746147262.538253:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32230:x1830967466018816:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.538273:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.538292:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad29ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda8a expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.538400:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.538416:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.538426:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.538439:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.538444:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.538448:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000001:00080000:1.0:1746147262.538644:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945619 is committed 00000001:00080000:1.0:1746147262.538653:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945602 is committed 00000001:00080000:1.0:1746147262.538659:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945617 is committed 00000001:00080000:1.0:1746147262.538664:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945610 is committed 00000001:00080000:1.0:1746147262.538673:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945621 is committed 00000004:00080000:1.0:1746147262.538678:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2608 committed 00000004:00080000:1.0:1746147262.538685:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2616 committed 00000004:00080000:1.0:1746147262.538691:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2615 committed 00000004:00080000:1.0:1746147262.538692:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2614 committed 00000004:00080000:1.0:1746147262.538694:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2613 committed 00000004:00080000:1.0:1746147262.538696:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2607 committed 00000004:00080000:1.0:1746147262.538697:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2612 committed 00000004:00080000:1.0:1746147262.538699:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2606 committed 00000004:00080000:1.0:1746147262.538700:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2611 committed 00000004:00080000:1.0:1746147262.538701:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2605 committed 00000004:00080000:1.0:1746147262.538703:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2604 committed 00000004:00080000:1.0:1746147262.538705:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2603 committed 00000004:00080000:1.0:1746147262.538706:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2610 committed 00000004:00080000:1.0:1746147262.538708:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2609 committed 00000004:00080000:1.0:1746147262.538709:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2602 committed 00000004:00080000:1.0:1746147262.538710:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2601 committed 00000004:00080000:1.0:1746147262.538711:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2608 committed 00000001:00080000:1.0:1746147262.538715:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945620 is committed 00000100:00100000:0.0:1746147262.538898:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.538959:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.538997:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.539016:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467153920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539017:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539028:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539037:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.539041:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539054:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154304 00000100:00100000:0.0:1746147262.539057:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154304 00000100:00100000:1.0:1746147262.539059:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539092:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154816 00000100:00100000:0.0:1746147262.539094:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154816 00000100:00100000:1.0:1746147262.539100:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539104:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155328 00000100:00100000:0.0:1746147262.539105:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155328 00000100:00100000:0.0:1746147262.539113:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467153920 00000100:00100000:1.0:1746147262.539114:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539114:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467153920 00000100:00100000:1.0:1746147262.539125:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539127:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154432 00000100:00100000:0.0:1746147262.539128:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154432 00000100:00100000:0.0:1746147262.539132:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154944 00000100:00100000:0.0:1746147262.539133:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154944 00000100:00100000:1.0:1746147262.539137:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539139:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16245 00000100:00100000:0.0:1746147262.539143:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967467154304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539146:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746147262.539150:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539161:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.539167:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.539184:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.539194:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.539200:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.539217:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.539236:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155456 00000100:00100000:1.0:1746147262.539240:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155456 00000100:00100000:1.0:1746147262.539253:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154048 00000100:00100000:1.0:1746147262.539255:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154048 00000100:00100000:1.0:1746147262.539261:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154560 00000100:00100000:1.0:1746147262.539263:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154560 00000100:00100000:1.0:1746147262.539269:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155072 00000100:00100000:1.0:1746147262.539270:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155072 00000100:00100000:1.0:1746147262.539275:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155584 00000100:00100000:1.0:1746147262.539277:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155584 00000100:00100000:1.0:1746147262.539284:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16246 00000100:00100000:1.0:1746147262.539288:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3294:x1830967467154816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539291:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3294:x1830967467154304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (332us total) trans 21474841494 rc 0/0 00000100:00100000:0.0:1746147262.539296:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16245 00000100:00100000:0.0:1746147262.539307:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16247 00000100:00100000:0.0:1746147262.539310:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3294:x1830967467155328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.539381:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3294:x1830967467154816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (370us total) trans 21474841495 rc 0/0 00000100:00100000:1.0:1746147262.539386:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16246 00000100:00100000:0.0:1746147262.539391:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467155328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (361us total) trans 17179874151 rc 0/0 00000100:00100000:0.0:1746147262.539394:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16247 00000100:00100000:1.0:1746147262.539397:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16248 00000100:00100000:1.0:1746147262.539401:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467153920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539401:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16249 00000100:00100000:0.0:1746147262.539403:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467154432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539456:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3295:x1830967467154432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (371us total) trans 21474841496 rc 0/0 00000100:00100000:0.0:1746147262.539459:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16249 00000100:00100000:0.0:1746147262.539469:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16250 00000100:00100000:0.0:1746147262.539472:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3295:x1830967467154944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147262.539473:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147262.539476:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147262.539478:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147262.539480:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:1.0:1746147262.539483:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147262.539501:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3295:x1830967467153920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (459us total) trans 21474841497 rc 0/0 00000100:00100000:1.0:1746147262.539506:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16248 00000100:00100000:1.0:1746147262.539516:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16251 00000100:00100000:1.0:1746147262.539521:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467155456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539522:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467154944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (407us total) trans 17179874152 rc 0/0 00000100:00100000:0.0:1746147262.539527:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16250 00000100:00100000:0.0:1746147262.539533:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16252 00000100:00100000:0.0:1746147262.539535:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467154048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147262.539581:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147262.539583:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147262.539584:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147262.539585:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147262.539587:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147262.539599:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3295:x1830967467154048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (437us total) trans 21474841498 rc 0/0 00000100:00100000:1.0:1746147262.539601:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467155456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (462us total) trans 17179874153 rc 0/0 00000100:00100000:0.0:1746147262.539602:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16252 00000100:00100000:1.0:1746147262.539609:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16251 00000100:00100000:0.0:1746147262.539613:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16253 00000100:00100000:0.0:1746147262.539616:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967467154560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539618:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16254 00000100:00100000:1.0:1746147262.539622:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3295:x1830967467155072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147262.539658:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:0.0:1746147262.539660:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147262.539661:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147262.539662:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147262.539663:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147262.539673:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3295:x1830967467154560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (494us total) trans 21474841499 rc 0/0 00000100:00100000:0.0:1746147262.539676:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16253 00000100:00100000:0.0:1746147262.539682:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16255 00000100:00100000:0.0:1746147262.539684:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467155584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.539698:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467155072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (502us total) trans 17179874154 rc 0/0 00000100:00100000:1.0:1746147262.539703:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16254 00000100:00100000:0.0:1746147262.539732:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967467155584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (515us total) trans 17179874155 rc 0/0 00000100:00100000:0.0:1746147262.539736:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16255 00000004:00080000:1.0:1746147262.539742:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9880/2, rc 0, transno 21474841498 00000100:00100000:1.0:1746147262.539747:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539752:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147262.539754:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f0000/2, rc 0, transno 21474841499 00000100:00100000:1.0:1746147262.539757:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147262.539764:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f0e00/2, rc 0, transno 17179874154 00000004:00080000:0.0:1746147262.539765:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f0700/2, rc 0, transno 21474841495 00000100:00100000:0.0:1746147262.539767:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539771:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147262.539772:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f1500/2, rc 0, transno 17179874151 00000100:00100000:0.0:1746147262.539775:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147262.539778:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f1c00/2, rc 0, transno 17179874155 00000004:00080000:0.0:1746147262.539778:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9500/2, rc 0, transno 21474841494 00000100:00100000:0.0:1746147262.539780:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.539781:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539784:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746147262.539787:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147262.539788:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047480/2, rc 0, transno 21474841497 00000100:00100000:1.0:1746147262.539790:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467153920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147262.539796:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e682a00/2, rc 0, transno 21474841496 00000100:00100000:1.0:1746147262.539798:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147262.539804:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f0a80/2, rc 0, transno 17179874152 00000100:00100000:1.0:1746147262.539807:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467154944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539809:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147262.539812:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f1880/2, rc 0, transno 17179874153 00000100:00100000:1.0:1746147262.539815:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539822:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.539834:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539841:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.539848:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155840 00000100:00100000:1.0:1746147262.539850:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155840 00000100:00100000:0.0:1746147262.539851:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154176 00000100:00100000:0.0:1746147262.539852:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154176 00000100:00100000:1.0:1746147262.539862:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467154688 00000100:00100000:0.0:1746147262.539863:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155200 00000100:00100000:1.0:1746147262.539864:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467154688 00000100:00100000:0.0:1746147262.539864:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155200 00000100:00100000:0.0:1746147262.539869:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155712 00000100:00100000:0.0:1746147262.539870:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155712 00000100:00100000:1.0:1746147262.539873:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16256 00000100:00100000:1.0:1746147262.539877:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467155840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.539877:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16257 00000100:00100000:0.0:1746147262.539880:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3294:x1830967467154176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.539962:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467154176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (158us total) trans 21474841500 rc 0/0 00000100:00100000:0.0:1746147262.539965:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16257 00000100:00100000:0.0:1746147262.539972:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16258 00000100:00100000:0.0:1746147262.539975:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830967467155200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.539983:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3294:x1830967467155840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (229us total) trans 17179874156 rc 0/0 00000100:00100000:1.0:1746147262.539988:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16256 00000100:00100000:1.0:1746147262.539997:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16259 00000100:00100000:1.0:1746147262.540002:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3294:x1830967467154688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.540029:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830967467155200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (199us total) trans 17179874157 rc 0/0 00000100:00100000:0.0:1746147262.540033:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16258 00000100:00100000:0.0:1746147262.540039:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16260 00000100:00100000:0.0:1746147262.540041:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3294:x1830967467155712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.540085:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3294:x1830967467154688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (264us total) trans 21474841501 rc 0/0 00000100:00100000:1.0:1746147262.540090:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16259 00000100:00100000:1.0:1746147262.540107:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.540113:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830967467155712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (269us total) trans 17179874158 rc 0/0 00000100:00100000:0.0:1746147262.540118:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16260 00000100:00100000:1.0:1746147262.540124:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.540134:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467155968 00000100:00100000:0.0:1746147262.540136:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467155968 00000100:00100000:0.0:1746147262.540149:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16261 00000100:00100000:0.0:1746147262.540152:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967467155968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.540221:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830967467155968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (97us total) trans 17179874159 rc 0/0 00000004:00010000:3.0:1746147262.540226:0:14048:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5a0ce00 reply state ffff8800941e0c00 transno 8589945621 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147262.540226:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16261 00000100:00100000:3.0:1746147262.540240:0:14048:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746147262.540242:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9c00/2, rc 0, transno 21474841500 00000100:00100000:0.0:1746147262.540245:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147262.540251:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f0380/2, rc 0, transno 21474841501 00000100:00100000:0.0:1746147262.540253:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467154688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147262.540261:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f1180/2, rc 0, transno 17179874157 00000100:00100000:0.0:1746147262.540263:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147262.540268:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f1f80/2, rc 0, transno 17179874158 00000100:00100000:0.0:1746147262.540270:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147262.540276:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f2300/2, rc 0, transno 17179874156 00000100:00100000:0.0:1746147262.540278:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467155840:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746147262.540314:0:14048:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147262.540326:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32223:x1830967466017408:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 39405us (39733us total) trans 8589945621 rc 0/0 00000100:00100000:3.0:1746147262.540333:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11588 00010000:00010000:3.0:1746147262.540357:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.540364:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.540369:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.540375:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b49ec600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.540378:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.540384:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.540397:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.540399:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147262.540404:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.540414:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.540420:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.540444:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.540453:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830967467156096:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.540498:0:3280:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147262.541200:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.541213:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 7 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.541220:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.541242:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 7 pid: 14047 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147262.541259:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478c380/2, rc 0, transno 17179874159 00000100:00100000:1.0:1746147262.541265:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467155968:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147262.541411:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 7 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.541422:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467156224:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.541680:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.545384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.545447:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830967467156096:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.545478:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147262.545486:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdad2996 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147262.545503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.545555:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466018944 00000100:00100000:1.0:1746147262.545563:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466018944 00000100:00100000:1.0:1746147262.545604:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4873 00000100:00100000:1.0:1746147262.545612:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32228:x1830967466018944:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147262.545734:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32228:x1830967466018944:12345-192.168.203.36@tcp:49:cat.0 Request processed in 122us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.545741:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4873 00000100:00100000:2.0:1746147262.545890:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019072 00000100:00100000:2.0:1746147262.545895:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019072 00000100:00100000:2.0:1746147262.545923:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11591 00000100:00100000:2.0:1746147262.545928:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32223:x1830967466019072:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147262.545968:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.545984:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda91 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.546024:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.546038:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.546054:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.546058:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147262.546061:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b26800, rc 0) 00000100:00100000:2.0:1746147262.546098:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32223:x1830967466019072:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 170us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.546104:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11591 00000100:00100000:2.0:1746147262.548822:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467156224:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.548850:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147262.549838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.549958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.550033:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019200 00000100:00100000:1.0:1746147262.550036:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019328 00000100:00100000:2.0:1746147262.550041:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019200 00000100:00100000:1.0:1746147262.550041:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019328 00010000:00010000:2.0:1746147262.550085:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 9 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.550104:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11592 00000100:00100000:2.0:1746147262.550109:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8326 00000100:00100000:1.0:1746147262.550111:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32223:x1830967466019328:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147262.550113:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466019200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.550125:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147262.550128:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.550130:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 9 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.550139:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 9 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.550141:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb3a00/0xb4b2209fbdad29ce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda98 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.550156:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009531f600/0xb4b2209fbdad2918 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda44 expref: 10 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.550170:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.550174:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.550181:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.550187:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.550205:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147262.550218:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147262.550225:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147262.550232:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:2.0:1746147262.550243:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466019200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.550250:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8326 00000004:00200000:1.0:1746147262.550256:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:1.0:1746147262.550260:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147262.550275:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147262.550835:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb3a00/0xb4b2209fbdad29ce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 9 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.550836:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.550845:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147262.550849:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 8 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.550855:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00000004:00200000:2.0:1746147262.550856:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147262.550857:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147262.550859:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb2a00, rc 0) 00000100:00100000:1.0:1746147262.550895:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32223:x1830967466019328:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 784us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.550900:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11592 00010000:00010000:2.0:1746147262.551145:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551153:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551159:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551165:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a0c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.551169:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551175:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551184:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.551187:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147262.551190:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551195:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0c00/0xb4b2209fbdad29c0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551209:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551214:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551222:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551226:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eb83e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.551229:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551234:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551240:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.551242:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.551245:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551250:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83e00/0xb4b2209fbdad29b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551258:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551263:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551268:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551272:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b196400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.551274:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551279:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551289:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76f00) 00010000:00010000:2.0:1746147262.551291:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.551293:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551297:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b196400/0xb4b2209fbdad29b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.551334:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad29ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda8a expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.551341:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad29ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda8a expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.551349:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb82400, rc 0) 00000100:00100000:2.0:1746147262.551372:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32230:x1830967466018816:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 13120us (14374us total) trans 8589945622 rc 301/301 00000100:00100000:2.0:1746147262.551378:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11590 00000100:00100000:0.0:1746147262.554455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.554497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.554525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.554540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.554568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.554590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.554610:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019456 00000100:00100000:0.0:1746147262.554610:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019712 00000100:00100000:1.0:1746147262.554618:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019456 00000100:00100000:0.0:1746147262.554618:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019712 00000100:00100000:0.0:1746147262.554653:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019968 00000100:00100000:0.0:1746147262.554655:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019968 00000100:00100000:3.0:1746147262.554708:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019584 00000100:00100000:3.0:1746147262.554718:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019584 00000100:00100000:1.0:1746147262.554763:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466019840 00000100:00100000:1.0:1746147262.554766:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466019840 00000100:00100000:1.0:1746147262.554780:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466020096 00000100:00100000:1.0:1746147262.554782:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466020096 00000100:00100000:1.0:1746147262.554796:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16262 00000100:00100000:1.0:1746147262.554803:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466019712:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147262.554821:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.554840:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edaad expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.554870:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.554872:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.554882:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.554896:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147262.554901:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16263 00010000:00010000:1.0:1746147262.554907:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbf600, rc 0) 00000100:00100000:2.0:1746147262.554909:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466019456:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147262.554916:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.554930:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eda9f expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147262.554975:0:17530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x81f 00000100:00100000:1.0:1746147262.554977:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466019712:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 173us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.554982:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16262 00010000:00010000:2.0:1746147262.554985:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.554986:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.554993:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.555002:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147262.555002:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16264 00000100:00100000:1.0:1746147262.555007:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466019840:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147262.555008:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b94a400, rc 0) 00010000:00010000:1.0:1746147262.555012:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.555021:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edab4 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.555023:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466019456:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 117us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.555027:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16263 00002000:00010000:1.0:1746147262.555031:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x821 00010000:00010000:1.0:1746147262.555037:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.555038:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.555042:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.555049:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.555056:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540400, rc 0) 00000100:00100000:1.0:1746147262.555067:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466019840:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 60us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.555082:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16264 00000100:00100000:1.0:1746147262.555092:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16265 00000100:00100000:1.0:1746147262.555096:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466020096:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147262.555100:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.555107:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edac2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147262.555122:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417be, atime: 0x681417be, ctime: 0x681417be, blocks: 0x102b 00010000:00010000:1.0:1746147262.555128:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.555129:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.555132:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.555139:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.555145:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540c00, rc 0) 00000100:00100000:1.0:1746147262.555157:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466020096:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 61us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.555161:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16265 00000100:00100000:0.0:1746147262.555244:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16266 00000100:00100000:0.0:1746147262.555251:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466019968:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147262.555256:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147262.555258:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16267 00010000:00010000:0.0:1746147262.555264:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edabb expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.555267:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466019584:12345-192.168.203.36@tcp:101:mirror_io.0 00002000:00010000:0.0:1746147262.555280:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417be, atime: 0x681417bd, ctime: 0x681417be, blocks: 0x163f 00010000:00010000:3.0:1746147262.555284:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147262.555287:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.555288:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.555293:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.555301:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edaa6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.555301:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147262.555307:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00000100:00100000:0.0:1746147262.555322:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466019968:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 73us (797us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147262.555324:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.555325:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147262.555327:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16266 00010000:00010000:3.0:1746147262.555334:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.555347:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.555362:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422c00, rc 0) 00000100:00100000:3.0:1746147262.555408:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466019584:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 142us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.555413:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16267 00000100:00100000:0.0:1746147262.555910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.556004:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466020352 00000100:00100000:2.0:1746147262.556008:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466020352 00002000:00100000:2.0:1746147262.556037:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5ba0000 x1830967466020352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.556047:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0000 with x1830967466020352 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.556052:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba0000 00000100:00100000:2.0:1746147262.556092:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7750 00000100:00100000:2.0:1746147262.556098:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967466020352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.565462:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967466020352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9352us (9540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.565475:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7750 00002000:00100000:2.0:1746147262.565488:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5ba0000 x1830967466020352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.565499:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0000 with x1830967466020352 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.565505:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba0000 00000100:00100000:0.0:1746147262.565667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.565798:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466020608 00000100:00100000:3.0:1746147262.565807:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466020608 00000100:00100000:3.0:1746147262.566321:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11593 00000100:00100000:3.0:1746147262.566329:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32230:x1830967466020608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.566350:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.566353:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147262.566379:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948f5c00/0xb4b2209fbdad29a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda83 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.566403:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.566407:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147262.566420:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2a0d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edac9 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.566475:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.566487:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.566494:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 7 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.566754:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.566784:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 7 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.566794:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 7 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.566805:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467156352:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.567136:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.567143:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 7 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.567150:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467156480:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.567175:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.568423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.568455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.568516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.568576:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466020864 00000100:00100000:3.0:1746147262.568583:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466020864 00010000:00010000:3.0:1746147262.568609:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 8 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.568628:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466020736 00000100:00100000:3.0:1746147262.568631:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466020736 00010000:00010000:3.0:1746147262.568638:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 9 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.568657:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8327 00000100:00100000:3.0:1746147262.568662:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967466020864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.568672:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.568677:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 9 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.568687:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 9 pid: 14048 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.568705:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.568709:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.568715:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.568719:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.568755:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1958:x1830967466020864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.568761:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8327 00000100:00100000:3.0:1746147262.568774:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8328 00000100:00100000:3.0:1746147262.568779:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967466020736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.568785:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.568789:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 8 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.568800:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 8 pid: 14047 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.568817:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.568820:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.568826:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.568831:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.568846:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.568860:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1958:x1830967466020736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.568865:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8328 00000100:00100000:3.0:1746147262.568884:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466020992 00000100:00100000:3.0:1746147262.568886:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466020992 00000100:00100000:3.0:1746147262.568928:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16268 00000100:00100000:3.0:1746147262.568933:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+34:32228:x1830967466020992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.568963:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.568976:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edad0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.569010:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.569012:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.569019:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 35 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.569034:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 35 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.569043:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aeb600, rc 0) 00000100:00100000:3.0:1746147262.569059:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:32228:x1830967466020992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 126us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.569064:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16268 00010000:00010000:3.0:1746147262.569116:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb2a00/0xb4b2209fbdad29d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda98 expref: 7 pid: 14047 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.569129:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467156352:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.569138:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b26800/0xb4b2209fbdad29c7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda91 expref: 6 pid: 14048 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.569147:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467156480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.569164:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.569189:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.569194:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:3.0:1746147262.570290:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3495, 88 off293056 00000004:00080000:3.0:1746147262.570297:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649557359795ns, next at 592568729900ns, rc = 0 00000100:00100000:0.0:1746147262.570671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.571615:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466021120 00000100:00100000:1.0:1746147262.571621:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466021120 00000100:00100000:1.0:1746147262.571658:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11594 00000100:00100000:1.0:1746147262.571664:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32228:x1830967466021120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.571678:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.572158:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edad7 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746147262.572177:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3483, 88 off292000 00000004:00080000:3.0:1746147262.572183:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559245894ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572207:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3484, 88 off292088 00000004:00080000:3.0:1746147262.572210:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559272709ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572221:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3496, 88 off293144 00000004:00080000:3.0:1746147262.572224:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559286479ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572242:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3497, 88 off293232 00000004:00080000:3.0:1746147262.572245:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559307609ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572252:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3485, 88 off292176 00000004:00080000:3.0:1746147262.572255:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559317809ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572261:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3486, 88 off292264 00000004:00080000:3.0:1746147262.572263:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559325689ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572267:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3487, 88 off292352 00000004:00080000:3.0:1746147262.572269:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559331479ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572276:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3498, 88 off293320 00000004:00080000:3.0:1746147262.572278:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559341201ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572286:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3488, 88 off292440 00000004:00080000:3.0:1746147262.572289:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559351584ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572296:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3499, 88 off293408 00000004:00080000:3.0:1746147262.572299:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559361554ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572306:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3489, 88 off292528 00000004:00080000:3.0:1746147262.572309:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559371922ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147262.572316:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3500, 88 off293496 00000004:00080000:3.0:1746147262.572319:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559381860ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572326:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3501, 88 off293584 00000004:00080000:3.0:1746147262.572328:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559391150ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572335:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3502, 88 off293672 00000004:00080000:3.0:1746147262.572337:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559400196ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572346:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3503, 88 off293760 00000004:00080000:3.0:1746147262.572348:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649559411281ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147262.572357:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3490, 88 off292616 00000004:00080000:3.0:1746147262.572359:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649559421874ns, next at 607576201812ns, rc = 0 00010000:00010000:1.0:1746147262.572393:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147262.572401:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 305 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.572417:0:14047:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147262.572426:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 305 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.572438:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147262.572440:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147262.572443:0:14047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 305 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.572448:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541e00, rc 0) 00000100:00100000:1.0:1746147262.572490:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32228:x1830967466021120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 827us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.572494:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11594 00000001:00080000:1.0:1746147262.613795:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945622 is committed 00000001:00080000:1.0:1746147262.613810:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945623 is committed 00000004:00080000:1.0:1746147262.613814:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2616 committed 00000004:00080000:1.0:1746147262.613821:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2625 committed 00000004:00080000:1.0:1746147262.613827:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2624 committed 00000004:00080000:1.0:1746147262.613828:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2623 committed 00000004:00080000:1.0:1746147262.613830:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2622 committed 00000004:00080000:1.0:1746147262.613832:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2615 committed 00000004:00080000:1.0:1746147262.613834:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2621 committed 00000004:00080000:1.0:1746147262.613835:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2614 committed 00000004:00080000:1.0:1746147262.613837:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2620 committed 00000004:00080000:1.0:1746147262.613839:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2613 committed 00000004:00080000:1.0:1746147262.613840:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2612 committed 00000004:00080000:1.0:1746147262.613842:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2611 committed 00000004:00080000:1.0:1746147262.613843:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2619 committed 00000004:00080000:1.0:1746147262.613845:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2618 committed 00000004:00080000:1.0:1746147262.613847:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2610 committed 00000004:00080000:1.0:1746147262.613848:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2609 committed 00000004:00080000:1.0:1746147262.613849:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2617 committed 00000100:00100000:1.0:1746147262.614024:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467156992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.614100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.614141:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467157504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.614155:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.614171:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147262.614175:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467156608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.614187:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.614195:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467157120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.614206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.614225:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467156992 00000100:00100000:1.0:1746147262.614232:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467156992 00000100:00100000:1.0:1746147262.614262:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467157504 00000100:00100000:1.0:1746147262.614263:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467157504 00000100:00100000:1.0:1746147262.614272:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467156608 00000100:00100000:1.0:1746147262.614273:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467156608 00000100:00100000:1.0:1746147262.614280:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467157120 00000100:00100000:1.0:1746147262.614282:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467157120 00000100:00100000:1.0:1746147262.614297:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16269 00000100:00100000:1.0:1746147262.614303:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830967467156992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147262.614322:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16270 00000100:00100000:3.0:1746147262.614331:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3295:x1830967467157504:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147262.614392:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.614404:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.614406:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147262.614410:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.614420:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.614426:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.614452:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.614462:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467157632:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.614520:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467156736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147262.614527:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.614770:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467156864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.614913:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.614913:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3295:x1830967467156992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 609us (813us total) trans 17179874160 rc 0/0 00000100:00100000:1.0:1746147262.614920:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16269 00000100:00100000:3.0:1746147262.614922:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3295:x1830967467157504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 592us (764us total) trans 17179874161 rc 0/0 00000100:00100000:3.0:1746147262.614928:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16270 00000100:00100000:2.0:1746147262.614928:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467157248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.614935:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467156736 00000100:00100000:1.0:1746147262.614951:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467156736 00000100:00100000:3.0:1746147262.614955:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16271 00000100:00100000:2.0:1746147262.614958:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147262.614960:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830967467156608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.614964:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467157248 00000100:00100000:1.0:1746147262.614966:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467157248 00000100:00100000:2.0:1746147262.614972:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467157888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.614973:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16272 00000100:00100000:1.0:1746147262.614977:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3295:x1830967467157120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.614987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147262.614994:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467158400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147262.615006:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147262.615042:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147262.615045:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147262.615047:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147262.615049:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147262.615051:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147262.615088:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3295:x1830967467156608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (880us total) trans 17179874162 rc 0/0 00000100:00100000:1.0:1746147262.615089:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3295:x1830967467157120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (881us total) trans 17179874163 rc 0/0 00000100:00100000:3.0:1746147262.615093:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16271 00000100:00100000:1.0:1746147262.615096:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16272 00000100:00100000:3.0:1746147262.615101:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467157888 00000100:00100000:3.0:1746147262.615103:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467157888 00000100:00100000:1.0:1746147262.615105:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158400 00000100:00100000:1.0:1746147262.615107:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158400 00000100:00100000:3.0:1746147262.615115:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16273 00000100:00100000:3.0:1746147262.615118:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3293:x1830967467156736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147262.615122:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16274 00000100:00100000:2.0:1746147262.615127:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16275 00000100:00100000:1.0:1746147262.615127:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3293:x1830967467157248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.615132:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3293:x1830967467157888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.615205:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967467157248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (246us total) trans 17179874164 rc 0/0 00000100:00100000:1.0:1746147262.615210:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16274 00000100:00100000:1.0:1746147262.615219:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16276 00000100:00100000:1.0:1746147262.615222:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3293:x1830967467158400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147262.615235:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147262.615238:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147262.615240:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147262.615242:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147262.615243:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746147262.615261:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3293:x1830967467157888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (272us total) trans 21474841502 rc 0/0 00000100:00100000:2.0:1746147262.615266:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16275 00002000:00010000:1.0:1746147262.615294:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00000100:00100000:2.0:1746147262.615295:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467157760:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147262.615297:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147262.615298:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147262.615300:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147262.615302:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:2.0:1746147262.615313:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.615315:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3293:x1830967467158400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (309us total) trans 21474841503 rc 0/0 00000100:00100000:1.0:1746147262.615320:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16276 00000100:00100000:2.0:1746147262.615322:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.615327:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467157760 00000100:00100000:1.0:1746147262.615330:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467157760 00000100:00100000:2.0:1746147262.615336:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147262.615339:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158272 00000100:00100000:1.0:1746147262.615340:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158272 00000100:00100000:2.0:1746147262.615344:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147262.615346:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16277 00000100:00100000:2.0:1746147262.615348:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.615350:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967467157760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147262.615364:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147262.615370:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147262.615382:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147262.615394:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158144 00000100:00100000:2.0:1746147262.615396:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158144 00002000:00010000:1.0:1746147262.615417:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147262.615419:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00000100:00100000:2.0:1746147262.615420:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158656 00002000:00010000:1.0:1746147262.615421:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00000100:00100000:2.0:1746147262.615422:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158656 00002000:00010000:1.0:1746147262.615423:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00000100:00100000:2.0:1746147262.615432:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16278 00000100:00100000:2.0:1746147262.615436:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467158272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147262.615458:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147262.615480:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467157760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (166us total) trans 21474841504 rc 0/0 00000100:00100000:1.0:1746147262.615485:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16277 00000100:00100000:1.0:1746147262.615494:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16279 00000100:00100000:1.0:1746147262.615498:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467158144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147262.615518:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467158272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (180us total) trans 21474841505 rc 0/0 00000100:00100000:2.0:1746147262.615523:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16278 00000100:00100000:2.0:1746147262.615531:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16280 00000100:00100000:2.0:1746147262.615534:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3296:x1830967467158656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.615572:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467158144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (207us total) trans 21474841506 rc 0/0 00000100:00100000:1.0:1746147262.615577:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16279 00002000:00010000:3.0:1746147262.615579:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147262.615581:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147262.615583:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147262.615585:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:3.0:1746147262.615587:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147262.615600:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3296:x1830967467158656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (217us total) trans 21474841507 rc 0/0 00000100:00100000:2.0:1746147262.615605:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16280 00000100:00100000:3.0:1746147262.615607:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967467156736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 488us (693us total) trans 17179874165 rc 0/0 00000100:00100000:3.0:1746147262.615612:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16273 00000004:00080000:2.0:1746147262.615622:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ba2d80/2, rc 0, transno 21474841506 00000004:00080000:1.0:1746147262.615622:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ba1880/2, rc 0, transno 21474841502 00000100:00100000:2.0:1746147262.615626:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.615626:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467157888:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147262.615632:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f2680/2, rc 0, transno 21474841507 00000004:00080000:1.0:1746147262.615632:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f151180/2, rc 0, transno 21474841503 00000100:00100000:2.0:1746147262.615634:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147262.615634:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467158400:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147262.615639:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ba1c00/2, rc 0, transno 21474841504 00000100:00100000:2.0:1746147262.615641:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467157760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147262.615641:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478ce00/2, rc 0, transno 17179874165 00000004:00080000:2.0:1746147262.615646:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f150000/2, rc 0, transno 21474841505 00000100:00100000:1.0:1746147262.615647:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467156736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.615649:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147262.615652:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478dc00/2, rc 0, transno 17179874164 00000100:00100000:1.0:1746147262.615655:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467157248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.615690:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.615832:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147262.615902:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158784 00000100:00100000:3.0:1746147262.615906:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158784 00000100:00100000:0.0:1746147262.615919:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147262.615922:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16281 00000100:00100000:3.0:1746147262.615926:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3296:x1830967467158784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.615928:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467156864 00000100:00100000:2.0:1746147262.615930:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467156864 00000100:00100000:0.0:1746147262.615933:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467157376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147262.615958:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16282 00000100:00100000:2.0:1746147262.615962:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3294:x1830967467156864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147262.615963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.615972:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467158016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.615987:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.615995:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467158528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147262.616007:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147262.616026:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467157376 00000100:00100000:0.0:1746147262.616029:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467157376 00000100:00100000:3.0:1746147262.616035:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3296:x1830967467158784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (202us total) trans 17179874166 rc 0/0 00002000:00010000:2.0:1746147262.616038:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00000100:00100000:3.0:1746147262.616040:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16281 00002000:00010000:2.0:1746147262.616040:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147262 -> 1746147262 00002000:00010000:2.0:1746147262.616042:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00000100:00100000:0.0:1746147262.616042:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158016 00002000:00010000:2.0:1746147262.616044:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147262 -> 1746147262 00000100:00100000:0.0:1746147262.616044:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158016 00002000:00010000:2.0:1746147262.616046:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:3.0:1746147262.616050:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467158528 00000100:00100000:3.0:1746147262.616052:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467158528 00000100:00100000:0.0:1746147262.616053:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16283 00000100:00100000:0.0:1746147262.616057:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3294:x1830967467157376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147262.616062:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16284 00000100:00100000:3.0:1746147262.616065:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3294:x1830967467158016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147262.616066:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3294:x1830967467156864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (147us total) trans 17179874167 rc 0/0 00000100:00100000:2.0:1746147262.616084:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16282 00000100:00100000:2.0:1746147262.616094:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16285 00000100:00100000:2.0:1746147262.616098:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3294:x1830967467158528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147262.616148:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147262.616151:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147262 -> 1746147262 00002000:00010000:3.0:1746147262.616152:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147262 -> 1746147262 00002000:00010000:3.0:1746147262.616154:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147262 -> 1746147262 00002000:00010000:3.0:1746147262.616155:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746147262.616156:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3294:x1830967467157376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (191us total) trans 17179874168 rc 0/0 00000100:00100000:2.0:1746147262.616160:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3294:x1830967467158528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (152us total) trans 21474841509 rc 0/0 00000100:00100000:0.0:1746147262.616161:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16283 00000100:00100000:2.0:1746147262.616164:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16285 00000100:00100000:3.0:1746147262.616174:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830967467158016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (186us total) trans 21474841508 rc 0/0 00000100:00100000:3.0:1746147262.616179:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16284 00000004:00080000:2.0:1746147262.616183:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478d180/2, rc 0, transno 17179874167 00000100:00100000:2.0:1746147262.616186:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467156864:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147262.616191:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478df80/2, rc 0, transno 17179874168 00000100:00100000:2.0:1746147262.616193:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467157376:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147262.616199:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ba1f80/2, rc 0, transno 21474841508 00000004:00080000:3.0:1746147262.616201:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478f480/2, rc 0, transno 17179874166 00000100:00100000:2.0:1746147262.616201:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467158016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147262.616205:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467158784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147262.616207:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3f2a00/2, rc 0, transno 21474841509 00000100:00100000:2.0:1746147262.616209:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467158528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147262.616222:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467157632:192.168.203.36@tcp:105: 00000004:00080000:0.0:1746147262.616225:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478ca80/2, rc 0, transno 17179874162 00000100:00100000:0.0:1746147262.616228:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467156608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147262.616234:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478d880/2, rc 0, transno 17179874163 00000100:00100000:0.0:1746147262.616236:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467157120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147262.616241:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478d500/2, rc 0, transno 17179874160 00000100:00100000:0.0:1746147262.616243:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467156992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147262.616248:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a478e300/2, rc 0, transno 17179874161 00010000:00010000:3.0:1746147262.616249:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad2a0d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 303 pid: 14049 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746147262.616250:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467157504:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147262.616264:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.616289:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85c3800, rc 0) 00000100:00100000:3.0:1746147262.616317:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32230:x1830967466020608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 49990us (50652us total) trans 8589945623 rc 0/0 00000100:00100000:3.0:1746147262.616325:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11593 00000100:00100000:2.0:1746147262.616539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.616694:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466021248 00000100:00100000:3.0:1746147262.616697:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466021248 00000100:00100000:3.0:1746147262.616789:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4874 00000100:00100000:3.0:1746147262.616795:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32228:x1830967466021248:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:3.0:1746147262.616928:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32228:x1830967466021248:12345-192.168.203.36@tcp:49:cat.0 Request processed in 132us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.616934:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4874 00000100:00100000:0.0:1746147262.618126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.618207:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466021376 00000100:00100000:3.0:1746147262.618212:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466021376 00000100:00100000:3.0:1746147262.618239:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4875 00000100:00100000:3.0:1746147262.618246:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32230:x1830967466021376:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:3.0:1746147262.618382:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32230:x1830967466021376:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 134us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.618388:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4875 00000100:00100000:0.0:1746147262.622258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.622626:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466021632 00000100:00100000:2.0:1746147262.622637:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466021632 00002000:00100000:2.0:1746147262.622685:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009b208380 x1830967466021632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.622696:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208380 with x1830967466021632 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.622703:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208380 00000100:00100000:2.0:1746147262.622727:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7751 00000100:00100000:2.0:1746147262.622734:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967466021632:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.631229:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967466021632:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8483us (8986us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.631242:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7751 00002000:00100000:2.0:1746147262.631254:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009b208380 x1830967466021632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.631264:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208380 with x1830967466021632 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.631270:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208380 00000100:00100000:0.0:1746147262.639215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.639243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.639270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.639304:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466021760 00000100:00100000:0.0:1746147262.639304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.639314:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466021760 00000100:00100000:2.0:1746147262.639369:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466021888 00000100:00100000:2.0:1746147262.639371:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466021888 00000100:00100000:2.0:1746147262.639385:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466022016 00000100:00100000:2.0:1746147262.639387:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466022016 00000100:00100000:2.0:1746147262.639397:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466022144 00000100:00100000:2.0:1746147262.639399:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466022144 00000100:00100000:1.0:1746147262.639418:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16286 00000100:00100000:0.0:1746147262.639432:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16287 00000100:00100000:1.0:1746147262.639433:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32230:x1830967466021760:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147262.639438:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16288 00000100:00100000:0.0:1746147262.639441:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967466021888:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147262.639443:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967466022016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.639451:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147262.639459:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16289 00010000:00010000:0.0:1746147262.639461:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147262.639463:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967466022144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.639466:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edade expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.639470:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147262.639474:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edae5 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.639480:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edaf3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.639491:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.639493:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.639493:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.639495:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.639495:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.639498:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 39 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.639502:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.639503:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.639503:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 39 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.639504:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.639506:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1294336->1576959] (req 1294336->1576959) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.639516:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147262.639516:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 39 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.639525:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb2400, rc 0) 00010000:00010000:0.0:1746147262.639525:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486400, rc 0) 00010000:00010000:1.0:1746147262.639528:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 39 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.639536:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 39 pid: 8478 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.639545:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467158912:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.639568:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967466021888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 129us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147262.639574:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16287 00000100:00100000:2.0:1746147262.639620:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967466022144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 154us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.639625:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16289 00010000:00010000:2.0:1746147262.639640:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.639646:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edaec expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.639656:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.639657:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.639661:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 39 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.639670:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 39 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.639677:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb3a00, rc 0) 00000100:00100000:2.0:1746147262.639697:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967466022016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 254us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.639702:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16288 00010000:00010000:1.0:1746147262.639977:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.639984:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 10 pid: 4445 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.640002:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467159040:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.640133:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147262.642177:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467158912:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.642189:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467159040:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.642218:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1294336->1576959] (req 1294336->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 38 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.642231:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423800, rc 0) 00000100:00100000:1.0:1746147262.642277:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:32230:x1830967466021760:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2849us (3073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.642284:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16286 00000100:00100000:0.0:1746147262.643051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.643139:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466022400 00000100:00100000:2.0:1746147262.643149:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466022400 00010000:00010000:2.0:1746147262.643188:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 38 pid: 8478 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.643223:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8329 00000100:00100000:2.0:1746147262.643230:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967466022400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.643244:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.643265:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 38 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.643276:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 38 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.643297:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad0 expref: 38 pid: 8478 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.643324:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.643371:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967466022400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.643377:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8329 00000100:00100000:1.0:1746147262.643565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.643617:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466022272 00000100:00100000:0.0:1746147262.643623:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466022272 00010000:00010000:0.0:1746147262.643647:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 11 pid: 4445 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746147262.643669:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8330 00000100:00100000:0.0:1746147262.643676:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466022272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147262.643690:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147262.643707:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 11 pid: 4445 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746147262.643717:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 11 pid: 4445 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746147262.643734:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdad29f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edab4 expref: 11 pid: 4445 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746147262.644183:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.644186:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147262.644193:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.644202:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147262.644230:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.644241:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467159168:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.644246:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.644335:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466022656 00000100:00100000:3.0:1746147262.644340:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466022656 00000100:00100000:3.0:1746147262.644365:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11595 00000100:00100000:3.0:1746147262.644370:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+6:32235:x1830967466022656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.644384:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.644396:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c600/0xb4b2209fbdad2a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edafa expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.644475:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644489:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644497:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644508:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644513:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644518:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644606:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644613:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644618:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147262.644625:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147262.644724:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644731:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644736:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644744:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a477d400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.644747:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644752:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644760:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.644762:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147262.644766:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644769:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d400/0xb4b2209fbdad2a5a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644782:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644786:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644790:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644794:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a477d800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.644796:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644799:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644804:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147262.644806:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.644808:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644812:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644818:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644822:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644826:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644830:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a477dc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.644832:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644835:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644840:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9e00) 00010000:00010000:3.0:1746147262.644842:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.644844:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644848:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2a53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.644876:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c600/0xb4b2209fbdad2a45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edafa expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.644883:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c600/0xb4b2209fbdad2a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edafa expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.644890:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477c600, rc 0) 00000100:00100000:0.0:1746147262.644969:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.645856:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32235:x1830967466022656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1483us (1607us total) trans 8589945624 rc 301/301 00000100:00100000:3.0:1746147262.645863:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11595 00000100:00100000:2.0:1746147262.649715:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467159168:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.649736:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.649771:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466022272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6095us (6206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.649781:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8330 00000100:00100000:0.0:1746147262.649899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.650006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.650245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.650551:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466023040 00000100:00100000:3.0:1746147262.650556:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466023040 00000100:00100000:3.0:1746147262.650566:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466023552 00000100:00100000:3.0:1746147262.650567:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466023552 00002000:00100000:3.0:1746147262.650592:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a5a0ca80 x1830967466023552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.650601:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ca80 with x1830967466023552 ext(3145728->4194303) 00002000:00010000:3.0:1746147262.650605:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ca80 00000100:00100000:3.0:1746147262.650840:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7752 00000100:00100000:3.0:1746147262.650848:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967466023552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.651988:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024320 00000100:00100000:3.0:1746147262.651993:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024320 00000100:00100000:3.0:1746147262.653180:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11596 00000100:00100000:3.0:1746147262.653190:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32234:x1830967466024320:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.653208:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.653224:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56000/0xb4b2209fbdad2a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb08 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.653306:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653318:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653328:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653339:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653344:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653349:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653436:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653442:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653448:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147262.653455:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147262.653513:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653519:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653523:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653528:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130aeb600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.653530:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653536:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653544:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.653546:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147262.653549:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653553:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb600/0xb4b2209fbdad2a7d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653564:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653568:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653572:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653575:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d57c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.653577:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653581:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653587:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147262.653588:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.653591:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653595:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad2a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653601:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653605:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653615:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653618:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d56600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.653621:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653625:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653630:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099ff9400) 00010000:00010000:3.0:1746147262.653632:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.653634:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653638:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56600/0xb4b2209fbdad2a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147262.653670:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56000/0xb4b2209fbdad2a68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb08 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.653677:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d56000/0xb4b2209fbdad2a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb08 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.653682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.653683:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d56000, rc 0) 00000100:00100000:3.0:1746147262.653712:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32234:x1830967466024320:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 524us (3705us total) trans 8589945625 rc 301/301 00000100:00100000:3.0:1746147262.653717:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11596 00002000:00100000:3.0:1746147262.653754:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a5a0d500 x1830967466023040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.653762:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d500 with x1830967466023040 ext(3145728->4194303) 00002000:00010000:3.0:1746147262.653766:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d500 00000100:00100000:3.0:1746147262.653777:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466022912 00000100:00100000:3.0:1746147262.653781:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466022912 00000100:00100000:1.0:1746147262.653784:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7753 00002000:00100000:3.0:1746147262.653789:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800998e4050 x1830967466022912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147262.653793:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967466023040:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147262.653795:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e4050 with x1830967466022912 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.653798:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800998e4050 00000100:00100000:3.0:1746147262.653813:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7754 00000100:00100000:3.0:1746147262.653818:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967466022912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.654016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.654154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.654181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.654203:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024064 00000100:00100000:2.0:1746147262.654208:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024064 00000100:00100000:2.0:1746147262.654237:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11597 00000100:00100000:2.0:1746147262.654242:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32235:x1830967466024064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.654255:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.654268:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2a8b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb01 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.654325:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.654335:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.654344:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147262.654369:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147262.654373:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147262.654385:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147262.654406:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2a8b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.654423:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.654429:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.654431:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147262.654434:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb83600, rc 0) 00000100:00100000:2.0:1746147262.654467:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32235:x1830967466024064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 224us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.654472:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11597 00000100:00100000:3.0:1746147262.654781:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466023424 00000100:00100000:3.0:1746147262.654786:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466023424 00002000:00100000:3.0:1746147262.654805:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800a4670000 x1830967466023424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.654811:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670000 with x1830967466023424 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.654815:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4670000 00000100:00100000:1.0:1746147262.654820:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466023936 00000100:00100000:1.0:1746147262.654824:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466023936 00000100:00100000:3.0:1746147262.654833:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7755 00000100:00100000:3.0:1746147262.654839:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466023424:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:1.0:1746147262.654840:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1294336->1298431) req@ffff88012ecedc00 x1830967466023936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.654847:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedc00 with x1830967466023936 ext(1294336->1298431) 00002000:00010000:1.0:1746147262.654850:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecedc00 00000100:00100000:1.0:1746147262.654878:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7756 00000100:00100000:1.0:1746147262.654883:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967466023936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147262.654962:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967466023936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 78us (806us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147262.654967:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7756 00002000:00100000:1.0:1746147262.654972:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1294336->1298431) req@ffff88012ecedc00 x1830967466023936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.654979:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedc00 with x1830967466023936 ext(1294336->1298431) 00002000:00010000:1.0:1746147262.654982:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecedc00 00000100:00100000:0.0:1746147262.661277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.661309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.661326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.661339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.661368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.661391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.662021:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024448 00000100:00100000:3.0:1746147262.662031:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024448 00000100:00100000:3.0:1746147262.662080:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024576 00000100:00100000:3.0:1746147262.662082:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024576 00000100:00100000:3.0:1746147262.662095:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024704 00000100:00100000:3.0:1746147262.662096:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024704 00000100:00100000:3.0:1746147262.662105:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024832 00000100:00100000:3.0:1746147262.662106:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024832 00000100:00100000:3.0:1746147262.662114:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466024960 00000100:00100000:3.0:1746147262.662115:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466024960 00000100:00100000:3.0:1746147262.662122:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466025088 00000100:00100000:3.0:1746147262.662124:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466025088 00000100:00100000:3.0:1746147262.662134:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16290 00000100:00100000:3.0:1746147262.662142:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466024448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.662161:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.662178:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb0f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.662201:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.662203:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.662213:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.662228:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.662239:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094060000, rc 0) 00000100:00100000:3.0:1746147262.662286:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967466024448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.662292:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16290 00000100:00100000:3.0:1746147262.662307:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16291 00000100:00100000:3.0:1746147262.662313:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967466024576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.662320:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.662330:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb16 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.662341:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.662342:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.662346:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.662356:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.662363:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094061e00, rc 0) 00000100:00100000:3.0:1746147262.662379:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967466024576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 67us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.662384:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16291 00000100:00100000:3.0:1746147262.662393:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16292 00000100:00100000:3.0:1746147262.662396:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967466024704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.662402:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.662408:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb1d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.662419:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.662420:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.662424:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.662437:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.662443:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477d800, rc 0) 00000100:00100000:3.0:1746147262.662458:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967466024704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 61us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.662462:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16292 00000100:00100000:3.0:1746147262.662471:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16293 00000100:00100000:3.0:1746147262.662475:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466024832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147262.662481:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.662487:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a477d400/0xb4b2209fbdad2aae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb24 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.662523:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159296:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147262.662577:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.663086:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466023552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12238us (12840us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.663093:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7752 00002000:00100000:3.0:1746147262.663102:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800a5a0ca80 x1830967466023552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.663110:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ca80 with x1830967466023552 ext(3145728->4194303) 00002000:00010000:3.0:1746147262.663115:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ca80 00000100:00100000:1.0:1746147262.663916:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16294 00000100:00100000:1.0:1746147262.663926:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967466024960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.663951:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.663963:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb2b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.663978:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.663980:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.663986:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.663996:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.664004:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423e00, rc 0) 00000100:00100000:1.0:1746147262.664023:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466024960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 100us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.664028:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16294 00000100:00100000:1.0:1746147262.664043:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16295 00000100:00100000:1.0:1746147262.664065:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1956:x1830967466025088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.664081:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.664090:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb32 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.664100:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.664101:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.664106:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.664114:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147262.664121:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422400, rc 0) 00000100:00100000:1.0:1746147262.664135:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967466025088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 87us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.664140:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16295 00000100:00100000:2.0:1746147262.668195:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967466022912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14365us (14506us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.668206:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7754 00002000:00100000:2.0:1746147262.668219:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800998e4050 x1830967466022912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.668228:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e4050 with x1830967466022912 ext(2097152->3145727) 00002000:00010000:2.0:1746147262.668233:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800998e4050 00002000:00010000:3.0:1746147262.669560:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147261 -> 1746147262 00002000:00010000:3.0:1746147262.669567:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147261 -> 1746147262 00002000:00010000:3.0:1746147262.669569:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147261 -> 1746147262 00000100:00100000:3.0:1746147262.669590:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159296:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147262.669621:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a477d400/0xb4b2209fbdad2aae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb24 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.669634:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a477d400/0xb4b2209fbdad2aae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb24 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.669644:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477d400, rc 0) 00000100:00100000:3.0:1746147262.670309:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466024832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7829us (8966us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147262.670309:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967466023040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16514us (20407us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.670318:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16293 00000100:00100000:1.0:1746147262.670318:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7753 00002000:00100000:1.0:1746147262.670326:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a5a0d500 x1830967466023040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.670334:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d500 with x1830967466023040 ext(3145728->4194303) 00002000:00010000:1.0:1746147262.670337:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d500 00000100:00100000:3.0:1746147262.672358:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967466023424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17512us (18339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.672369:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7755 00002000:00100000:3.0:1746147262.672377:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800a4670000 x1830967466023424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.672385:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670000 with x1830967466023424 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.672389:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4670000 00000100:00100000:0.0:1746147262.672616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.672686:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466025344 00000100:00100000:3.0:1746147262.672693:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466025344 00002000:00100000:3.0:1746147262.672727:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1572864->1576959) req@ffff88009b6a1880 x1830967466025344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.672735:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1880 with x1830967466025344 ext(1572864->1576959) 00002000:00010000:3.0:1746147262.672739:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a1880 00000100:00100000:3.0:1746147262.672764:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7757 00000100:00100000:3.0:1746147262.672771:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967466025344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.672910:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967466025344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 139us (294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147262.672915:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7757 00002000:00100000:3.0:1746147262.672920:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1572864->1576959) req@ffff88009b6a1880 x1830967466025344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.672927:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1880 with x1830967466025344 ext(1572864->1576959) 00002000:00010000:3.0:1746147262.672930:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a1880 00000100:00100000:0.0:1746147262.673064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.673166:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466025472 00000100:00100000:3.0:1746147262.673169:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466025472 00000100:00100000:3.0:1746147262.673562:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16296 00000100:00100000:3.0:1746147262.673569:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32234:x1830967466025472:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.673579:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.673598:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb39 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.673624:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.673633:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.673641:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.673647:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.673649:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.673652:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [3403776->3678207] (req 3403776->3678207) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.673682:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.673693:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 36 pid: 11147 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.673705:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159424:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.673988:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.673996:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 20 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.674004:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159552:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.674293:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147262.674301:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 9 pid: 8480 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.674314:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159680:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.674333:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.675972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.676031:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466025728 00000100:00100000:1.0:1746147262.676041:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466025728 00000100:00100000:3.0:1746147262.676057:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.676067:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159552:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.676105:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4876 00000100:00100000:1.0:1746147262.676113:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32230:x1830967466025728:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147262.676289:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32230:x1830967466025728:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 177us (321us total) trans 8589945626 rc 0/0 00000100:00100000:1.0:1746147262.676296:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4876 00000100:00100000:0.0:1746147262.679309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.679331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.679350:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466025984 00000100:00100000:2.0:1746147262.679360:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466025984 00010000:00010000:2.0:1746147262.679395:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 10 pid: 8480 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746147262.679403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.679420:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466025856 00000100:00100000:2.0:1746147262.679421:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466025856 00010000:00010000:2.0:1746147262.679429:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 21 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.679442:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8331 00000100:00100000:2.0:1746147262.679449:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466025984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.679461:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147262.679464:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466026112 00000100:00100000:1.0:1746147262.679468:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466026112 00010000:00010000:2.0:1746147262.679482:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 10 pid: 8480 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.679491:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16297 00010000:00010000:2.0:1746147262.679493:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 10 pid: 8480 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.679496:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967466026112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.679509:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.679519:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147262.679521:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a477d400/0xb4b2209fbdad2aca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb40 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.679537:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.679545:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a477d400/0xb4b2209fbdad2aca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb40 expref: 38 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147262.679550:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8332 00000100:00100000:2.0:1746147262.679555:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466025984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147262.679555:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a477d400/0xb4b2209fbdad2aca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb40 expref: 38 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147262.679559:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967466025856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147262.679561:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8331 00010000:00010000:1.0:1746147262.679565:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477d400, rc 0) 00010000:00010000:3.0:1746147262.679568:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.679578:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 21 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.679583:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967466026112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 87us (180us total) trans 0 rc 301/301 00010000:00010000:3.0:1746147262.679588:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 21 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.679588:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16297 00010000:00010000:3.0:1746147262.679600:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423e00/0xb4b2209fbdad2ab5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb2b expref: 21 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.679612:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.679673:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967466025856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.679679:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8332 00010000:00010000:3.0:1746147262.679721:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad29ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edabb expref: 9 pid: 8480 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.679735:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467159680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147262.679763:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3403776->3678207] (req 3403776->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.679772:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064200, rc 0) 00000100:00100000:3.0:1746147262.679789:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32234:x1830967466025472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6221us (6724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.679794:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16296 00000100:00100000:0.0:1746147262.681148:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.681261:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466026368 00000100:00100000:1.0:1746147262.681266:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466026368 00002000:00100000:1.0:1746147262.681297:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b6a2680 x1830967466026368/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.681306:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a2680 with x1830967466026368 ext(0->1048575) 00002000:00010000:1.0:1746147262.681311:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a2680 00000100:00100000:1.0:1746147262.681447:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7758 00000100:00100000:1.0:1746147262.681453:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466026368:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.686427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.686457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.686478:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466026624 00000100:00100000:2.0:1746147262.686487:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466026624 00002000:00100000:2.0:1746147262.686526:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012ecef100 x1830967466026624/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.686540:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef100 with x1830967466026624 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.686545:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecef100 00000100:00100000:2.0:1746147262.686561:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466026880 00000100:00100000:2.0:1746147262.686564:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466026880 00002000:00100000:2.0:1746147262.686574:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012ecece00 x1830967466026880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.686580:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967466026880 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.686583:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:2.0:1746147262.686667:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7759 00000100:00100000:2.0:1746147262.686675:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466026624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147262.686762:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7760 00000100:00100000:3.0:1746147262.686780:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466026880:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147262.687315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.687346:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466027008 00000100:00100000:3.0:1746147262.687353:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466027008 00000100:00100000:0.0:1746147262.687369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.687375:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 37 pid: 11147 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.687398:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8333 00000100:00100000:3.0:1746147262.687403:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967466027008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.687411:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.687426:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 37 pid: 11147 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.687436:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 37 pid: 11147 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746147262.687451:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466027136 00000100:00100000:1.0:1746147262.687456:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466027136 00010000:00010000:3.0:1746147262.687457:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094eb3a00/0xb4b2209fbdad2a3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaec expref: 37 pid: 11147 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.687470:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.687472:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.687477:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.687484:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147262.687493:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16298 00000100:00100000:1.0:1746147262.687499:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:32228:x1830967466027136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.687509:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.687510:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.687518:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467159808:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147262.687523:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb47 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.687545:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.687552:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147262.687554:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147262.687558:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.687577:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147262.687582:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.687593:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 20 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.687608:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467159936:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.687644:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.692134:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467159808:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147262.692134:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467159936:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.692135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.692154:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147262.692164:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.692180:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477d600, rc 0) 00000100:00100000:3.0:1746147262.692229:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967466027008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4824us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.692240:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8333 00000100:00100000:1.0:1746147262.692242:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:32228:x1830967466027136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4743us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.692250:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16298 00000100:00100000:1.0:1746147262.692746:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466026368:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11292us (11602us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147262.692753:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7758 00002000:00100000:1.0:1746147262.692762:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b6a2680 x1830967466026368/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.692772:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a2680 with x1830967466026368 ext(0->1048575) 00002000:00010000:1.0:1746147262.692776:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a2680 00000100:00100000:1.0:1746147262.692789:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466027392 00000100:00100000:1.0:1746147262.692794:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466027392 00002000:00100000:1.0:1746147262.692816:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3403776->3407871) req@ffff88009b6a2a00 x1830967466027392/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.692823:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a2a00 with x1830967466027392 ext(3403776->3407871) 00010000:00010000:1.0:1746147262.692829:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.692841:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.692848:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a2a00 00000100:00100000:1.0:1746147262.693063:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2652 00000100:00100000:1.0:1746147262.693080:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466027392:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147262.693204:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1956:x1830967466027392:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 134us (1077us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147262.693209:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2652 00002000:00100000:1.0:1746147262.693214:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3403776->3407871) req@ffff88009b6a2a00 x1830967466027392/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.693221:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a2a00 with x1830967466027392 ext(3403776->3407871) 00010000:00010000:1.0:1746147262.693226:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.693234:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.693239:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a2a00 00000100:00100000:3.0:1746147262.701119:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466026880:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14335us (14649us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.701133:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7760 00002000:00100000:3.0:1746147262.701146:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012ecece00 x1830967466026880/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.701163:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967466026880 ext(1048576->2097151) 00002000:00010000:3.0:1746147262.701170:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:2.0:1746147262.706310:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466026624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 19624us (19881us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.706322:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7759 00002000:00100000:2.0:1746147262.706334:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012ecef100 x1830967466026624/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.706343:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef100 with x1830967466026624 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.706350:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecef100 00000100:00100000:0.0:1746147262.711356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.712531:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466027648 00000100:00100000:2.0:1746147262.712543:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466027648 00002000:00100000:2.0:1746147262.712631:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3674112->3678207) req@ffff88009b6a3b80 x1830967466027648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.712641:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3b80 with x1830967466027648 ext(3674112->3678207) 00010000:00010000:2.0:1746147262.712651:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.712666:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.712673:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a3b80 00000100:00100000:2.0:1746147262.713037:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2653 00000100:00100000:2.0:1746147262.713045:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466027648:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.713355:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466027648:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 310us (2006us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147262.713362:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2653 00002000:00100000:2.0:1746147262.713368:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3674112->3678207) req@ffff88009b6a3b80 x1830967466027648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.713374:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3b80 with x1830967466027648 ext(3674112->3678207) 00010000:00010000:2.0:1746147262.713380:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.713389:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 19 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.713395:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a3b80 00000100:00100000:0.0:1746147262.715177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.715243:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466027776 00000100:00100000:1.0:1746147262.715252:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466027776 00000100:00100000:1.0:1746147262.715302:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16299 00000100:00100000:1.0:1746147262.715309:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32235:x1830967466027776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.715327:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.715346:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb4e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.715375:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.715383:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147262.715385:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147262.715388:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.715426:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.715437:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 36 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746147262.715449:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467160064:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.715545:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.715696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.715782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.715794:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466028032 00000100:00100000:2.0:1746147262.715798:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466028032 00002000:00100000:2.0:1746147262.715825:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3403776->3678207) req@ffff88009b6a0000 x1830967466028032/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.715834:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0000 with x1830967466028032 ext(3403776->3678207) 00010000:00010000:2.0:1746147262.715841:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 21 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.715851:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 21 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.715857:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a0000 00000100:00100000:1.0:1746147262.715890:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466028288 00000100:00100000:1.0:1746147262.715894:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466028288 00000100:00100000:1.0:1746147262.715923:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4877 00000100:00100000:1.0:1746147262.715928:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32234:x1830967466028288:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147262.716004:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2654 00000100:00100000:2.0:1746147262.716013:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466028032:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147262.716309:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32234:x1830967466028288:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 379us (526us total) trans 8589945627 rc 0/0 00000100:00100000:1.0:1746147262.716318:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4877 00000100:00100000:1.0:1746147262.717562:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467160064:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147262.717582:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.717595:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094060200, rc 0) 00000100:00100000:1.0:1746147262.717618:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32235:x1830967466027776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2310us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.717624:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16299 00000100:00100000:0.0:1746147262.719011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.719033:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466028416 00000100:00100000:3.0:1746147262.719040:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466028416 00002000:00100000:3.0:1746147262.719083:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1294336->1576959) req@ffff88009b6a1f80 x1830967466028416/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.719092:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1f80 with x1830967466028416 ext(1294336->1576959) 00010000:00010000:3.0:1746147262.719099:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 37 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.719109:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 37 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.719115:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a1f80 00000100:00100000:3.0:1746147262.719132:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2655 00000100:00100000:3.0:1746147262.719138:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967466028416:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147262.721494:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466028032:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 5475us (5791us total) trans 17179874169 rc 0/0 00000100:00100000:2.0:1746147262.721505:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2654 00002000:00100000:2.0:1746147262.721514:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3403776->3678207) req@ffff88009b6a0000 x1830967466028032/t17179874169(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.721523:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0000 with x1830967466028032 ext(3403776->3678207) 00010000:00010000:2.0:1746147262.721530:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.721542:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.721549:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a0000 00000100:00100000:3.0:1746147262.724632:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967466028416:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5484us (5615us total) trans 17179874170 rc 0/0 00000100:00100000:3.0:1746147262.724645:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2655 00002000:00100000:3.0:1746147262.724656:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1294336->1576959) req@ffff88009b6a1f80 x1830967466028416/t17179874170(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.724666:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1f80 with x1830967466028416 ext(1294336->1576959) 00010000:00010000:3.0:1746147262.724675:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.724689:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.724695:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a1f80 00000100:00100000:0.0:1746147262.725672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.726432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.726504:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466028544 00000100:00100000:3.0:1746147262.726505:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466028672 00000100:00100000:3.0:1746147262.726512:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466028672 00000100:00100000:2.0:1746147262.726512:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466028544 00010000:00010000:3.0:1746147262.726539:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.726565:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.726571:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8334 00000100:00100000:3.0:1746147262.726577:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967466028672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.726589:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.726609:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.726619:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.726631:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8335 00010000:00010000:3.0:1746147262.726640:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094423800/0xb4b2209fbdad2a29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1576959) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edade expref: 39 pid: 8481 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.726657:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466028544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.726658:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.726660:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.726667:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.726680:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.726682:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.726711:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.726714:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.726723:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467160192:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.726724:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.726751:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064200/0xb4b2209fbdad2ac3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3678207) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb39 expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.726776:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.726778:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147262.726782:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00010000:00010000:2.0:1746147262.726782:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.726803:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.726835:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.726844:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467160320:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.726902:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.732704:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467160192:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147262.732704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147262.732723:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.732740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.732771:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967466028672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6192us (6336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.732771:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467160320:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.732780:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8334 00010000:00010000:2.0:1746147262.732793:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.732811:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466028928 00000100:00100000:3.0:1746147262.732815:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466028928 00000100:00100000:2.0:1746147262.732834:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466028544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6195us (7162us total) trans 0 rc 0/0 00002000:00100000:3.0:1746147262.732842:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6a1500 x1830967466028928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147262.732843:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8335 00002000:00100000:3.0:1746147262.732850:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1500 with x1830967466028928 ext(4194304->4976639) 00002000:00010000:3.0:1746147262.732854:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a1500 00000100:00100000:3.0:1746147262.732869:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466029184 00000100:00100000:3.0:1746147262.732872:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466029184 00002000:00100000:3.0:1746147262.732884:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e977b80 x1830967466029184/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147262.732884:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7761 00002000:00100000:3.0:1746147262.732891:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977b80 with x1830967466029184 ext(1048576->2097151) 00000100:00100000:2.0:1746147262.732893:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967466028928:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:3.0:1746147262.732894:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977b80 00000100:00100000:3.0:1746147262.732921:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7762 00000100:00100000:3.0:1746147262.732927:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466029184:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147262.742044:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466029184:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9109us (9295us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.742055:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7762 00002000:00100000:3.0:1746147262.742064:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e977b80 x1830967466029184/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.743180:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977b80 with x1830967466029184 ext(1048576->2097151) 00002000:00010000:3.0:1746147262.743185:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977b80 00000100:00100000:3.0:1746147262.745155:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967466028928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12258us (12453us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147262.745166:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7761 00002000:00100000:3.0:1746147262.745176:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6a1500 x1830967466028928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.745183:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1500 with x1830967466028928 ext(4194304->4976639) 00002000:00010000:3.0:1746147262.745188:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a1500 00000100:00100000:0.0:1746147262.747155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.747228:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466029312 00000100:00100000:1.0:1746147262.747236:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466029312 00000100:00100000:1.0:1746147262.747291:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16300 00000100:00100000:1.0:1746147262.747298:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32235:x1830967466029312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147262.747310:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147262.747325:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb55 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.747344:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.747345:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147262.747351:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.747363:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147262.747372:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477dc00, rc 0) 00000100:00100000:1.0:1746147262.747423:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32235:x1830967466029312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 125us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147262.747427:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16300 00000100:00100000:0.0:1746147262.750375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.750487:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466029440 00000100:00100000:2.0:1746147262.750495:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466029440 00000100:00100000:2.0:1746147262.750541:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16301 00000100:00100000:2.0:1746147262.750545:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967466029440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.750558:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.750570:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb5c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.750584:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.750585:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.750591:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.750607:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.750617:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31d800, rc 0) 00000100:00100000:2.0:1746147262.750667:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967466029440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.750673:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16301 00000100:00100000:0.0:1746147262.758651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.758764:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466029696 00000100:00100000:1.0:1746147262.758774:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466029696 00000100:00100000:1.0:1746147262.758831:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4878 00000100:00100000:1.0:1746147262.758837:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32228:x1830967466029696:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147262.759044:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32228:x1830967466029696:12345-192.168.203.36@tcp:35:cat.0 Request processed in 206us (403us total) trans 8589945628 rc 0/0 00000100:00100000:1.0:1746147262.759049:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4878 00000100:00100000:0.0:1746147262.768280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.768323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.768353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.768381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.768415:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466029952 00000100:00100000:2.0:1746147262.768427:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466029952 00000100:00100000:0.0:1746147262.768432:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466030208 00000100:00100000:0.0:1746147262.768439:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466030208 00002000:00100000:2.0:1746147262.768469:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e975180 x1830967466029952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.768471:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e974e00 x1830967466030208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.768477:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975180 with x1830967466029952 ext(2097152->3145727) 00002000:00100000:0.0:1746147262.768479:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967466030208 ext(3145728->4194303) 00002000:00010000:2.0:1746147262.768483:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975180 00002000:00010000:0.0:1746147262.768483:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974e00 00000100:00100000:2.0:1746147262.768504:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466030464 00000100:00100000:2.0:1746147262.768507:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466030464 00002000:00100000:2.0:1746147262.768519:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e974a80 x1830967466030464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.768526:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974a80 with x1830967466030464 ext(2097152->3145727) 00002000:00010000:2.0:1746147262.768529:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974a80 00000100:00100000:0.0:1746147262.768676:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466030592 00000100:00100000:0.0:1746147262.768679:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466030592 00002000:00100000:0.0:1746147262.768695:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e974700 x1830967466030592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.768702:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974700 with x1830967466030592 ext(3145728->4194303) 00002000:00010000:0.0:1746147262.768705:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974700 00000100:00100000:0.0:1746147262.768717:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7763 00000100:00100000:0.0:1746147262.768725:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466029952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.769492:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7764 00000100:00100000:0.0:1746147262.769501:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7765 00000100:00100000:2.0:1746147262.769502:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466030208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147262.769510:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1956:x1830967466030464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147262.770654:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7766 00000100:00100000:1.0:1746147262.770663:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466030592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.781824:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466030208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12312us (13488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.781838:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7764 00002000:00100000:2.0:1746147262.781850:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008e974e00 x1830967466030208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.781861:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967466030208 ext(3145728->4194303) 00002000:00010000:2.0:1746147262.781867:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974e00 00000100:00100000:3.0:1746147262.784854:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466029952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16118us (16575us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.784865:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7763 00002000:00100000:3.0:1746147262.784877:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e975180 x1830967466029952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.784886:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975180 with x1830967466029952 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.784893:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975180 00000100:00100000:1.0:1746147262.790417:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466030592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19743us (22021us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147262.790429:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7766 00002000:00100000:1.0:1746147262.790440:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008e974700 x1830967466030592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.790450:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974700 with x1830967466030592 ext(3145728->4194303) 00002000:00010000:1.0:1746147262.790456:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974700 00000100:00100000:1.0:1746147262.795803:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1956:x1830967466030464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26281us (27436us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147262.795816:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7765 00002000:00100000:1.0:1746147262.795828:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008e974a80 x1830967466030464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.795843:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974a80 with x1830967466030464 ext(2097152->3145727) 00002000:00010000:1.0:1746147262.795849:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974a80 00000100:00100000:0.0:1746147262.806461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.806568:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466030976 00000100:00100000:1.0:1746147262.806579:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466030976 00002000:00100000:1.0:1746147262.806632:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88008e977480 x1830967466030976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.806642:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967466030976 ext(4194304->4976639) 00002000:00010000:1.0:1746147262.806647:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977480 00000100:00100000:1.0:1746147262.806684:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7767 00000100:00100000:1.0:1746147262.806692:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466030976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147262.813008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.813542:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466031232 00000100:00100000:3.0:1746147262.813557:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466031232 00000100:00100000:3.0:1746147262.813610:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11598 00000100:00100000:3.0:1746147262.813616:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32241:x1830967466031232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147262.813638:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147262.813656:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f9e00/0xb4b2209fbdad2aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb63 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.813771:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813784:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813795:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813809:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813814:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813818:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813919:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813926:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.813971:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147262.813981:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147262.814062:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814078:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814084:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814089:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eb82400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.814092:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814098:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814109:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147262.814111:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147262.814115:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814120:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82400/0xb4b2209fbdad2b02 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814144:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814149:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814157:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814161:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f31c200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.814164:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814168:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814174:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147262.814176:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.814178:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814182:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c200/0xb4b2209fbdad2af4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814190:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814195:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814200:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814204:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eb82600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147262.814206:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814210:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814219:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4b00) 00010000:00010000:3.0:1746147262.814221:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147262.814223:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814226:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb82600/0xb4b2209fbdad2afb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.814255:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f9e00/0xb4b2209fbdad2aed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb63 expref: 306 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.814264:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f9e00/0xb4b2209fbdad2aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb63 expref: 306 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.814272:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f9e00, rc 0) 00000100:00100000:3.0:1746147262.814322:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32241:x1830967466031232:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 704us (1325us total) trans 8589945629 rc 301/301 00000100:00100000:3.0:1746147262.814328:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11598 00000100:00100000:1.0:1746147262.814600:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466030976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7909us (8227us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147262.814607:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7767 00002000:00100000:1.0:1746147262.814615:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88008e977480 x1830967466030976/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.814623:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967466030976 ext(4194304->4976639) 00002000:00010000:1.0:1746147262.814626:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977480 00000100:00100000:0.0:1746147262.819378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.819451:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466031360 00000100:00100000:2.0:1746147262.819461:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466031360 00000100:00100000:0.0:1746147262.820308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.820334:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466031616 00000100:00100000:0.0:1746147262.820337:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466031616 00000100:00100000:0.0:1746147262.820369:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4879 00000100:00100000:0.0:1746147262.820376:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32235:x1830967466031616:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147262.820633:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32235:x1830967466031616:12345-192.168.203.36@tcp:35:cat.0 Request processed in 253us (320us total) trans 8589945630 rc 0/0 00000100:00100000:0.0:1746147262.820639:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4879 00000100:00100000:2.0:1746147262.820844:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16302 00000100:00100000:2.0:1746147262.820851:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:32241:x1830967466031360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.820865:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.820883:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb6a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.820909:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.820917:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.820924:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.820926:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.820930:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3051520->3145727] (req 3051520->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.820984:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.820996:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 21 pid: 8480 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.821009:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467160448:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.821097:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.821106:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.821120:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467160576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.821145:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.824815:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467160448:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.824830:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467160576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.824857:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3051520->3145727] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.824873:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486600, rc 0) 00000100:00100000:2.0:1746147262.824921:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+40:32241:x1830967466031360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4067us (5549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.824929:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16302 00000100:00100000:0.0:1746147262.826214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.826291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.826343:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466031744 00000100:00100000:3.0:1746147262.826351:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466031744 00010000:00010000:3.0:1746147262.826378:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 22 pid: 8480 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.826395:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466031872 00000100:00100000:3.0:1746147262.826396:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466031872 00010000:00010000:3.0:1746147262.826402:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.826411:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8336 00000100:00100000:3.0:1746147262.826416:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466031744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.826430:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.826452:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 22 pid: 8480 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.826463:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 22 pid: 8480 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.826483:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a477dc00/0xb4b2209fbdad2adf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb55 expref: 22 pid: 8480 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.826511:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.826538:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967466031744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.826545:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8336 00000100:00100000:3.0:1746147262.826556:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8337 00000100:00100000:3.0:1746147262.826559:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967466031872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.826565:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.826570:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.826577:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.826585:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a477d600/0xb4b2209fbdad2ad1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb47 expref: 40 pid: 8480 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.826595:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.826596:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.826601:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 39 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.826607:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 39 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.826629:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 39 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.826637:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467160704:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.826688:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.829730:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467160704:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.829755:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.829814:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967466031872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3251us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.829826:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8337 00000100:00100000:0.0:1746147262.833909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.833968:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466032000 00000100:00100000:2.0:1746147262.833978:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466032000 00000100:00100000:2.0:1746147262.834668:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16303 00000100:00100000:2.0:1746147262.834678:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+21:32241:x1830967466032000:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.834698:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.834715:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb71 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.834744:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.834752:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.834760:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.834766:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.834767:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.834770:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2097152->2179071] (req 2097152->2179071) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.834840:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.834852:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 22 pid: 17530 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.834864:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467160832:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.834994:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.835003:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 15 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.835015:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467160960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.835049:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147262.835061:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 11 pid: 4445 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746147262.835081:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467161088:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.835102:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.840202:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467160832:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.840212:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467160960:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147262.841211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.841330:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466032128 00000100:00100000:3.0:1746147262.841338:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466032128 00010000:00010000:3.0:1746147262.841374:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 23 pid: 17530 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.841412:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8338 00000100:00100000:3.0:1746147262.841419:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466032128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.841435:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.841458:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 23 pid: 17530 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.841468:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 23 pid: 17530 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.841489:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eb2400/0xb4b2209fbdad2a37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaf3 expref: 23 pid: 17530 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.841509:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.841841:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967466032128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 421us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.841847:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8338 00000100:00100000:2.0:1746147262.842098:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467161088:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147262.842110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147262.842125:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->2179071] (req 2097152->2179071) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.842136:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487000, rc 0) 00000100:00100000:2.0:1746147262.842160:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+21:32241:x1830967466032000:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7485us (8261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.842166:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16303 00000100:00100000:3.0:1746147262.842169:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466032256 00000100:00100000:3.0:1746147262.842172:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466032256 00010000:00010000:3.0:1746147262.842183:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 16 pid: 6881 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.842211:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8339 00000100:00100000:3.0:1746147262.842216:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1959:x1830967466032256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.842224:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.842233:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 16 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.842240:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 16 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.842252:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094422400/0xb4b2209fbdad2abc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb32 expref: 16 pid: 6881 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.842261:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.842284:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1959:x1830967466032256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.842289:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8339 00000100:00100000:0.0:1746147262.842837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.842877:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466032640 00000100:00100000:0.0:1746147262.842879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.842881:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466032640 00010000:00010000:3.0:1746147262.842894:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 12 pid: 4445 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746147262.842913:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8340 00000100:00100000:3.0:1746147262.842918:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967466032640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.842924:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147262.842958:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466032512 00000100:00100000:2.0:1746147262.842962:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466032512 00000100:00100000:2.0:1746147262.842984:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11599 00000100:00100000:2.0:1746147262.842989:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32244:x1830967466032512:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.843006:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.843020:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb78 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.843132:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843143:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843153:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843165:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843171:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843176:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.843247:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 12 pid: 4445 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.843256:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 12 pid: 4445 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.843268:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f540c00/0xb4b2209fbdad29f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac2 expref: 12 pid: 4445 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746147262.843283:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.843285:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.843286:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.843292:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.843293:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843299:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147262.843300:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746147262.843307:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147262.843326:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.843339:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467161216:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.843379:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843385:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843394:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00000100:00100000:3.0:1746147262.843399:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00010000:00010000:2.0:1746147262.843400:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.843404:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843410:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843417:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.843420:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147262.843423:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843427:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b33 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843440:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843445:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843449:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843453:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.843455:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843459:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843467:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.843469:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.843472:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843476:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843482:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843486:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843490:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843494:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.843496:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843500:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843505:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76300) 00010000:00010000:2.0:1746147262.843507:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.843509:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843513:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.843541:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb78 expref: 13 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.843548:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb78 expref: 13 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.843554:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00000100:00100000:2.0:1746147262.843576:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32244:x1830967466032512:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 586us (697us total) trans 8589945631 rc 301/301 00000100:00100000:2.0:1746147262.843582:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11599 00000100:00100000:0.0:1746147262.849577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.849679:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466032896 00000100:00100000:1.0:1746147262.849866:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466032896 00002000:00100000:1.0:1746147262.849912:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2174976->2179071) req@ffff880134c54000 x1830967466032896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.849926:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967466032896 ext(2174976->2179071) 00002000:00010000:1.0:1746147262.849932:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:1.0:1746147262.849986:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7768 00000100:00100000:1.0:1746147262.849992:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967466032896:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147262.850188:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967466032896:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 195us (621us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147262.850194:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7768 00002000:00100000:1.0:1746147262.850200:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2174976->2179071) req@ffff880134c54000 x1830967466032896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.850211:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967466032896 ext(2174976->2179071) 00002000:00010000:1.0:1746147262.850215:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:3.0:1746147262.850313:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467161216:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.850339:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.850376:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466032640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7450us (7533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.850384:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8340 00000100:00100000:0.0:1746147262.863429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.863851:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466033152 00000100:00100000:1.0:1746147262.863862:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466033152 00000100:00100000:1.0:1746147262.864536:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4880 00000100:00100000:1.0:1746147262.864544:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32241:x1830967466033152:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147262.864782:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32241:x1830967466033152:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 238us (1362us total) trans 8589945632 rc 0/0 00000100:00100000:1.0:1746147262.864789:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4880 00000100:00100000:0.0:1746147262.890995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.891111:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466033408 00000100:00100000:2.0:1746147262.891121:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466033408 00000100:00100000:2.0:1746147262.891178:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11600 00000100:00100000:2.0:1746147262.891186:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32248:x1830967466033408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.891212:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.891230:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb7f expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.891345:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891358:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891368:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891382:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891388:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891394:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891501:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891509:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891516:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147262.891524:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147262.891605:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891612:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891618:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891624:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.891628:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891634:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891644:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.891646:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147262.891649:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891663:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b56 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891681:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891685:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891689:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891692:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.891695:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891699:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891704:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147262.891705:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.891707:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891711:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891717:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891721:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891725:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891730:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147262.891732:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891736:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891740:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76400) 00010000:00010000:2.0:1746147262.891742:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147262.891744:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891748:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2b4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.891780:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2b41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb7f expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.891788:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdad2b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb7f expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.891795:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:2.0:1746147262.892138:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+307:32248:x1830967466033408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 952us (1219us total) trans 8589945633 rc 301/301 00000100:00100000:2.0:1746147262.892145:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11600 00000100:00100000:0.0:1746147262.894840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.894983:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466033536 00000100:00100000:2.0:1746147262.894995:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466033536 00000100:00100000:2.0:1746147262.895062:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11601 00000100:00100000:2.0:1746147262.895090:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+307:32248:x1830967466033536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.895120:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.895140:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b64 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb86 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.895239:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.895254:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.895265:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147262.895297:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147262.895303:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147262.895319:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147262.895346:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0xb4b2209fbdad2b64 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 309 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.895365:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.895373:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147262.895376:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147262.895379:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487400, rc 0) 00000100:00100000:2.0:1746147262.895452:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32248:x1830967466033536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 365us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.895458:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11601 00000100:00100000:0.0:1746147262.909354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.909433:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466033792 00000100:00100000:2.0:1746147262.909445:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466033792 00002000:00100000:2.0:1746147262.909488:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134c55500 x1830967466033792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.909498:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55500 with x1830967466033792 ext(0->1048575) 00002000:00010000:2.0:1746147262.909503:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55500 00000100:00100000:2.0:1746147262.909530:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7769 00000100:00100000:2.0:1746147262.909537:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967466033792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147262.913819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147262.914578:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466034048 00000100:00100000:1.0:1746147262.914590:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466034048 00002000:00100000:1.0:1746147262.914643:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134c54380 x1830967466034048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.914653:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967466034048 ext(1048576->2097151) 00002000:00010000:1.0:1746147262.914658:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:1.0:1746147262.914697:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7770 00000100:00100000:1.0:1746147262.914705:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967466034048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147262.918285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.918324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.918348:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466034304 00000100:00100000:2.0:1746147262.918358:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466034304 00000100:00100000:3.0:1746147262.918392:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466034560 00002000:00100000:2.0:1746147262.918394:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012eceea00 x1830967466034304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147262.918396:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466034560 00002000:00100000:2.0:1746147262.918401:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceea00 with x1830967466034304 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.918405:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eceea00 00002000:00100000:3.0:1746147262.918418:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012ecec000 x1830967466034560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.918426:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec000 with x1830967466034560 ext(1048576->2097151) 00000100:00100000:2.0:1746147262.918427:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7771 00002000:00010000:3.0:1746147262.918430:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecec000 00000100:00100000:2.0:1746147262.918431:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466034304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.918445:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7772 00000100:00100000:3.0:1746147262.918450:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967466034560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.920993:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967466033792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11445us (11642us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.921006:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7769 00002000:00100000:3.0:1746147262.921018:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134c55500 x1830967466033792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.921027:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55500 with x1830967466033792 ext(0->1048575) 00002000:00010000:3.0:1746147262.921033:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55500 00000100:00100000:1.0:1746147262.926370:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466034048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11652us (12547us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147262.926385:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7770 00002000:00100000:1.0:1746147262.926400:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134c54380 x1830967466034048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.926410:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967466034048 ext(1048576->2097151) 00002000:00010000:1.0:1746147262.926416:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:2.0:1746147262.932089:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967466034304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13635us (13790us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147262.932101:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7771 00002000:00100000:2.0:1746147262.932114:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012eceea00 x1830967466034304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.932123:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceea00 with x1830967466034304 ext(1048576->2097151) 00002000:00010000:2.0:1746147262.932129:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eceea00 00000100:00100000:0.0:1746147262.945826:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.946028:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466034688 00000100:00100000:2.0:1746147262.946037:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466034688 00000100:00100000:2.0:1746147262.946107:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16304 00000100:00100000:2.0:1746147262.946115:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32244:x1830967466034688:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.946134:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.946152:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb8d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.946181:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.946188:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.946189:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.946197:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2379776->3145727] (req 2379776->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.946230:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.946240:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 40 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.946254:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467161344:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.946343:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147262.947521:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967466034560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 29065us (29190us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.947531:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7772 00002000:00100000:3.0:1746147262.947541:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012ecec000 x1830967466034560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.947550:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec000 with x1830967466034560 ext(1048576->2097151) 00002000:00010000:3.0:1746147262.947555:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecec000 00000100:00100000:0.0:1746147262.948045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.948130:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466034816 00000100:00100000:3.0:1746147262.948135:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466034816 00002000:00100000:3.0:1746147262.948164:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3051520->3145727) req@ffff880134c56680 x1830967466034816/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.948172:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56680 with x1830967466034816 ext(3051520->3145727) 00010000:00010000:3.0:1746147262.948179:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 39 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.948192:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 39 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.948199:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c56680 00000100:00100000:3.0:1746147262.948221:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2656 00000100:00100000:3.0:1746147262.948227:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967466034816:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147262.949158:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467161344:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.949190:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2379776->3145727] (req 2379776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.949210:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486a00, rc 0) 00000100:00100000:2.0:1746147262.949242:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32244:x1830967466034688:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3127us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.949249:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16304 00000100:00100000:3.0:1746147262.954489:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967466034816:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6244us (6427us total) trans 17179874171 rc 0/0 00000100:00100000:3.0:1746147262.954504:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2656 00002000:00100000:3.0:1746147262.954520:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3051520->3145727) req@ffff880134c56680 x1830967466034816/t17179874171(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.954531:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56680 with x1830967466034816 ext(3051520->3145727) 00010000:00010000:3.0:1746147262.954543:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 41 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.954562:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 41 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.954569:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c56680 00000100:00100000:0.0:1746147262.955856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.956625:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466034944 00000100:00100000:2.0:1746147262.956635:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466034944 00000100:00100000:2.0:1746147262.956689:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16305 00000100:00100000:2.0:1746147262.956697:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+41:32248:x1830967466034944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.956714:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.956732:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb94 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.956758:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.956765:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2379776->3145727] (req 2379776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.956771:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147262.956774:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.956811:0:4445:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2379776->3145727] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.956824:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147262.956837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147262.956838:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:2.0:1746147262.956891:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32248:x1830967466034944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 195us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.956897:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16305 00000100:00100000:3.0:1746147262.957235:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466035072 00000100:00100000:3.0:1746147262.957239:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466035072 00010000:00010000:3.0:1746147262.957256:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 42 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.957274:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8341 00000100:00100000:3.0:1746147262.957279:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967466035072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147262.957369:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147262.957391:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 42 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.957406:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 42 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.957423:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad2b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb6a expref: 42 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.957444:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.957445:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147262.957450:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.957456:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.957474:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.957484:0:7120:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 21 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.957495:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467161600:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147262.957556:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.959186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.959201:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467161600:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147262.959220:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147262.959257:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967466035072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1977us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147262.959266:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8341 00000100:00100000:2.0:1746147262.959452:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466035328 00000100:00100000:2.0:1746147262.959457:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466035328 00002000:00100000:2.0:1746147262.959495:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2379776->2383871) req@ffff880134c55880 x1830967466035328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.959504:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967466035328 ext(2379776->2383871) 00010000:00010000:2.0:1746147262.959511:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.959522:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.959527:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55880 00000100:00100000:2.0:1746147262.959540:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2657 00000100:00100000:2.0:1746147262.959547:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466035328:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.959694:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466035328:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 147us (511us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147262.959700:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2657 00002000:00100000:2.0:1746147262.959705:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2379776->2383871) req@ffff880134c55880 x1830967466035328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147262.959718:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967466035328 ext(2379776->2383871) 00010000:00010000:2.0:1746147262.959723:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.959732:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746147262.959738:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55880 00000100:00100000:0.0:1746147262.966638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.966690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.966695:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466035584 00000100:00100000:2.0:1746147262.966704:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466035584 00000100:00100000:2.0:1746147262.966753:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16306 00000100:00100000:2.0:1746147262.966759:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32244:x1830967466035584:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147262.966775:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.966789:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edb9b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147262.966798:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466035712 00000100:00100000:3.0:1746147262.966803:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466035712 00010000:00010000:2.0:1746147262.966816:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.966821:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.966823:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.966825:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147262.966831:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2379776->3145727) req@ffff880134c55180 x1830967466035712/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.966840:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55180 with x1830967466035712 ext(2379776->3145727) 00010000:00010000:3.0:1746147262.966848:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.966852:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147262.966859:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 22 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.966863:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 20 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.966865:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55180 00000100:00100000:2.0:1746147262.966872:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467161728:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147262.966878:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2658 00000100:00100000:3.0:1746147262.966883:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466035712:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147262.966957:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.969546:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467161728:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.969579:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.969598:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00000100:00100000:2.0:1746147262.969647:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32244:x1830967466035584:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2887us (3018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.969655:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16306 00000100:00100000:0.0:1746147262.970161:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147262.970186:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466035840 00000100:00100000:0.0:1746147262.970193:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466035840 00002000:00100000:0.0:1746147262.970227:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2179071) req@ffff880134c57800 x1830967466035840/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147262.970242:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57800 with x1830967466035840 ext(2097152->2179071) 00010000:00010000:0.0:1746147262.970248:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 21 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746147262.970257:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 21 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:0.0:1746147262.970264:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c57800 00000100:00100000:0.0:1746147262.970280:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2659 00000100:00100000:0.0:1746147262.970286:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967466035840:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147262.973369:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466035840:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3073us (3199us total) trans 21474841510 rc 0/0 00000100:00100000:1.0:1746147262.973383:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2659 00002000:00100000:1.0:1746147262.973394:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2179071) req@ffff880134c57800 x1830967466035840/t21474841510(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147262.973403:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57800 with x1830967466035840 ext(2097152->2179071) 00010000:00010000:1.0:1746147262.973414:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 23 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746147262.973425:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 23 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:1.0:1746147262.973431:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c57800 00000100:00100000:0.0:1746147262.975203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.975333:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466035968 00000100:00100000:2.0:1746147262.975341:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466035968 00010000:00010000:2.0:1746147262.975374:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 23 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.975412:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8342 00000100:00100000:2.0:1746147262.975418:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466035968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.975431:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.975455:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 23 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.975470:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 23 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746147262.975512:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466035712:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8627us (8819us total) trans 17179874172 rc 0/0 00000100:00100000:3.0:1746147262.975522:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2658 00002000:00100000:3.0:1746147262.975530:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2379776->3145727) req@ffff880134c55180 x1830967466035712/t17179874172(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.975538:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55180 with x1830967466035712 ext(2379776->3145727) 00010000:00010000:2.0:1746147262.975540:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb71 expref: 23 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.975546:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 24 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.975561:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 24 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.975568:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55180 00010000:00010000:2.0:1746147262.975627:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.975629:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.975636:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.975644:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.975676:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.975689:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467161856:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.975751:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.977490:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467161856:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.977509:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147262.977521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.977550:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967466035968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2130us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.977557:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8342 00000100:00100000:3.0:1746147262.977625:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466036224 00000100:00100000:3.0:1746147262.977631:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466036224 00002000:00100000:3.0:1746147262.977661:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2113536->2117631) req@ffff880134c56a00 x1830967466036224/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.977670:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56a00 with x1830967466036224 ext(2113536->2117631) 00002000:00010000:3.0:1746147262.977673:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c56a00 00000100:00100000:3.0:1746147262.977688:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7773 00000100:00100000:1.0:1746147262.977692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.977694:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466036224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147262.977745:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466036352 00000100:00100000:2.0:1746147262.977749:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466036352 00010000:00010000:2.0:1746147262.977764:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 24 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.977790:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8343 00000100:00100000:2.0:1746147262.977796:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466036352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147262.977831:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466036224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 137us (377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147262.977837:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7773 00002000:00100000:3.0:1746147262.977843:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2113536->2117631) req@ffff880134c56a00 x1830967466036224/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.977850:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56a00 with x1830967466036224 ext(2113536->2117631) 00002000:00010000:3.0:1746147262.977852:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c56a00 00010000:00010000:2.0:1746147262.977929:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.977976:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 24 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.977987:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 24 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.978005:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486a00/0xb4b2209fbdad2b72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2379776->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb8d expref: 24 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.978017:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.978018:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.978025:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.978031:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.978055:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 40 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.978065:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467161984:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.978145:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147262.980214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.980279:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467161984:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.980296:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.980512:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967466036352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2715us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.980521:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8343 00000100:00100000:1.0:1746147262.980658:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466036608 00000100:00100000:1.0:1746147262.980664:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466036608 00000100:00100000:1.0:1746147262.980699:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4881 00000100:00100000:1.0:1746147262.980707:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32244:x1830967466036608:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147262.980888:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32244:x1830967466036608:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 182us (681us total) trans 8589945634 rc 0/0 00000100:00100000:1.0:1746147262.980893:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4881 00000100:00100000:0.0:1746147262.981050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.981149:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466036864 00000100:00100000:3.0:1746147262.981153:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466036864 00002000:00100000:3.0:1746147262.981179:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e3100 x1830967466036864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.981195:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3100 with x1830967466036864 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.981199:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e3100 00000100:00100000:3.0:1746147262.981213:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7774 00000100:00100000:3.0:1746147262.981219:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967466036864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147262.988293:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967466036864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7049us (7219us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147262.988427:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7774 00002000:00100000:3.0:1746147262.988442:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e3100 x1830967466036864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:638/0 lens 488/440 e 0 to 0 dl 1746147273 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.988452:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3100 with x1830967466036864 ext(2097152->3145727) 00002000:00010000:3.0:1746147262.988459:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e3100 00000100:00100000:0.0:1746147262.990972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.991039:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466036992 00000100:00100000:2.0:1746147262.991049:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466036992 00000100:00100000:2.0:1746147262.991117:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16307 00000100:00100000:2.0:1746147262.991125:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:32248:x1830967466036992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147262.991144:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147262.991160:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edba2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.991190:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.991197:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.991199:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147262.991202:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.991233:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.991244:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 15 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.991261:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162112:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147262.991349:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.992525:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147262.992550:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.992563:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486600, rc 0) 00000100:00100000:2.0:1746147262.992597:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32248:x1830967466036992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1473us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.992604:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16307 00000100:00100000:0.0:1746147262.992701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147262.992747:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466037120 00000100:00100000:3.0:1746147262.992752:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466037120 00002000:00100000:3.0:1746147262.992787:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2117631) req@ffff8800b52e1f80 x1830967466037120/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/0 e 0 to 0 dl 1746147273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.992795:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967466037120 ext(2097152->2117631) 00010000:00010000:3.0:1746147262.992801:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 16 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.992812:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 16 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.992817:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e1f80 00000100:00100000:3.0:1746147262.992834:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2660 00000100:00100000:3.0:1746147262.992839:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466037120:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147262.994226:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466037120:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 1381us (1521us total) trans 21474841511 rc 0/0 00000100:00100000:3.0:1746147262.994234:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2660 00002000:00100000:3.0:1746147262.994242:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2117631) req@ffff8800b52e1f80 x1830967466037120/t21474841511(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:638/0 lens 488/448 e 0 to 0 dl 1746147273 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147262.994250:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967466037120 ext(2097152->2117631) 00010000:00010000:3.0:1746147262.994257:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 18 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746147262.994268:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 18 pid: 4445 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746147262.994275:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e1f80 00000100:00100000:0.0:1746147262.997276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147262.997342:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466037248 00000100:00100000:2.0:1746147262.997353:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466037248 00010000:00010000:2.0:1746147262.997392:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 18 pid: 4445 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746147262.997430:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8344 00000100:00100000:2.0:1746147262.997438:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466037248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147262.997452:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147262.997476:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 18 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.997488:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 18 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.997517:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb9b expref: 18 pid: 4445 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746147262.997541:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.997543:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147262.997551:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.997559:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147262.997593:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147262.997606:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467162240:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147262.997862:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147262.999047:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467162240:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147262.999064:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147262.999110:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466037248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1672us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147262.999119:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8344 00000100:00100000:0.0:1746147263.003797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.003870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.003872:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466037504 00000100:00100000:3.0:1746147263.003883:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466037504 00000100:00100000:0.0:1746147263.003918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147263.003930:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800b52e0700 x1830967466037504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.003971:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0700 with x1830967466037504 ext(2097152->3145727) 00002000:00010000:3.0:1746147263.003977:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0700 00000100:00100000:3.0:1746147263.004001:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466037760 00000100:00100000:3.0:1746147263.004004:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466037760 00002000:00100000:3.0:1746147263.004018:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800b52e2a00 x1830967466037760/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.004025:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2a00 with x1830967466037760 ext(3145728->4194303) 00002000:00010000:3.0:1746147263.004029:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2a00 00000100:00100000:3.0:1746147263.004038:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466038016 00000100:00100000:3.0:1746147263.004040:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466038016 00002000:00100000:3.0:1746147263.004051:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e1880 x1830967466038016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.004057:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967466038016 ext(3145728->4194303) 00000100:00100000:2.0:1746147263.004057:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7775 00002000:00010000:3.0:1746147263.004060:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:1.0:1746147263.004074:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7776 00000100:00100000:2.0:1746147263.004078:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466037504:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147263.004083:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466037760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147263.004099:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7777 00000100:00100000:2.0:1746147263.004105:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967466038016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147263.011688:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967466038016:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7569us (7757us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.011701:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7777 00002000:00100000:2.0:1746147263.011715:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e1880 x1830967466038016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.011725:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967466038016 ext(3145728->4194303) 00002000:00010000:2.0:1746147263.011732:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:3.0:1746147263.018520:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466037504:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14432us (14763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147263.018533:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7775 00002000:00100000:3.0:1746147263.018556:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800b52e0700 x1830967466037504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.018566:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0700 with x1830967466037504 ext(2097152->3145727) 00002000:00010000:3.0:1746147263.018576:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0700 00010000:00010000:2.0:1746147263.021227:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147263.022446:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466037760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18355us (18566us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147263.022458:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7776 00002000:00100000:1.0:1746147263.022471:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff8800b52e2a00 x1830967466037760/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.022480:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2a00 with x1830967466037760 ext(3145728->4194303) 00002000:00010000:1.0:1746147263.022486:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2a00 00000100:00100000:0.0:1746147263.027017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.027104:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466038272 00000100:00100000:1.0:1746147263.027114:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466038272 00002000:00100000:1.0:1746147263.027164:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800b52e1c00 x1830967466038272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.027174:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967466038272 ext(4194304->4976639) 00002000:00010000:1.0:1746147263.027206:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1c00 00000100:00100000:1.0:1746147263.027298:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7778 00000100:00100000:1.0:1746147263.027308:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967466038272:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147263.032688:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967466038272:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5372us (5671us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147263.032700:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7778 00002000:00100000:1.0:1746147263.032710:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800b52e1c00 x1830967466038272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.032716:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967466038272 ext(4194304->4976639) 00002000:00010000:1.0:1746147263.032791:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1c00 00000100:00100000:0.0:1746147263.036599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.036713:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466038528 00000100:00100000:1.0:1746147263.036724:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466038528 00000100:00100000:1.0:1746147263.036781:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4882 00000100:00100000:1.0:1746147263.036789:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32248:x1830967466038528:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147263.037055:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:32248:x1830967466038528:12345-192.168.203.36@tcp:35:cat.0 Request processed in 267us (465us total) trans 8589945635 rc 0/0 00000100:00100000:1.0:1746147263.037063:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4882 00000100:00100000:0.0:1746147263.042513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.042611:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466038784 00000100:00100000:2.0:1746147263.042622:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466038784 00000100:00100000:2.0:1746147263.042681:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11602 00000100:00100000:2.0:1746147263.042688:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32253:x1830967466038784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.042713:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.042730:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edba9 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.042841:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.042854:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.042865:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.042879:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.042888:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.042893:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043054:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043064:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043089:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147263.043098:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147263.043183:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043189:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043194:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043199:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.043203:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043209:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043219:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.043222:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147263.043227:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043232:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2ba3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043249:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043254:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043258:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043262:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.043264:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043268:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043273:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147263.043274:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.043277:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043280:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043286:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043291:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043296:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043299:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.043301:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043304:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043309:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76400) 00010000:00010000:2.0:1746147263.043311:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.043313:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043317:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2b9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.043351:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba9 expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.043357:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad2b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba9 expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.043364:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487a00, rc 0) 00000100:00100000:2.0:1746147263.043432:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32253:x1830967466038784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 744us (929us total) trans 8589945636 rc 301/301 00000100:00100000:2.0:1746147263.043439:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11602 00000100:00100000:0.0:1746147263.045562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.045614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.045695:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466038912 00000100:00100000:2.0:1746147263.045702:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466038912 00000100:00100000:2.0:1746147263.045744:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466039040 00000100:00100000:2.0:1746147263.045746:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466039040 00000100:00100000:2.0:1746147263.045777:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16308 00000100:00100000:2.0:1746147263.045784:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967466038912:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.045801:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147263.045811:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16309 00010000:00010000:2.0:1746147263.045817:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbb0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.045819:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1959:x1830967466039040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147263.045827:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.045837:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbb7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.045838:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.045840:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.045848:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 24 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.045850:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.045851:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.045856:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.045860:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 24 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.045866:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.045870:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486200, rc 0) 00010000:00010000:3.0:1746147263.045874:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55400, rc 0) 00000100:00100000:3.0:1746147263.045903:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466039040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.045908:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16309 00000100:00080000:0.0:1746147263.045914:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147263.045917:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147263.046360:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466038912:12345-192.168.203.36@tcp:101:cat.0 Request processed in 576us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.046366:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16308 00000100:00100000:0.0:1746147263.066396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.066440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.066485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.066549:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466039296 00000100:00100000:2.0:1746147263.066559:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466039296 00000100:00100000:3.0:1746147263.066570:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466039552 00000100:00100000:3.0:1746147263.066575:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466039552 00002000:00100000:3.0:1746147263.066606:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e3480 x1830967466039552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.066606:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e1180 x1830967466039296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.066616:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3480 with x1830967466039552 ext(3145728->4194303) 00002000:00100000:2.0:1746147263.066616:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1180 with x1830967466039296 ext(2097152->3145727) 00002000:00010000:3.0:1746147263.066622:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e3480 00002000:00010000:2.0:1746147263.066622:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1180 00000100:00100000:3.0:1746147263.066639:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466039808 00000100:00100000:3.0:1746147263.066641:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466039808 00002000:00100000:3.0:1746147263.066652:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800b52e0000 x1830967466039808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.066659:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0000 with x1830967466039808 ext(2097152->3145727) 00002000:00010000:3.0:1746147263.066662:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0000 00000100:00100000:2.0:1746147263.066664:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7779 00000100:00100000:2.0:1746147263.066672:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466039552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147263.066863:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7780 00000100:00100000:1.0:1746147263.066871:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466039296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.066876:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7781 00000100:00100000:3.0:1746147263.066883:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466039808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147263.067528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.067541:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466040064 00000100:00100000:0.0:1746147263.067544:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466040064 00002000:00100000:0.0:1746147263.067559:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012d499c00 x1830967466040064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.067566:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967466040064 ext(3145728->4194303) 00002000:00010000:0.0:1746147263.067569:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:0.0:1746147263.067579:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7782 00000100:00100000:0.0:1746147263.067583:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967466040064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.074692:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967466039808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7798us (8195us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147263.074706:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7781 00002000:00100000:3.0:1746147263.074717:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff8800b52e0000 x1830967466039808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.074735:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0000 with x1830967466039808 ext(2097152->3145727) 00002000:00010000:3.0:1746147263.074742:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0000 00000100:00100000:2.0:1746147263.078644:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967466039552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11960us (12190us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.078659:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7779 00002000:00100000:2.0:1746147263.078671:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800b52e3480 x1830967466039552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.078682:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3480 with x1830967466039552 ext(3145728->4194303) 00002000:00010000:2.0:1746147263.078689:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e3480 00000100:00100000:1.0:1746147263.083240:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466039296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16357us (16843us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147263.083253:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7780 00002000:00100000:1.0:1746147263.083265:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800b52e1180 x1830967466039296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.083274:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1180 with x1830967466039296 ext(2097152->3145727) 00002000:00010000:1.0:1746147263.083280:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1180 00000100:00100000:2.0:1746147263.084465:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466040064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16154us (16211us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.084475:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7782 00002000:00100000:2.0:1746147263.084483:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012d499c00 x1830967466040064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.084491:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967466040064 ext(3145728->4194303) 00002000:00010000:2.0:1746147263.084495:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:0.0:1746147263.090083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.090572:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466040320 00000100:00100000:2.0:1746147263.090591:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466040320 00002000:00100000:2.0:1746147263.090638:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d49ad80 x1830967466040320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.090650:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967466040320 ext(4194304->4976639) 00002000:00010000:2.0:1746147263.090655:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49ad80 00000100:00100000:2.0:1746147263.090685:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7783 00000100:00100000:2.0:1746147263.090694:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466040320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147263.092123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.092199:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466040576 00000100:00100000:2.0:1746147263.092204:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466040576 00000100:00100000:2.0:1746147263.092247:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11603 00000100:00100000:2.0:1746147263.092253:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+309:32255:x1830967466040576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147263.092270:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.092288:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbbe expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.092383:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092396:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092407:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092419:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092425:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092430:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092521:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092528:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092533:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147263.092544:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147263.092616:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092622:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092628:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092633:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.092636:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092642:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092652:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.092655:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147263.092658:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092663:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2bd4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092698:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092703:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092707:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092715:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.092717:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092722:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092727:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147263.092729:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.092731:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092735:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092742:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092747:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092751:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092755:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.092757:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092761:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092766:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76400) 00010000:00010000:2.0:1746147263.092768:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.092770:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092774:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.092805:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2bbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbbe expref: 311 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.092812:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbbe expref: 311 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.092819:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00000100:00100000:2.0:1746147263.092848:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32255:x1830967466040576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 595us (731us total) trans 8589945637 rc 301/301 00000100:00100000:2.0:1746147263.092855:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11603 00000100:00100000:3.0:1746147263.099047:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466040320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8345us (8977us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147263.099061:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7783 00002000:00100000:3.0:1746147263.099087:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012d49ad80 x1830967466040320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.099097:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967466040320 ext(4194304->4976639) 00002000:00010000:3.0:1746147263.099102:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49ad80 00000100:00100000:0.0:1746147263.106893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.107167:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466040832 00000100:00100000:2.0:1746147263.107186:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466040832 00000100:00100000:2.0:1746147263.107245:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4883 00000100:00100000:2.0:1746147263.107253:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32253:x1830967466040832:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147263.107692:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32253:x1830967466040832:12345-192.168.203.36@tcp:35:cat.0 Request processed in 439us (809us total) trans 8589945638 rc 0/0 00000100:00100000:2.0:1746147263.107699:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4883 00000100:00100000:0.0:1746147263.166256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.166364:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466041088 00000100:00100000:2.0:1746147263.166374:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466041088 00000100:00100000:2.0:1746147263.166436:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11604 00000100:00100000:2.0:1746147263.166445:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32259:x1830967466041088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.166470:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.166489:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbc5 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.166600:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166613:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166624:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166636:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166641:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166646:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166746:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166754:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166759:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147263.166767:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147263.166844:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166850:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166857:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166862:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.166865:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166871:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166880:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.166883:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147263.166886:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166890:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdad2bf7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166920:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166925:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166929:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166933:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.166972:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166977:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166986:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147263.166989:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.166991:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.166995:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdad2be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167004:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167008:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167012:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167016:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.167018:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167022:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167027:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76000) 00010000:00010000:2.0:1746147263.167028:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.167030:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167035:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad2bf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.167078:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2be2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbc5 expref: 312 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.167086:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad2be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbc5 expref: 312 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.167093:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486c00, rc 0) 00000100:00100000:2.0:1746147263.167147:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32259:x1830967466041088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 704us (902us total) trans 8589945639 rc 301/301 00000100:00100000:2.0:1746147263.167154:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11604 00000100:00100000:0.0:1746147263.183254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.184738:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466041216 00000100:00100000:2.0:1746147263.184751:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466041216 00000100:00100000:2.0:1746147263.184821:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16310 00000100:00100000:2.0:1746147263.184829:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32255:x1830967466041216:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147263.184849:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.184866:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbcc expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.184896:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.184904:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.184912:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.184917:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.184920:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.184923:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [1208320->1990655] (req 1208320->1990655) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.184960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147263.184978:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.184991:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 10 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.185004:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162368:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.185117:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.185126:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 17 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.185134:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162496:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.185162:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.185170:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 24 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.185177:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162624:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.185193:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466041472 00000100:00100000:2.0:1746147263.185194:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.185197:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466041472 00000100:00100000:3.0:1746147263.185228:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4884 00000100:00100000:3.0:1746147263.185233:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32259:x1830967466041472:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147263.189851:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:32259:x1830967466041472:12345-192.168.203.36@tcp:35:cat.0 Request processed in 4607us (4882us total) trans 8589945640 rc 0/0 00000100:00100000:3.0:1746147263.189863:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4884 00000100:00100000:0.0:1746147263.191703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.191744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.191798:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466041600 00000100:00100000:0.0:1746147263.191807:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466041600 00010000:00010000:0.0:1746147263.191839:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 11 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.191863:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466041728 00000100:00100000:0.0:1746147263.191867:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466041728 00010000:00010000:0.0:1746147263.191877:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:0.0:1746147263.191892:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8345 00000100:00100000:0.0:1746147263.191898:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967466041600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147263.191909:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147263.191913:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8346 00000100:00100000:2.0:1746147263.191922:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967466041728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.191930:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.191932:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 11 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.191961:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:0.0:1746147263.191963:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 11 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.191988:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.192022:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967466041600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.192028:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8345 00010000:00010000:2.0:1746147263.192324:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.192338:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147263.192361:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094422c00/0xb4b2209fbdad2a06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaa6 expref: 10 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.192375:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162368:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.192375:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967466041728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 453us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.192381:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8346 00000100:00100000:3.0:1746147263.192386:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162496:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.192394:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d64c00/0xb4b2209fbdad298f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda75 expref: 24 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.192411:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162624:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.192437:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1208320->1990655] (req 1208320->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.192447:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487000, rc 0) 00000100:00100000:3.0:1746147263.192467:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32255:x1830967466041216:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7639us (9223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.192473:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16310 00000100:00100000:0.0:1746147263.193326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.194275:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466041856 00000100:00100000:3.0:1746147263.194285:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466041856 00010000:00010000:3.0:1746147263.194318:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 18 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.194360:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8347 00000100:00100000:3.0:1746147263.194368:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466041856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.194381:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.194405:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 18 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.194417:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 18 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.194437:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094061e00/0xb4b2209fbdad2aa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb16 expref: 18 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.194457:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.194459:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.194466:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.194474:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.194506:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.194518:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467162752:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.194606:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.199022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.199147:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466042112 00000100:00100000:2.0:1746147263.199158:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466042112 00002000:00100000:2.0:1746147263.199206:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1208320->1212415) req@ffff88012d498000 x1830967466042112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.199216:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498000 with x1830967466042112 ext(1208320->1212415) 00002000:00010000:2.0:1746147263.199223:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d498000 00000100:00100000:3.0:1746147263.199453:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467162752:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147263.199503:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7784 00010000:00010000:3.0:1746147263.199512:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.199512:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466042112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.199559:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466041856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5192us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.199568:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8347 00000100:00100000:2.0:1746147263.199678:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466042112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 167us (667us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147263.199684:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7784 00002000:00100000:2.0:1746147263.199689:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1208320->1212415) req@ffff88012d498000 x1830967466042112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.199701:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498000 with x1830967466042112 ext(1208320->1212415) 00002000:00010000:2.0:1746147263.199704:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d498000 00000100:00100000:0.0:1746147263.205882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.205975:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466042368 00000100:00100000:1.0:1746147263.205985:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466042368 00002000:00100000:1.0:1746147263.206031:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1986560->1990655) req@ffff88012d498e00 x1830967466042368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.206040:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498e00 with x1830967466042368 ext(1986560->1990655) 00002000:00010000:1.0:1746147263.206046:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d498e00 00000100:00100000:1.0:1746147263.206083:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7785 00000100:00100000:1.0:1746147263.206090:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466042368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147263.206861:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466042368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 769us (985us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147263.206869:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7785 00002000:00100000:1.0:1746147263.206875:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1986560->1990655) req@ffff88012d498e00 x1830967466042368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.206882:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498e00 with x1830967466042368 ext(1986560->1990655) 00002000:00010000:1.0:1746147263.206885:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d498e00 00000100:00100000:0.0:1746147263.208680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.208753:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466042624 00000100:00100000:3.0:1746147263.208760:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466042624 00000100:00100000:3.0:1746147263.208812:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11605 00000100:00100000:3.0:1746147263.208819:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32261:x1830967466042624:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.208844:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.208864:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad2c0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbd3 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.209094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147263.209134:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209147:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209157:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209168:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209173:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209178:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209282:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209290:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209295:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.209304:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.209376:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209382:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209391:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209397:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.209400:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209407:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209417:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.209420:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.209424:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147263.209424:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466042880 00000100:00100000:2.0:1746147263.209427:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466042880 00010000:00010000:3.0:1746147263.209428:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c21 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147263.209452:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4885 00010000:00010000:3.0:1746147263.209458:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147263.209458:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:32255:x1830967466042880:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:3.0:1746147263.209463:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209467:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209471:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.209474:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209478:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209486:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.209488:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.209490:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209494:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209500:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209504:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209508:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209512:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1b200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.209514:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209518:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209523:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4d00) 00010000:00010000:3.0:1746147263.209524:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.209526:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209530:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.209560:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad2c0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbd3 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.209567:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad2c0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbd3 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.209574:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1ac00, rc 0) 00000100:00100000:2.0:1746147263.209612:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32255:x1830967466042880:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 154us (518us total) trans 8589945642 rc 0/0 00000100:00100000:2.0:1746147263.209618:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4885 00000100:00100000:3.0:1746147263.209699:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32261:x1830967466042624:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 880us (1025us total) trans 8589945641 rc 301/301 00000100:00100000:3.0:1746147263.209705:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11605 00000100:00100000:0.0:1746147263.215757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.215917:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466043008 00000100:00100000:3.0:1746147263.215928:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466043008 00000100:00100000:3.0:1746147263.216257:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16311 00000100:00100000:3.0:1746147263.216266:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32261:x1830967466043008:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.216282:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.216332:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbda expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.216362:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.216370:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147263.216371:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147263.216374:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1060864->1294335] (req 1060864->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.216404:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.216419:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 22 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.216431:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162880:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.216956:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.217823:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467162880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.217848:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1060864->1294335] (req 1060864->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.217862:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1aa00, rc 0) 00000100:00100000:3.0:1746147263.217908:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32261:x1830967466043008:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1642us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.217915:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16311 00000100:00100000:0.0:1746147263.220800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.220882:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466043136 00000100:00100000:1.0:1746147263.220892:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466043136 00002000:00100000:1.0:1746147263.220969:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1208320->1990655) req@ffff88012d499f80 x1830967466043136/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.220980:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499f80 with x1830967466043136 ext(1208320->1990655) 00010000:00010000:1.0:1746147263.220990:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 23 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.221004:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 23 pid: 4445 timeout: 750 lvb_type: 0 00002000:00010000:1.0:1746147263.221011:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d499f80 00000100:00100000:1.0:1746147263.221045:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2661 00000100:00100000:1.0:1746147263.221052:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466043136:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147263.234885:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466043136:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13821us (14080us total) trans 21474841512 rc 0/0 00000100:00100000:1.0:1746147263.234900:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2661 00002000:00100000:1.0:1746147263.234913:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1208320->1990655) req@ffff88012d499f80 x1830967466043136/t21474841512(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.234923:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499f80 with x1830967466043136 ext(1208320->1990655) 00010000:00010000:1.0:1746147263.234950:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.234964:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00002000:00010000:1.0:1746147263.234972:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d499f80 00000100:00100000:0.0:1746147263.237287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.237454:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466043264 00000100:00100000:3.0:1746147263.237464:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466043264 00010000:00010000:3.0:1746147263.237498:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.237540:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8348 00000100:00100000:3.0:1746147263.237547:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466043264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.237562:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147263.237579:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147261 -> 1746147263 00002000:00010000:3.0:1746147263.237582:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147261 -> 1746147263 00010000:00010000:3.0:1746147263.237587:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.237600:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.237623:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487000/0xb4b2209fbdad2c05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbcc expref: 25 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.237655:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.237657:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.237664:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.237673:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.237704:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.237716:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467163008:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.237802:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.239620:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467163008:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147263.239627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147263.239639:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.239681:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466043264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2134us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.239689:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8348 00000100:00100000:1.0:1746147263.239760:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466043520 00000100:00100000:1.0:1746147263.239767:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466043520 00002000:00100000:1.0:1746147263.239801:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1060864->1064959) req@ffff8801312a5180 x1830967466043520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.239810:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5180 with x1830967466043520 ext(1060864->1064959) 00002000:00010000:1.0:1746147263.239815:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a5180 00000100:00100000:1.0:1746147263.239844:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7786 00000100:00100000:1.0:1746147263.239850:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466043520:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147263.240025:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466043520:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 175us (400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147263.240032:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7786 00002000:00100000:1.0:1746147263.240037:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1060864->1064959) req@ffff8801312a5180 x1830967466043520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.240044:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5180 with x1830967466043520 ext(1060864->1064959) 00002000:00010000:1.0:1746147263.240047:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a5180 00000100:00100000:0.0:1746147263.243279:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.243345:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466043776 00000100:00100000:2.0:1746147263.243355:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466043776 00002000:00100000:2.0:1746147263.243401:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1290240->1294335) req@ffff8801312a6a00 x1830967466043776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.243410:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967466043776 ext(1290240->1294335) 00002000:00010000:2.0:1746147263.243416:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6a00 00000100:00100000:2.0:1746147263.243445:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7787 00000100:00100000:2.0:1746147263.243451:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466043776:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147263.243623:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1956:x1830967466043776:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 170us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147263.243630:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7787 00002000:00100000:2.0:1746147263.243634:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1290240->1294335) req@ffff8801312a6a00 x1830967466043776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.243641:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967466043776 ext(1290240->1294335) 00002000:00010000:2.0:1746147263.243645:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6a00 00000100:00100000:0.0:1746147263.245521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.245622:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466044032 00000100:00100000:2.0:1746147263.245630:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466044032 00000100:00100000:2.0:1746147263.245662:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4886 00000100:00100000:2.0:1746147263.245669:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32261:x1830967466044032:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147263.245876:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32261:x1830967466044032:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 207us (359us total) trans 8589945643 rc 0/0 00000100:00100000:2.0:1746147263.245884:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4886 00000100:00100000:0.0:1746147263.325927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.327011:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466044288 00000100:00100000:3.0:1746147263.327022:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466044288 00000100:00100000:3.0:1746147263.327091:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11606 00000100:00100000:3.0:1746147263.327100:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32269:x1830967466044288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147263.327127:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.327145:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdad2c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbe1 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.327258:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327271:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327281:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327295:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327301:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327306:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327583:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327592:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327598:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.327610:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.327689:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327696:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327702:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327707:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1ae00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.327711:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327718:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327728:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.327731:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.327735:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.327741:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c4b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328204:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328209:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328214:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328221:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1b800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.328224:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328228:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328235:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.328237:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.328240:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328244:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328252:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328256:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328260:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328264:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.328266:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328271:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328275:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4b00) 00010000:00010000:3.0:1746147263.328277:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.328280:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328284:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.328318:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdad2c36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbe1 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.328325:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdad2c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbe1 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.328332:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a200, rc 0) 00000100:00100000:3.0:1746147263.328403:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32269:x1830967466044288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1304us (2484us total) trans 8589945644 rc 301/301 00000100:00100000:3.0:1746147263.328410:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11606 00000100:00100000:0.0:1746147263.331820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.332005:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466044544 00000100:00100000:3.0:1746147263.332016:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466044544 00000100:00100000:3.0:1746147263.332544:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11607 00000100:00100000:3.0:1746147263.332554:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32268:x1830967466044544:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.332578:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.332597:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdad2c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbe8 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.332722:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332734:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332745:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332759:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332764:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332768:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332877:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332884:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.332890:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.332897:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.333473:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333480:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333486:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333492:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1ae00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.333495:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333501:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333514:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.333517:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.333521:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333525:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ae00/0xb4b2209fbdad2c6e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333549:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333555:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333559:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333562:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.333565:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333569:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333575:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.333577:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.333579:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333584:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdad2c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333590:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333595:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333599:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333602:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1b800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.333604:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.333608:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.334114:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4e00) 00010000:00010000:3.0:1746147263.334118:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.334126:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.334132:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b800/0xb4b2209fbdad2c67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.334194:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdad2c59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbe8 expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.334206:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdad2c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbe8 expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.334214:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a200, rc 0) 00000100:00100000:3.0:1746147263.334283:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:32268:x1830967466044544:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1729us (2471us total) trans 8589945645 rc 301/301 00000100:00100000:3.0:1746147263.334294:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11607 00000100:00100000:0.0:1746147263.335932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.336195:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466044800 00000100:00100000:3.0:1746147263.336205:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466044800 00002000:00100000:3.0:1746147263.336246:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8801312a6300 x1830967466044800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 504/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.336256:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6300 with x1830967466044800 ext(1048576->2097151) 00002000:00010000:3.0:1746147263.336261:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6300 00000100:00100000:3.0:1746147263.336725:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7788 00000100:00100000:3.0:1746147263.336734:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466044800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.344203:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1957:x1830967466044800:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7456us (8267us total) trans 0 rc 815104/815104 00000100:00100000:3.0:1746147263.344216:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7788 00002000:00100000:3.0:1746147263.344231:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8801312a6300 x1830967466044800/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 504/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.344240:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6300 with x1830967466044800 ext(1048576->2097151) 00002000:00010000:3.0:1746147263.344246:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6300 00000100:00100000:0.0:1746147263.367380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.367457:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466045056 00000100:00100000:2.0:1746147263.367470:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466045056 00000100:00100000:2.0:1746147263.367532:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4887 00000100:00100000:2.0:1746147263.367540:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32269:x1830967466045056:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147263.367773:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32269:x1830967466045056:12345-192.168.203.36@tcp:35:cat.0 Request processed in 233us (405us total) trans 8589945646 rc 0/0 00000100:00100000:2.0:1746147263.367780:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4887 00000100:00100000:0.0:1746147263.369609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.369900:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466045312 00000100:00100000:3.0:1746147263.369909:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466045312 00000100:00100000:3.0:1746147263.370108:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11608 00000100:00100000:3.0:1746147263.370116:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32271:x1830967466045312:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.370136:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.370155:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad2c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbef expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.370273:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370285:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370296:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370310:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370315:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370320:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370436:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370444:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370449:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.370459:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.370549:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370556:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370566:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370571:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.370574:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370581:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370591:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.370594:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.370598:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370603:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a400/0xb4b2209fbdad2c91 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370633:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370637:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370641:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370646:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1b200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.370648:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370652:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370662:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.370664:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.370666:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370670:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1b200/0xb4b2209fbdad2c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370676:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370679:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370683:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370686:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.370688:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370692:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370696:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4d00) 00010000:00010000:3.0:1746147263.370697:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.370699:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370702:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdad2c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.370735:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad2c7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbef expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.370743:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ac00/0xb4b2209fbdad2c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbef expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.370750:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1ac00, rc 0) 00000100:00100000:3.0:1746147263.370818:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32271:x1830967466045312:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 702us (1216us total) trans 8589945647 rc 301/301 00000100:00100000:3.0:1746147263.370825:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11608 00000100:00100000:0.0:1746147263.412115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.412191:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466045440 00000100:00100000:3.0:1746147263.412201:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466045440 00000100:00100000:3.0:1746147263.412435:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16312 00000100:00100000:3.0:1746147263.412444:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32271:x1830967466045440:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.412464:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.412482:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbf6 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.412517:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.412520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147263.412525:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147263.412598:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466045696 00000100:00100000:2.0:1746147263.412603:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466045696 00010000:00010000:3.0:1746147263.412625:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.412627:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.412632:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2125824->2580479] (req 2125824->2580479) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.412632:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11609 00000100:00100000:2.0:1746147263.412637:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+314:32275:x1830967466045696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.412651:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.412663:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad2ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edbfd expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.412674:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.412687:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.412699:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467163136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.412768:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.412779:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.412790:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.412797:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.412801:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.412810:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 23 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.412818:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467163264:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.412838:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00010000:00010000:2.0:1746147263.413301:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413308:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413418:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413426:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413432:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147263.413441:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147263.413513:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413519:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413524:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413529:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0fa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.413533:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413540:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413548:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.413551:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147263.413554:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413558:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2cbb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413590:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413595:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413599:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413603:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0f400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.413605:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413609:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413614:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147263.413616:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.413619:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413624:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413631:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413636:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413640:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413644:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0ea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147263.413646:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413650:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413654:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76f00) 00010000:00010000:2.0:1746147263.413656:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147263.413658:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413662:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2cb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147263.413698:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad2ca6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbfd expref: 316 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.413705:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdad2ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbfd expref: 316 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.413712:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59dc00, rc 0) 00000100:00100000:2.0:1746147263.413755:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+315:32275:x1830967466045696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1117us (1234us total) trans 8589945648 rc 301/301 00000100:00100000:2.0:1746147263.413762:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11609 00000100:00100000:3.0:1746147263.416170:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467163136:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.416181:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467163264:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.416212:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2125824->2580479] (req 2125824->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.416229:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1b400, rc 0) 00000100:00100000:3.0:1746147263.416313:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+19:32271:x1830967466045440:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3870us (4211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.416325:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16312 00000100:00100000:0.0:1746147263.417699:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.417774:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466045824 00000100:00100000:3.0:1746147263.417782:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466045824 00010000:00010000:3.0:1746147263.417811:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 24 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.417884:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8349 00000100:00100000:3.0:1746147263.417890:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967466045824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.417904:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.417924:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 24 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.417934:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 24 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.418100:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486600/0xb4b2209fbdad2b87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edba2 expref: 24 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.418123:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.419025:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466045824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1133us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.419032:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8349 00000100:00100000:0.0:1746147263.419496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.419652:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466045952 00000100:00100000:3.0:1746147263.419657:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466045952 00010000:00010000:3.0:1746147263.419671:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.419699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.419702:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8350 00000100:00100000:3.0:1746147263.419708:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967466045952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147263.419762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.419786:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466046080 00000100:00100000:0.0:1746147263.419789:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466046080 00000100:00100000:0.0:1746147263.419807:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466046208 00000100:00100000:0.0:1746147263.419809:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466046208 00000100:00100000:0.0:1746147263.419822:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16313 00000100:00100000:0.0:1746147263.419827:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466046080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147263.419841:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147263.419853:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2cc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc04 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.419900:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467163392:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147263.419975:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.420166:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16314 00000100:00100000:2.0:1746147263.420174:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466046208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.420181:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.420188:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2cd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc0b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.420200:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.420208:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2cd0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc0b expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.420216:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad2cd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc0b expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.420229:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ee00, rc 0) 00010000:00010000:3.0:1746147263.420235:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.420249:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.420259:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.420261:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466046208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (499us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.420266:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16314 00010000:00010000:3.0:1746147263.420272:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdad2bb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb7 expref: 19 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.420281:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.420282:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.420289:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.420297:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.420316:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.420324:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467163520:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.420345:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.423256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.423293:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466046464 00000100:00100000:0.0:1746147263.423300:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466046464 00002000:00100000:0.0:1746147263.423336:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2125824->2129919) req@ffff880132e12300 x1830967466046464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.423347:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12300 with x1830967466046464 ext(2125824->2129919) 00002000:00010000:0.0:1746147263.423352:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12300 00000100:00100000:0.0:1746147263.423382:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7789 00000100:00100000:0.0:1746147263.423388:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967466046464:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147263.423544:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967466046464:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 156us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147263.423550:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7789 00002000:00100000:0.0:1746147263.423555:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (2125824->2129919) req@ffff880132e12300 x1830967466046464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.423561:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12300 with x1830967466046464 ext(2125824->2129919) 00002000:00010000:0.0:1746147263.423564:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12300 00002000:00010000:2.0:1746147263.423917:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147261 -> 1746147263 00000100:00100000:2.0:1746147263.423932:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467163392:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.423976:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2cc9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc04 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.423987:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2cc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc04 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.423998:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c7800, rc 0) 00000100:00100000:2.0:1746147263.424021:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466046080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4194us (4323us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.424027:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16313 00000100:00100000:3.0:1746147263.424193:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467163520:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147263.424208:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.424227:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1958:x1830967466045952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4519us (4732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.424234:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8350 00000100:00100000:0.0:1746147263.429678:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.429818:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466046592 00000100:00100000:2.0:1746147263.429827:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466046592 00000100:00100000:2.0:1746147263.429872:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16315 00000100:00100000:2.0:1746147263.429879:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32275:x1830967466046592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.429898:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.429915:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc12 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.429978:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.429985:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.429987:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.429990:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.430020:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.430030:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 17 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.430048:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467163648:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147263.430359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.430364:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.430473:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466046848 00000100:00100000:3.0:1746147263.430477:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466046848 00002000:00100000:3.0:1746147263.430646:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2576384->2580479) req@ffff8800a478c700 x1830967466046848/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.430656:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478c700 with x1830967466046848 ext(2576384->2580479) 00002000:00010000:3.0:1746147263.430660:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a478c700 00000100:00100000:3.0:1746147263.430697:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7790 00000100:00100000:3.0:1746147263.430702:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466046848:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147263.430846:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466046848:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 142us (489us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147263.430852:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7790 00002000:00100000:3.0:1746147263.430857:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2576384->2580479) req@ffff8800a478c700 x1830967466046848/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.430864:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478c700 with x1830967466046848 ext(2576384->2580479) 00002000:00010000:3.0:1746147263.430867:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a478c700 00000100:00100000:0.0:1746147263.431666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.431719:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466046976 00000100:00100000:2.0:1746147263.431721:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467163648:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.431723:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466046976 00002000:00100000:3.0:1746147263.431740:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1060864->1294335) req@ffff880132e13800 x1830967466046976/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.431747:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13800 with x1830967466046976 ext(1060864->1294335) 00010000:00010000:2.0:1746147263.431749:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.431754:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 18 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.431763:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0f400, rc 0) 00010000:00010000:3.0:1746147263.431765:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 18 pid: 4445 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.431771:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132e13800 00000100:00100000:3.0:1746147263.431781:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2662 00000100:00100000:3.0:1746147263.431786:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+18:1959:x1830967466046976:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147263.431800:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32275:x1830967466046592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1921us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.431807:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16315 00000100:00100000:1.0:1746147263.432176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.432236:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466047232 00000100:00100000:3.0:1746147263.432240:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466047232 00000100:00100000:3.0:1746147263.432277:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4888 00000100:00100000:3.0:1746147263.432281:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32271:x1830967466047232:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147263.432793:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32271:x1830967466047232:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 510us (616us total) trans 8589945649 rc 0/0 00000100:00100000:3.0:1746147263.432799:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4888 00000100:00100000:3.0:1746147263.440346:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1959:x1830967466046976:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8546us (8668us total) trans 21474841513 rc 0/0 00000100:00100000:3.0:1746147263.440361:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2662 00002000:00100000:3.0:1746147263.440373:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1060864->1294335) req@ffff880132e13800 x1830967466046976/t21474841513(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.440383:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13800 with x1830967466046976 ext(1060864->1294335) 00010000:00010000:3.0:1746147263.440394:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 20 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.440414:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 20 pid: 4445 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.440420:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132e13800 00000100:00100000:0.0:1746147263.443157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.443247:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466047360 00000100:00100000:3.0:1746147263.443257:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466047360 00010000:00010000:3.0:1746147263.443295:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 20 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.443330:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8351 00000100:00100000:3.0:1746147263.443338:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967466047360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.443354:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.443376:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 20 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.443388:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 20 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.443412:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1aa00/0xb4b2209fbdad2c2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbda expref: 20 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.443427:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.443430:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.443437:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.443450:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.443481:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.443496:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467163776:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.443592:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.446213:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467163776:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147263.446234:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.446297:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1958:x1830967466047360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2959us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.446306:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8351 00000100:00100000:1.0:1746147263.450162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.450266:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466047616 00000100:00100000:3.0:1746147263.450276:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466047616 00002000:00100000:3.0:1746147263.450323:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a478ea00 x1830967466047616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.450333:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478ea00 with x1830967466047616 ext(1048576->2097151) 00002000:00010000:3.0:1746147263.450338:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a478ea00 00000100:00100000:3.0:1746147263.450373:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7791 00000100:00100000:3.0:1746147263.450381:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466047616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.458860:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466047616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8468us (8697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147263.458877:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7791 00002000:00100000:3.0:1746147263.458889:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a478ea00 x1830967466047616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.458899:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478ea00 with x1830967466047616 ext(1048576->2097151) 00002000:00010000:3.0:1746147263.458904:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a478ea00 00000100:00100000:0.0:1746147263.471897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.472822:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466047744 00000100:00100000:2.0:1746147263.472832:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466047744 00000100:00100000:2.0:1746147263.473456:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16316 00000100:00100000:2.0:1746147263.473465:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32275:x1830967466047744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.473484:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.473503:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc19 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.473535:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.473543:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.473545:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.473548:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.473583:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.473595:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 18 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.473607:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467163904:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.473792:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.481646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.482285:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467163904:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.482322:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.482342:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0e400, rc 0) 00000100:00100000:2.0:1746147263.482405:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:32275:x1830967466047744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8941us (10517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.482414:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16316 00000100:00100000:3.0:1746147263.482854:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466047872 00000100:00100000:3.0:1746147263.482861:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466047872 00002000:00100000:3.0:1746147263.482908:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2125824->2580479) req@ffff880132e12680 x1830967466047872/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.482918:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967466047872 ext(2125824->2580479) 00010000:00010000:3.0:1746147263.482924:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 19 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.482957:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 19 pid: 4445 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.482963:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132e12680 00000100:00100000:3.0:1746147263.483550:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2663 00000100:00100000:3.0:1746147263.483557:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466047872:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147263.492398:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967466047872:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8829us (10749us total) trans 21474841514 rc 0/0 00000100:00100000:3.0:1746147263.492411:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2663 00002000:00100000:3.0:1746147263.492424:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2125824->2580479) req@ffff880132e12680 x1830967466047872/t21474841514(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.492439:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967466047872 ext(2125824->2580479) 00010000:00010000:3.0:1746147263.492451:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 21 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.492465:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 21 pid: 4445 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.492473:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147263.495459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.495558:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466048000 00000100:00100000:3.0:1746147263.495569:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466048000 00010000:00010000:3.0:1746147263.495607:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 21 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.495714:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8352 00000100:00100000:3.0:1746147263.495724:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466048000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.495738:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147263.495756:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147262 -> 1746147263 00002000:00010000:3.0:1746147263.495759:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147262 -> 1746147263 00010000:00010000:3.0:1746147263.495764:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 21 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.495777:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 21 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.495800:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2c9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2580479) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbf6 expref: 21 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.496434:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.496439:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.496451:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.496462:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.496502:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.496514:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467164032:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.496621:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.503049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.503114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.503198:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466048256 00000100:00100000:2.0:1746147263.503208:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466048256 00002000:00100000:2.0:1746147263.503254:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880132e11500 x1830967466048256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.503265:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11500 with x1830967466048256 ext(2097152->3145727) 00002000:00010000:2.0:1746147263.503270:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11500 00000100:00100000:2.0:1746147263.503294:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466048512 00000100:00100000:2.0:1746147263.503296:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466048512 00002000:00100000:2.0:1746147263.503310:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880132e13100 x1830967466048512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.503317:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13100 with x1830967466048512 ext(3145728->4194303) 00002000:00010000:2.0:1746147263.503319:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e13100 00000100:00100000:2.0:1746147263.503332:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7792 00000100:00100000:2.0:1746147263.503339:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967466048256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.503527:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7793 00000100:00100000:3.0:1746147263.503542:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967466048512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.504673:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467164032:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147263.504686:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.504703:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967466048000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8982us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.504709:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8352 00000100:00100000:3.0:1746147263.511775:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466048512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8231us (8653us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147263.511785:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7793 00002000:00100000:3.0:1746147263.511799:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880132e13100 x1830967466048512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.511808:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13100 with x1830967466048512 ext(3145728->4194303) 00002000:00010000:3.0:1746147263.511813:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e13100 00000100:00100000:3.0:1746147263.512150:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967466048256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8811us (9112us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147263.512156:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7792 00002000:00100000:3.0:1746147263.512162:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880132e11500 x1830967466048256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.512168:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11500 with x1830967466048256 ext(2097152->3145727) 00002000:00010000:3.0:1746147263.512170:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11500 00000100:00100000:0.0:1746147263.520904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.520988:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466048640 00000100:00100000:2.0:1746147263.520999:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466048640 00000100:00100000:2.0:1746147263.521082:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16317 00000100:00100000:2.0:1746147263.521090:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:32268:x1830967466048640:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147263.521110:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.521129:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc20 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.521158:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.521165:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.521170:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.521172:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.521175:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1380352->2097151] (req 1380352->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.521205:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.521220:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.521230:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164160:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.521343:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.521351:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 23 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.521358:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164288:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.521375:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.524347:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164160:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.524361:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164288:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.524394:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1380352->2097151] (req 1380352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.524409:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0fa00, rc 0) 00000100:00100000:2.0:1746147263.524476:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32268:x1830967466048640:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3386us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.524489:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16317 00000100:00100000:0.0:1746147263.525865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.526121:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466048768 00000100:00100000:3.0:1746147263.526131:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466048768 00010000:00010000:3.0:1746147263.526163:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.526196:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8353 00000100:00100000:3.0:1746147263.526202:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967466048768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.526213:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.526229:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.526238:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.526255:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdad2ae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb5c expref: 42 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.526273:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.526309:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967466048768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.526314:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8353 00000100:00100000:2.0:1746147263.527004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.527052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.527395:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466049152 00000100:00100000:3.0:1746147263.527402:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466049152 00000100:00100000:3.0:1746147263.527438:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4889 00000100:00100000:3.0:1746147263.527444:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:32275:x1830967466049152:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147263.527736:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466048896 00000100:00100000:1.0:1746147263.527740:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466048896 00010000:00010000:1.0:1746147263.527759:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 24 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.527787:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8354 00000100:00100000:1.0:1746147263.527793:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466048896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.527802:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.527819:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 24 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.527831:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 24 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.527849:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2ad8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb4e expref: 24 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.527870:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.527872:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.527879:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.527888:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.527917:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.527929:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467164416:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.528056:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:32275:x1830967466049152:12345-192.168.203.36@tcp:35:cat.0 Request processed in 610us (1052us total) trans 8589945650 rc 0/0 00000100:00100000:3.0:1746147263.528072:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4889 00000100:00100000:1.0:1746147263.528077:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147263.529483:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467164416:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147263.529505:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.529559:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466048896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1765us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.529566:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8354 00000100:00100000:0.0:1746147263.530706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.531379:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466049408 00000100:00100000:3.0:1746147263.531388:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466049408 00002000:00100000:3.0:1746147263.531431:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1380352->1384447) req@ffff880132e10a80 x1830967466049408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.531441:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10a80 with x1830967466049408 ext(1380352->1384447) 00002000:00010000:3.0:1746147263.531447:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e10a80 00000100:00100000:3.0:1746147263.531466:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7794 00000100:00100000:3.0:1746147263.531473:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967466049408:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.531638:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967466049408:12345-192.168.203.36@tcp:3:cat.0 Request processed in 166us (937us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147263.531644:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7794 00002000:00100000:3.0:1746147263.531649:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1380352->1384447) req@ffff880132e10a80 x1830967466049408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.531657:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10a80 with x1830967466049408 ext(1380352->1384447) 00002000:00010000:3.0:1746147263.531660:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e10a80 00000100:00100000:0.0:1746147263.536990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.537034:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466049536 00000100:00100000:2.0:1746147263.537044:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466049536 00000100:00100000:2.0:1746147263.537108:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16318 00000100:00100000:2.0:1746147263.537115:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:32268:x1830967466049536:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147263.537130:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.537146:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc27 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.537169:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.537177:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.537182:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.537183:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.537187:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.537209:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.537220:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 22 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.537230:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164544:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.537366:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.537375:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.537382:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164672:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.537402:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.538819:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164544:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.538829:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164672:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.538857:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 42 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.538871:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094060200, rc 0) 00000100:00100000:2.0:1746147263.538907:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+42:32268:x1830967466049536:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1793us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.538915:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16318 00000100:00100000:0.0:1746147263.541821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.542353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.542434:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466049664 00000100:00100000:3.0:1746147263.542438:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466049792 00000100:00100000:2.0:1746147263.542442:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466049664 00000100:00100000:3.0:1746147263.542448:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466049792 00010000:00010000:2.0:1746147263.542471:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 23 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.542480:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.542496:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8355 00000100:00100000:2.0:1746147263.542503:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466049664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.542514:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.542532:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 23 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.542542:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 23 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.542561:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486200/0xb4b2209fbdad2bb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edbb0 expref: 23 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.542565:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8356 00010000:00010000:2.0:1746147263.542578:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.542612:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466049664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.542674:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8355 00000100:00100000:3.0:1746147263.542679:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967466049792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.542691:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.542715:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.542727:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.542762:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad2b79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb94 expref: 42 pid: 4445 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.542780:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.542782:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.542789:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.542799:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.542840:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.542853:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467164800:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.542980:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.544688:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467164800:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147263.544708:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.544969:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967466049792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2262us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.544987:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8356 00000100:00100000:0.0:1746147263.547274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.547463:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466050048 00000100:00100000:2.0:1746147263.547475:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466050048 00002000:00100000:2.0:1746147263.547524:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2416640->2420735) req@ffff880132e11180 x1830967466050048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.547534:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967466050048 ext(2416640->2420735) 00002000:00010000:2.0:1746147263.547539:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e11180 00000100:00100000:2.0:1746147263.548210:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7795 00000100:00100000:2.0:1746147263.548219:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1959:x1830967466050048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147263.548483:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1959:x1830967466050048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 257us (1223us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147263.548489:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7795 00002000:00100000:2.0:1746147263.548496:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2416640->2420735) req@ffff880132e11180 x1830967466050048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.548503:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967466050048 ext(2416640->2420735) 00002000:00010000:2.0:1746147263.548507:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e11180 00000100:00100000:0.0:1746147263.550558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.550788:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466050304 00000100:00100000:3.0:1746147263.550797:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466050304 00000100:00100000:3.0:1746147263.550847:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4890 00000100:00100000:3.0:1746147263.550855:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:32268:x1830967466050304:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147263.551748:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32268:x1830967466050304:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 891us (1195us total) trans 8589945651 rc 0/0 00000100:00100000:3.0:1746147263.551758:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4890 00000100:00100000:0.0:1746147263.560668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.561355:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466050560 00000100:00100000:3.0:1746147263.561365:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466050560 00000100:00100000:3.0:1746147263.561418:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11610 00000100:00100000:3.0:1746147263.561426:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32279:x1830967466050560:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.561449:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.561467:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdad2cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc2e expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.561578:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561591:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561601:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561614:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561619:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561625:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561727:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561735:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561741:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147263.561748:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.561895:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561902:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561911:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561917:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d55800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.561920:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561925:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561970:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.561973:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.561977:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.561982:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d08 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562008:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562012:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562017:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562021:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d54800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.562023:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562027:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562037:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.562039:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.562042:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562046:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562053:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562057:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562070:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562075:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d55e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.562077:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562082:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562087:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4d00) 00010000:00010000:3.0:1746147263.562089:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.562091:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562095:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.562126:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdad2cf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc2e expref: 23 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.562133:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdad2cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc2e expref: 23 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.562140:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54200, rc 0) 00000100:00100000:3.0:1746147263.562200:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32279:x1830967466050560:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 774us (1541us total) trans 8589945652 rc 301/301 00000100:00100000:3.0:1746147263.562207:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11610 00000100:00100000:0.0:1746147263.564531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.564636:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466050816 00000100:00100000:3.0:1746147263.564644:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466050816 00000100:00100000:3.0:1746147263.564722:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4891 00000100:00100000:3.0:1746147263.564739:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:32223:x1830967466050816:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147263.565154:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32223:x1830967466050816:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 415us (628us total) trans 8589945653 rc 0/0 00000100:00100000:3.0:1746147263.565160:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4891 00000100:00100000:0.0:1746147263.566634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.566793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.566865:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466050944 00000100:00100000:2.0:1746147263.566871:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466050944 00000100:00100000:2.0:1746147263.566925:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16319 00000100:00100000:2.0:1746147263.566959:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32279:x1830967466050944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147263.567019:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.567125:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc35 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.567135:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466051200 00000100:00100000:3.0:1746147263.567139:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466051200 00000100:00100000:3.0:1746147263.567163:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4892 00000100:00100000:3.0:1746147263.567168:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32223:x1830967466051200:12345-192.168.203.36@tcp:35:mirror_io.0 00010000:00010000:2.0:1746147263.567175:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.567182:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.567184:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.567188:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3817472->3923967] (req 3817472->3923967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.567237:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.567256:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 40 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.567268:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164928:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.567286:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32223:x1830967466051200:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 117us (492us total) trans 8589945654 rc 0/0 00000100:00100000:3.0:1746147263.567292:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4892 00000100:00100000:2.0:1746147263.567389:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.569081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.569131:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466051328 00000100:00100000:3.0:1746147263.569136:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466051328 00002000:00100000:3.0:1746147263.569168:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2420735) req@ffff88009f150700 x1830967466051328/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.569182:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150700 with x1830967466051328 ext(2097152->2420735) 00010000:00010000:3.0:1746147263.569189:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 41 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.569199:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 41 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.569201:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467164928:192.168.203.36@tcp:104: 00002000:00010000:3.0:1746147263.569205:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f150700 00000100:00100000:3.0:1746147263.569226:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2664 00000100:00100000:3.0:1746147263.569232:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967466051328:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147263.569239:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3817472->3923967] (req 3817472->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.569250:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6800, rc 0) 00000100:00100000:2.0:1746147263.569299:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32279:x1830967466050944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2361us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.569312:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16319 00000100:00100000:3.0:1746147263.573397:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967466051328:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4153us (4325us total) trans 17179874173 rc 0/0 00000100:00100000:3.0:1746147263.573409:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2664 00002000:00100000:3.0:1746147263.573421:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2420735) req@ffff88009f150700 x1830967466051328/t17179874173(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.573430:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f150700 with x1830967466051328 ext(2097152->2420735) 00010000:00010000:3.0:1746147263.573441:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 43 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.573454:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 43 pid: 21080 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.573461:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f150700 00000100:00100000:0.0:1746147263.575908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.575962:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466051456 00000100:00100000:3.0:1746147263.575972:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466051456 00010000:00010000:3.0:1746147263.576005:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 43 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.576050:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8357 00000100:00100000:3.0:1746147263.576057:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967466051456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.576083:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147263.576099:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147262 -> 1746147263 00002000:00010000:3.0:1746147263.576102:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147262 -> 1746147263 00010000:00010000:3.0:1746147263.576106:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 43 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.576118:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 43 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.576142:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094060200/0xb4b2209fbdad2cec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc27 expref: 43 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.576173:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.576176:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.576183:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.576202:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.576236:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 22 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.576249:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467165056:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147263.576342:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.579250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.579451:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466051712 00000100:00100000:2.0:1746147263.579462:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466051712 00002000:00100000:2.0:1746147263.579507:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3817472->3821567) req@ffff88009f153800 x1830967466051712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.579517:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f153800 with x1830967466051712 ext(3817472->3821567) 00002000:00010000:2.0:1746147263.579522:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f153800 00000100:00100000:2.0:1746147263.579547:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7796 00000100:00100000:2.0:1746147263.579554:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967466051712:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147263.579734:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1959:x1830967466051712:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 180us (494us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147263.579740:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7796 00002000:00100000:2.0:1746147263.579746:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3817472->3821567) req@ffff88009f153800 x1830967466051712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.579753:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f153800 with x1830967466051712 ext(3817472->3821567) 00002000:00010000:2.0:1746147263.579755:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f153800 00000100:00100000:3.0:1746147263.580182:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467165056:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147263.580207:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.580233:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967466051456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4176us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.580241:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8357 00000100:00100000:0.0:1746147263.582484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.582544:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466051968 00000100:00100000:2.0:1746147263.582551:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466051968 00002000:00100000:2.0:1746147263.582587:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3919872->3923967) req@ffff88009f151500 x1830967466051968/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.582601:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151500 with x1830967466051968 ext(3919872->3923967) 00002000:00010000:2.0:1746147263.582606:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f151500 00000100:00100000:2.0:1746147263.582634:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7797 00000100:00100000:2.0:1746147263.582641:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967466051968:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147263.582824:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967466051968:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 182us (344us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147263.582830:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7797 00002000:00100000:2.0:1746147263.582835:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3919872->3923967) req@ffff88009f151500 x1830967466051968/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.582842:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f151500 with x1830967466051968 ext(3919872->3923967) 00002000:00010000:2.0:1746147263.582845:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f151500 00000100:00100000:0.0:1746147263.590867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.591615:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466052224 00000100:00100000:1.0:1746147263.591625:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466052224 00000100:00100000:1.0:1746147263.591683:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4893 00000100:00100000:1.0:1746147263.591692:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32279:x1830967466052224:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147263.592783:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32279:x1830967466052224:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1089us (1923us total) trans 8589945655 rc 0/0 00000100:00100000:1.0:1746147263.592794:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4893 00000100:00100000:0.0:1746147263.595005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.595074:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466052480 00000100:00100000:3.0:1746147263.595087:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466052480 00000100:00100000:3.0:1746147263.595149:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11611 00000100:00100000:3.0:1746147263.595156:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32284:x1830967466052480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147263.595178:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.595195:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc3c expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.595297:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595309:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595319:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595331:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595336:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595342:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595453:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdad2d32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595460:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdad2d32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595466:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdad2d32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147263.595474:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.595557:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595563:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595569:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595574:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d54800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.595577:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595583:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595592:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.595595:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.595599:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595607:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdad2d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595634:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595642:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595650:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595654:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d55800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.595657:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595661:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595668:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4b00) 00010000:00010000:3.0:1746147263.595670:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.595672:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595676:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdad2d2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147263.595711:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdad2d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc3c expref: 26 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.595722:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdad2d32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc3c expref: 25 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.595731:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.595732:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147263.595734:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54600, rc 0) 00000100:00100000:3.0:1746147263.595796:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32284:x1830967466052480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 639us (797us total) trans 8589945656 rc 0/0 00000100:00100000:3.0:1746147263.595802:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11611 00000100:00100000:0.0:1746147263.601889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.601987:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466052608 00000100:00100000:3.0:1746147263.601995:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466052608 00000100:00100000:3.0:1746147263.602033:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 798 00000100:00100000:3.0:1746147263.602039:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967466052608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.602052:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.602083:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdad2d32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc3c expref: 25 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.602098:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.602102:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.602145:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967466052608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.602151:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 798 00000100:00100000:0.0:1746147263.607136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.607170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.607197:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466052736 00000100:00100000:0.0:1746147263.607197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.607210:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466052736 00000100:00100000:3.0:1746147263.607242:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466052992 00000100:00100000:3.0:1746147263.607248:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466052992 00000100:00100000:1.0:1746147263.607264:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466052864 00000100:00100000:1.0:1746147263.607268:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466052864 00000100:00100000:2.0:1746147263.607274:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16320 00000100:00100000:3.0:1746147263.607282:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16321 00000100:00100000:2.0:1746147263.607282:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466052736:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147263.607288:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466052992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.607301:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.607302:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147263.607305:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16322 00000100:00100000:1.0:1746147263.607311:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466052864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147263.607317:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc51 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.607318:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc43 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.607319:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147263.607328:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad2d4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc4a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.607340:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.607340:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.607342:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.607342:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.607350:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.607351:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.607362:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147263.607363:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165184:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.607368:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.607370:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54000, rc 0) 00010000:00010000:2.0:1746147263.607376:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6e00, rc 0) 00000100:00100000:3.0:1746147263.607402:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466052992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.607407:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16321 00000100:00100000:2.0:1746147263.607423:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466052736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.607426:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.607430:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16320 00002000:00010000:2.0:1746147263.612352:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147262 -> 1746147263 00002000:00010000:2.0:1746147263.612359:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147262 -> 1746147263 00002000:00010000:2.0:1746147263.612361:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147262 -> 1746147263 00000100:00100000:2.0:1746147263.612385:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165184:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.612416:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad2d4e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc4a expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.612430:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad2d4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc4a expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.612494:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e800, rc 0) 00000100:00100000:2.0:1746147263.612636:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466052864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5323us (5436us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.612645:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16322 00000100:00100000:0.0:1746147263.620113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.620430:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466053248 00000100:00100000:2.0:1746147263.620440:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466053248 00002000:00100000:2.0:1746147263.620487:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e919f80 x1830967466053248/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.620502:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919f80 with x1830967466053248 ext(1048576->2097151) 00002000:00010000:2.0:1746147263.620507:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e919f80 00000100:00100000:2.0:1746147263.620541:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7798 00000100:00100000:2.0:1746147263.620548:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466053248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147263.630374:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466053248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9814us (10259us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.630386:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7798 00002000:00100000:2.0:1746147263.630398:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e919f80 x1830967466053248/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.630407:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919f80 with x1830967466053248 ext(1048576->2097151) 00002000:00010000:2.0:1746147263.630414:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e919f80 00000100:00100000:0.0:1746147263.635008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.635094:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466053376 00000100:00100000:2.0:1746147263.635104:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466053376 00000100:00100000:2.0:1746147263.635472:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16323 00000100:00100000:2.0:1746147263.635480:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32284:x1830967466053376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.635498:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.635514:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc58 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.635544:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.635550:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.635552:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.635556:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.635586:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.635597:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 41 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.635609:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165312:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.636153:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.638999:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165312:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.639032:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.639049:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c7800, rc 0) 00000100:00100000:3.0:1746147263.639422:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32284:x1830967466053376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3934us (4416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.639433:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16323 00000100:00100000:0.0:1746147263.639675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.639855:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466053504 00000100:00100000:2.0:1746147263.639861:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466053504 00002000:00100000:2.0:1746147263.639897:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1380352->2097151) req@ffff88008e91b480 x1830967466053504/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.639905:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b480 with x1830967466053504 ext(1380352->2097151) 00010000:00010000:2.0:1746147263.639912:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 42 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.639923:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 42 pid: 21080 timeout: 750 lvb_type: 0 00002000:00010000:2.0:1746147263.639934:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e91b480 00000100:00100000:2.0:1746147263.639971:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2665 00000100:00100000:2.0:1746147263.639977:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967466053504:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147263.648223:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967466053504:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8234us (8537us total) trans 17179874174 rc 0/0 00000100:00100000:2.0:1746147263.648237:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2665 00002000:00100000:2.0:1746147263.648250:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1380352->2097151) req@ffff88008e91b480 x1830967466053504/t17179874174(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.648260:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e91b480 with x1830967466053504 ext(1380352->2097151) 00010000:00010000:2.0:1746147263.648272:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 44 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.648288:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 44 pid: 21080 timeout: 750 lvb_type: 0 00002000:00010000:2.0:1746147263.648294:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e91b480 00000100:00100000:0.0:1746147263.656613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.656731:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466053632 00000100:00100000:1.0:1746147263.656742:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466053632 00010000:00010000:1.0:1746147263.656780:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 44 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.656827:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8358 00000100:00100000:1.0:1746147263.656835:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967466053632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.656852:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.656875:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 44 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.656888:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 44 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.656910:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e0fa00/0xb4b2209fbdad2ce5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc20 expref: 44 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.656955:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.656958:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.656965:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.656973:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.657005:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.657017:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467165440:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147263.657104:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.658293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.658807:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466053888 00000100:00100000:0.0:1746147263.658814:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466053888 00000100:00100000:0.0:1746147263.658864:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11612 00000100:00100000:0.0:1746147263.658871:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32288:x1830967466053888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147263.658891:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147263.658907:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc5f expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.659045:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147263.659057:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147263.659079:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147263.659091:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147263.659096:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147263.659101:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659591:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad2d71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659600:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad2d71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659607:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad2d71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147263.659614:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147263.659700:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659706:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659714:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659718:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bc200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147263.659721:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659727:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659736:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147263.659739:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147263.659742:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659747:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bc200/0xb4b2209fbdad2d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659762:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659767:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659772:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659775:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948bda00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147263.659777:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659780:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659789:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a56dea00) 00010000:00010000:1.0:1746147263.659791:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147263.659793:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659797:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bda00/0xb4b2209fbdad2d6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147263.659832:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc5f expref: 320 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.659842:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad2d71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc5f expref: 319 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.659847:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147263.659849:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147263.659851:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094760e00, rc 0) 00000100:00100000:1.0:1746147263.659909:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32288:x1830967466053888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1039us (1620us total) trans 8589945657 rc 0/0 00000100:00100000:1.0:1746147263.659916:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11612 00000100:00100000:1.0:1746147263.662855:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467165440:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147263.662877:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.663481:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967466053632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6644us (6876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.663491:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8358 00000100:00100000:0.0:1746147263.665693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.665727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.665757:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466054272 00000100:00100000:0.0:1746147263.665758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.665767:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466054272 00000100:00100000:0.0:1746147263.665797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.665817:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466054528 00000100:00100000:3.0:1746147263.665819:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466054528 00000100:00100000:0.0:1746147263.665826:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16324 00000100:00100000:3.0:1746147263.665850:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16325 00000100:00100000:3.0:1746147263.665857:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967466054528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147263.665878:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.665897:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54e00/0xb4b2209fbdad2d7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc6d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.665983:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165568:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147263.666000:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466054400 00000100:00100000:2.0:1746147263.666007:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466054400 00002000:00100000:2.0:1746147263.666043:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e918700 x1830967466054400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.666052:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918700 with x1830967466054400 ext(1048576->2097151) 00002000:00010000:2.0:1746147263.666056:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e918700 00000100:00100000:3.0:1746147263.666083:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.666093:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7799 00000100:00100000:2.0:1746147263.666099:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466054400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147263.666215:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967466054272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147263.666224:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147263.666236:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc66 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.666250:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147263.666252:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147263.666259:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147263.666270:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147263.666278:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bd600, rc 0) 00000100:00100000:0.0:1746147263.666307:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1958:x1830967466054272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 474us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.666313:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16324 00000100:00100000:1.0:1746147263.666357:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466054144 00000100:00100000:1.0:1746147263.666361:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466054144 00000100:00100000:1.0:1746147263.666400:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 799 00000100:00100000:1.0:1746147263.666405:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967466054144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.666420:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.666435:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad2d71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc5f expref: 319 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.666449:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147263.666452:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.666470:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1956:x1830967466054144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.666476:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 799 00002000:00010000:3.0:1746147263.671138:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147261 -> 1746147263 00000100:00100000:3.0:1746147263.671159:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165568:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147263.671186:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54e00/0xb4b2209fbdad2d7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc6d expref: 45 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.671198:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54e00/0xb4b2209fbdad2d7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc6d expref: 45 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.671219:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54e00, rc 0) 00000100:00100000:3.0:1746147263.671261:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967466054528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5404us (5462us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147263.671267:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16325 00000100:00100000:0.0:1746147263.674424:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466054400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8319us (8657us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147263.674433:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7799 00002000:00100000:0.0:1746147263.674443:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e918700 x1830967466054400/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.674451:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e918700 with x1830967466054400 ext(1048576->2097151) 00002000:00010000:0.0:1746147263.674455:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e918700 00000100:00100000:0.0:1746147263.681544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.681629:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466054784 00000100:00100000:2.0:1746147263.681636:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466054784 00002000:00100000:2.0:1746147263.681670:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e919c00 x1830967466054784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.681678:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919c00 with x1830967466054784 ext(1048576->2097151) 00002000:00010000:2.0:1746147263.681681:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e919c00 00000100:00100000:2.0:1746147263.681710:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7800 00000100:00100000:2.0:1746147263.681716:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967466054784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147263.687762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.688682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.688707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.688730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.688765:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466055552 00000100:00100000:3.0:1746147263.688767:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466055168 00000100:00100000:3.0:1746147263.688772:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466055168 00000100:00100000:0.0:1746147263.688772:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466055552 00002000:00100000:3.0:1746147263.688802:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012eceed80 x1830967466055168/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.688802:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012ecedf80 x1830967466055552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.688810:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceed80 with x1830967466055168 ext(2097152->3145727) 00002000:00100000:0.0:1746147263.688810:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedf80 with x1830967466055552 ext(3145728->4194303) 00002000:00010000:3.0:1746147263.688814:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eceed80 00002000:00010000:0.0:1746147263.688814:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecedf80 00000100:00100000:0.0:1746147263.688998:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466055936 00000100:00100000:0.0:1746147263.689001:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466055936 00002000:00100000:0.0:1746147263.689016:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012ecee300 x1830967466055936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 504/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.689023:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967466055936 ext(3145728->4194303) 00002000:00010000:0.0:1746147263.689026:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecee300 00000100:00100000:0.0:1746147263.689036:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7801 00000100:00100000:0.0:1746147263.689041:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466055168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147263.689603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.689632:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466055808 00000100:00100000:2.0:1746147263.689635:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466055808 00002000:00100000:2.0:1746147263.689653:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012ecef480 x1830967466055808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.689659:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef480 with x1830967466055808 ext(2097152->3145727) 00002000:00010000:2.0:1746147263.689662:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef480 00000100:00100000:2.0:1746147263.689672:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7802 00000100:00100000:2.0:1746147263.689677:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466055552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147263.689958:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7803 00000100:00100000:3.0:1746147263.689964:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466055936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147263.690409:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7804 00000100:00100000:1.0:1746147263.690417:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466055808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147263.691894:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466055424 00000100:00100000:0.0:1746147263.691903:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466055424 00000100:00100000:0.0:1746147263.691956:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11613 00000100:00100000:0.0:1746147263.691962:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+318:32290:x1830967466055424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147263.691976:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147263.691988:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad2d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc74 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.692058:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147263.692082:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.692088:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 319 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.692092:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147263.692116:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 319 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.692126:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 319 pid: 14047 timeout: 750 lvb_type: 0 00000100:00100000:0.0:1746147263.692134:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e91aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467165696:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147263.692188:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.692195:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 23 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:0.0:1746147263.692202:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e91a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467165824:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147263.692217:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.692503:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967466054784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10786us (10964us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.692514:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7800 00002000:00100000:2.0:1746147263.692521:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008e919c00 x1830967466054784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.692529:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e919c00 with x1830967466054784 ext(1048576->2097151) 00002000:00010000:2.0:1746147263.692532:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e919c00 00000100:00100000:0.0:1746147263.698760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.698785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.698932:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056192 00000100:00100000:3.0:1746147263.698954:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056192 00010000:00010000:3.0:1746147263.698981:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 320 pid: 14047 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.699004:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056320 00000100:00100000:3.0:1746147263.699006:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056320 00010000:00010000:3.0:1746147263.699013:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 24 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:0.0:1746147263.699024:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967466055808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8608us (9420us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147263.699029:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8359 00000100:00100000:0.0:1746147263.699032:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7804 00000100:00100000:3.0:1746147263.699034:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967466056192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746147263.699039:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012ecef480 x1830967466055808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147263.699043:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746147263.699046:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef480 with x1830967466055808 ext(2097152->3145727) 00010000:00010000:3.0:1746147263.699048:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 320 pid: 14047 timeout: 750 lvb_type: 0 00002000:00010000:0.0:1746147263.699050:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef480 00010000:00010000:3.0:1746147263.699057:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 320 pid: 14047 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.699089:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.699094:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.699100:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.699104:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.699124:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8360 00000100:00100000:3.0:1746147263.699125:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967466056192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.699129:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466056320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147263.699130:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8359 00010000:00010000:0.0:1746147263.699136:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.699141:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 24 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:0.0:1746147263.699148:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 24 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:0.0:1746147263.699159:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147263.699162:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147263.699167:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147263.699172:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147263.699183:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.699195:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466056320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.699200:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8360 00010000:00010000:2.0:1746147263.699355:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdad2b6b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb86 expref: 319 pid: 14047 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.700685:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e91aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467165696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.700706:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb83600/0xb4b2209fbdad2a92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb01 expref: 23 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.700716:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e91a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467165824:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.700731:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.700737:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.700742:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147263.700757:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147263.700860:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948bca00/0xb4b2209fbdad2d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.700876:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.700882:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.700884:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147263.700886:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097df8600, rc 0) 00000100:00100000:2.0:1746147263.701740:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32290:x1830967466055424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9776us (13981us total) trans 8589945658 rc 0/0 00000100:00100000:2.0:1746147263.701747:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11613 00000100:00100000:2.0:1746147263.704247:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466055168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15194us (15527us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.704260:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7801 00002000:00100000:2.0:1746147263.704271:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012eceed80 x1830967466055168/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.704281:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceed80 with x1830967466055168 ext(2097152->3145727) 00002000:00010000:2.0:1746147263.704287:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eceed80 00000100:00100000:0.0:1746147263.706413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.706462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.706541:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056576 00000100:00100000:3.0:1746147263.706552:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056576 00000100:00100000:3.0:1746147263.706596:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16326 00000100:00100000:3.0:1746147263.706604:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:32288:x1830967466056576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147263.706617:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.706631:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc7b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.706637:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056448 00000100:00100000:2.0:1746147263.706644:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056448 00010000:00010000:3.0:1746147263.706654:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.706661:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147263.706663:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147263.706665:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.706687:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.706693:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11614 00010000:00010000:3.0:1746147263.706695:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 25 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.706699:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32284:x1830967466056448:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147263.706705:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.706717:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147263.706770:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147263.707213:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc82 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.707344:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.707444:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.707536:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.707540:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147263.707544:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0ea00, rc 0) 00000100:00100000:2.0:1746147263.707590:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32284:x1830967466056448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 890us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.707621:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11614 00000100:00100000:3.0:1746147263.710989:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466055936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21017us (22250us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746147263.711000:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7803 00002000:00100000:3.0:1746147263.711010:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012ecee300 x1830967466055936/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 504/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.711024:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967466055936 ext(3145728->4194303) 00010000:00010000:3.0:1746147263.711033:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.711046:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.711053:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ecee300 00000100:00100000:0.0:1746147263.711130:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467165952:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147263.711166:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.711183:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54a00, rc 0) 00000100:00100000:0.0:1746147263.711214:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:32288:x1830967466056576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4610us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.711225:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16326 00000100:00100000:2.0:1746147263.711983:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466055552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22303us (23300us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.711992:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7802 00002000:00100000:2.0:1746147263.712161:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012ecedf80 x1830967466055552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.712170:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedf80 with x1830967466055552 ext(3145728->4194303) 00002000:00010000:2.0:1746147263.712175:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecedf80 00000100:00100000:0.0:1746147263.714214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.714266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.714360:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056832 00000100:00100000:1.0:1746147263.714369:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056832 00000100:00100000:1.0:1746147263.714406:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16327 00000100:00100000:1.0:1746147263.714412:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32284:x1830967466056832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147263.714428:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147263.714445:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc89 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.714470:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147263.714472:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147263.714476:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.714485:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.714495:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056704 00010000:00010000:1.0:1746147263.714499:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c985e00, rc 0) 00000100:00100000:2.0:1746147263.714500:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056704 00002000:00100000:2.0:1746147263.714527:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3817472->3923967) req@ffff88009b408700 x1830967466056704/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.714536:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408700 with x1830967466056704 ext(3817472->3923967) 00000100:00100000:1.0:1746147263.714537:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32284:x1830967466056832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 125us (270us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147263.714542:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 26 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.714543:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16327 00010000:00010000:2.0:1746147263.714555:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 25 pid: 21080 timeout: 750 lvb_type: 0 00002000:00010000:2.0:1746147263.714567:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b408700 00000100:00100000:2.0:1746147263.714598:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2666 00000100:00100000:2.0:1746147263.714603:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466056704:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147263.716316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.716358:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466056960 00000100:00100000:2.0:1746147263.716364:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466056960 00000100:00100000:2.0:1746147263.716396:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16328 00000100:00100000:2.0:1746147263.716403:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:32290:x1830967466056960:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147263.716414:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.716426:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc90 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.716447:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.716455:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.716461:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.716462:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.716465:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1302528->1515519] (req 1302528->1515519) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 46 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.716490:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.716506:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.716516:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.716802:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.716809:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 26 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.716817:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166208:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.716836:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.717394:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967466056704:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2788us (3184us total) trans 17179874175 rc 0/0 00000100:00100000:3.0:1746147263.717404:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2666 00002000:00100000:3.0:1746147263.717413:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3817472->3923967) req@ffff88009b408700 x1830967466056704/t17179874175(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.717422:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408700 with x1830967466056704 ext(3817472->3923967) 00010000:00010000:3.0:1746147263.717430:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 27 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.717439:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 27 pid: 21080 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.717445:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b408700 00000100:00100000:0.0:1746147263.719903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.721395:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466057088 00000100:00100000:1.0:1746147263.721408:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466057088 00010000:00010000:1.0:1746147263.721454:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 27 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.721495:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8361 00000100:00100000:1.0:1746147263.721505:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967466057088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.721521:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.721545:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 27 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.721556:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 27 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.721587:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.721642:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1956:x1830967466057088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 140us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.721648:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8361 00000100:00100000:2.0:1746147263.721859:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.721873:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c7800/0xb4b2209fbdad2d55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc58 expref: 26 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.721891:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.721917:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1302528->1515519] (req 1302528->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 46 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.721926:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948bc200, rc 0) 00000100:00100000:2.0:1746147263.721984:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:32290:x1830967466056960:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5581us (5674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.721994:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16328 00000100:00100000:2.0:1746147263.722916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.723038:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466057216 00000100:00100000:0.0:1746147263.723044:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466057216 00010000:00010000:0.0:1746147263.723074:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.723137:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8362 00000100:00100000:0.0:1746147263.723144:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1958:x1830967466057216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147263.723154:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.723170:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.723179:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.723195:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948bd600/0xb4b2209fbdad2d86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc66 expref: 46 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.723217:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147263.723219:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147263.723225:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.723233:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.723500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.723644:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466057344 00000100:00100000:1.0:1746147263.723648:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466057344 00010000:00010000:1.0:1746147263.723665:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 26 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.723693:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8363 00000100:00100000:1.0:1746147263.723698:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1956:x1830967466057344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.723705:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.723717:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 26 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.723727:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 26 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.723739:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6800/0xb4b2209fbdad2d16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3817472->3923967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc35 expref: 26 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.723753:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.723755:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.723759:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.723765:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.723771:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.723772:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.723775:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.723786:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.723819:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.723833:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467166336:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147263.723929:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.723955:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467166464:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147263.723986:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147263.724122:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.724131:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b40aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467166592:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147263.724155:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.729631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.729722:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b40aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467166592:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147263.729734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147263.729744:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.729789:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967466057216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6644us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.729800:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467166336:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147263.729800:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8362 00000100:00100000:1.0:1746147263.729809:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467166464:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147263.729823:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.729843:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466057344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6144us (6343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.729850:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8363 00000100:00100000:3.0:1746147263.729931:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466057728 00000100:00100000:3.0:1746147263.729961:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466057728 00002000:00100000:3.0:1746147263.730002:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012ecef800 x1830967466057728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.730017:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef800 with x1830967466057728 ext(3145728->4194303) 00002000:00010000:3.0:1746147263.730022:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef800 00000100:00100000:3.0:1746147263.730042:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466057856 00000100:00100000:3.0:1746147263.730045:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466057856 00002000:00100000:3.0:1746147263.730055:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1302528->1306623) req@ffff88012d49b100 x1830967466057856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147263.730073:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7805 00000100:00100000:0.0:1746147263.730082:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466057728:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147263.730090:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967466057856 ext(1302528->1306623) 00002000:00010000:3.0:1746147263.730093:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b100 00000100:00100000:3.0:1746147263.730104:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7806 00000100:00100000:3.0:1746147263.730109:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967466057856:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147263.730236:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967466057856:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 126us (502us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147263.730242:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7806 00002000:00100000:3.0:1746147263.730247:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1302528->1306623) req@ffff88012d49b100 x1830967466057856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.730254:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967466057856 ext(1302528->1306623) 00002000:00010000:3.0:1746147263.730256:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b100 00000100:00100000:0.0:1746147263.736083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.736113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.736154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.736270:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466058240 00000100:00100000:2.0:1746147263.736281:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466058240 00002000:00100000:2.0:1746147263.736329:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b40aa00 x1830967466058240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147263.736337:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466058112 00002000:00100000:2.0:1746147263.736339:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40aa00 with x1830967466058240 ext(3145728->4194303) 00000100:00100000:1.0:1746147263.736342:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466058112 00002000:00010000:2.0:1746147263.736346:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40aa00 00002000:00100000:1.0:1746147263.736360:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b408a80 x1830967466058112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147263.736364:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466058624 00000100:00100000:2.0:1746147263.736367:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466058624 00002000:00100000:1.0:1746147263.736367:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408a80 with x1830967466058112 ext(2097152->3145727) 00002000:00010000:1.0:1746147263.736371:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b408a80 00002000:00100000:2.0:1746147263.736377:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1511424->1515519) req@ffff88009b409180 x1830967466058624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.736384:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409180 with x1830967466058624 ext(1511424->1515519) 00002000:00010000:2.0:1746147263.736387:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409180 00000100:00100000:1.0:1746147263.736389:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7807 00000100:00100000:1.0:1746147263.736395:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967466058240:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147263.736401:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7808 00000100:00100000:2.0:1746147263.736406:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967466058112:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147263.737152:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7809 00000100:00100000:3.0:1746147263.737175:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1958:x1830967466058624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147263.737284:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1958:x1830967466058624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 125us (1129us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147263.737290:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7809 00002000:00100000:3.0:1746147263.737296:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1511424->1515519) req@ffff88009b409180 x1830967466058624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.737303:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b409180 with x1830967466058624 ext(1511424->1515519) 00002000:00010000:3.0:1746147263.737306:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b409180 00000100:00100000:0.0:1746147263.737716:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466057728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7635us (8095us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147263.737725:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7805 00002000:00100000:0.0:1746147263.737730:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012ecef800 x1830967466057728/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147263.737737:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef800 with x1830967466057728 ext(3145728->4194303) 00002000:00010000:0.0:1746147263.737740:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef800 00000100:00100000:0.0:1746147263.745296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.746490:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466058752 00000100:00100000:2.0:1746147263.746502:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466058752 00000100:00100000:2.0:1746147263.746557:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16329 00000100:00100000:2.0:1746147263.746565:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466058752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.746584:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.746602:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef64800/0xb4b2209fbdad2dbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc97 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.746657:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166720:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147263.746880:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147263.749232:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967466058240:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12828us (13162us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147263.749244:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7807 00002000:00100000:1.0:1746147263.749256:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009b40aa00 x1830967466058240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.749265:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40aa00 with x1830967466058240 ext(3145728->4194303) 00002000:00010000:1.0:1746147263.749271:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40aa00 00000100:00100000:2.0:1746147263.750103:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166720:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.750133:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef64800/0xb4b2209fbdad2dbe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc97 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.750145:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef64800/0xb4b2209fbdad2dbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc97 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.750167:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef64800, rc 0) 00000100:00100000:2.0:1746147263.750189:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466058752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3626us (4906us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.750195:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16329 00000100:00100000:0.0:1746147263.753047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.753275:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967466058112:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16865us (17158us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147263.753287:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7808 00002000:00100000:2.0:1746147263.753299:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009b408a80 x1830967466058112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.753308:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b408a80 with x1830967466058112 ext(2097152->3145727) 00002000:00010000:2.0:1746147263.753314:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b408a80 00000100:00100000:2.0:1746147263.753339:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466059008 00000100:00100000:2.0:1746147263.753345:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466059008 00002000:00100000:2.0:1746147263.753372:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b40ad80 x1830967466059008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.753379:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40ad80 with x1830967466059008 ext(4194304->4976639) 00002000:00010000:2.0:1746147263.753381:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40ad80 00000100:00100000:2.0:1746147263.753401:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7810 00000100:00100000:2.0:1746147263.753406:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967466059008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147263.765343:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967466059008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11924us (12295us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147263.765356:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7810 00002000:00100000:2.0:1746147263.765369:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b40ad80 x1830967466059008/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.765378:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b40ad80 with x1830967466059008 ext(4194304->4976639) 00002000:00010000:2.0:1746147263.765383:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b40ad80 00000100:00100000:1.0:1746147263.765637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.765671:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466059264 00000100:00100000:2.0:1746147263.765679:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466059264 00002000:00100000:2.0:1746147263.765710:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a478fb80 x1830967466059264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147263.765717:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478fb80 with x1830967466059264 ext(4194304->4976639) 00002000:00010000:2.0:1746147263.765721:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a478fb80 00000100:00100000:2.0:1746147263.765736:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7811 00000100:00100000:2.0:1746147263.765742:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967466059264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147263.770646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.770792:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466059392 00000100:00100000:2.0:1746147263.770802:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466059392 00000100:00100000:2.0:1746147263.770966:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16330 00000100:00100000:2.0:1746147263.770975:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466059392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147263.770993:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.771008:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef64c00/0xb4b2209fbdad2dc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edc9e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.771072:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166848:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147263.771159:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.771347:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967466059264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5604us (5709us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147263.771358:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7811 00002000:00100000:3.0:1746147263.771368:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a478fb80 x1830967466059264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/440 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.771376:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478fb80 with x1830967466059264 ext(4194304->4976639) 00002000:00010000:3.0:1746147263.771381:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a478fb80 00000100:00100000:2.0:1746147263.776366:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166848:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.776404:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef64c00/0xb4b2209fbdad2dc5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc9e expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.776418:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef64c00/0xb4b2209fbdad2dc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc9e expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.776450:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef64c00, rc 0) 00000100:00100000:2.0:1746147263.776510:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466059392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5535us (5872us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.776519:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16330 00000100:00100000:0.0:1746147263.780692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.780738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.780786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.780789:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466059776 00000100:00100000:3.0:1746147263.780800:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466059776 00000100:00100000:0.0:1746147263.780818:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466059904 00000100:00100000:0.0:1746147263.780822:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466059904 00000100:00100000:3.0:1746147263.780860:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4894 00000100:00100000:3.0:1746147263.780868:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32288:x1830967466059776:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147263.780991:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16331 00000100:00100000:0.0:1746147263.780997:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466059904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147263.781008:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147263.781025:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f69600/0xb4b2209fbdad2dcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcac expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.781096:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166976:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147263.781128:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:32288:x1830967466059776:12345-192.168.203.36@tcp:35:cat.0 Request processed in 260us (388us total) trans 8589945659 rc 0/0 00000100:00100000:3.0:1746147263.781135:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4894 00000100:00100000:0.0:1746147263.781154:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.781285:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466059520 00000100:00100000:2.0:1746147263.781289:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466059520 00000100:00100000:2.0:1746147263.781320:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11615 00000100:00100000:2.0:1746147263.781324:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32292:x1830967466059520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147263.781334:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.781345:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64e00/0xb4b2209fbdad2dd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edca5 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.782148:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782162:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782173:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782187:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782193:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782198:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782302:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782313:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.782320:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.782345:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.782356:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 319 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.782366:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467167104:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.782434:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147263.783153:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467166976:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147263.783177:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f69600/0xb4b2209fbdad2dcc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcac expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.783187:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f69600/0xb4b2209fbdad2dcc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcac expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.783205:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f69600, rc 0) 00000100:00100000:1.0:1746147263.783233:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466059904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2236us (2446us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147263.783240:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16331 00000100:00100000:3.0:1746147263.787859:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467167104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.787887:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147263.788388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.788434:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466060160 00000100:00100000:1.0:1746147263.788442:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466060160 00000100:00100000:1.0:1746147263.788500:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4895 00000100:00100000:1.0:1746147263.788509:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:19601:x1830967466060160:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147263.788916:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+321:19601:x1830967466060160:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 407us (528us total) trans 8589945660 rc 0/0 00000100:00100000:2.0:1746147263.788965:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.789312:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4895 00000100:00100000:1.0:1746147263.789330:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466060416 00000100:00100000:1.0:1746147263.789333:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466060416 00000100:00100000:1.0:1746147263.789349:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4896 00000100:00100000:1.0:1746147263.789353:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32284:x1830967466060416:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147263.789695:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32284:x1830967466060416:12345-192.168.203.36@tcp:35:cat.0 Request processed in 339us (729us total) trans 8589945661 rc 0/0 00000100:00100000:1.0:1746147263.789702:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4896 00000100:00100000:0.0:1746147263.791086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.791155:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466060544 00000100:00100000:1.0:1746147263.791160:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466060544 00010000:00010000:1.0:1746147263.791184:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 321 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.791204:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8364 00000100:00100000:1.0:1746147263.791209:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1958:x1830967466060544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.791219:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.791224:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 321 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.791236:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 321 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.791257:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097df8600/0xb4b2209fbdad2d94 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc74 expref: 321 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.791275:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147263.791280:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147263.791289:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147263.791295:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147263.792197:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.792245:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1958:x1830967466060544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1033us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.792252:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8364 00010000:00010000:3.0:1746147263.792351:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792359:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.792397:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147263.792402:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147263.792417:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792426:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792434:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792440:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792445:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792450:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef65000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.792454:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792460:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792468:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.792471:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.792474:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792478:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65000/0xb4b2209fbdad2dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792645:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792651:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792656:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792660:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef65200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.792662:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792667:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792674:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76f00) 00010000:00010000:3.0:1746147263.792676:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.792677:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792682:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65200/0xb4b2209fbdad2de1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.792714:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64e00/0xb4b2209fbdad2dd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.792726:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.792732:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.792734:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147263.792735:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef65400, rc 0) 00000100:00100000:3.0:1746147263.793279:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32292:x1830967466059520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 11952us (12597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.793287:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11615 00000100:00100000:0.0:1746147263.796098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.796132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.796180:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466060672 00000100:00100000:1.0:1746147263.796189:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466060672 00000100:00100000:1.0:1746147263.796237:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466060800 00000100:00100000:1.0:1746147263.796239:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466060800 00000100:00100000:1.0:1746147263.796256:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16332 00000100:00100000:1.0:1746147263.796262:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466060672:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147263.796278:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16333 00010000:00010000:1.0:1746147263.796281:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147263.796291:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967466060800:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147263.796299:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcb3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.796300:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.796312:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2df6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcba expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.796322:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.796324:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.796338:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147263.796356:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467167232:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147263.796356:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.796366:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984800, rc 0) 00000100:00100000:1.0:1746147263.796406:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466060672:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.796411:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16332 00000100:00100000:2.0:1746147263.796682:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147263.796866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.796904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.796981:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466061056 00000100:00100000:2.0:1746147263.796984:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466061056 00000100:00100000:2.0:1746147263.797011:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466060928 00000100:00100000:2.0:1746147263.797013:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466060928 00000100:00100000:2.0:1746147263.797027:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16334 00000100:00100000:2.0:1746147263.797031:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466061056:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147263.797034:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16335 00010000:00010000:2.0:1746147263.797038:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147263.797043:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466060928:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147263.797046:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcc8 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.797050:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.797057:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.797058:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcc1 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.797059:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.797080:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.797083:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.797085:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.797090:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.797091:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.797098:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef64600, rc 0) 00010000:00010000:3.0:1746147263.797101:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.797107:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065000, rc 0) 00000100:00100000:2.0:1746147263.797128:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466061056:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.797132:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466060928:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.797134:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16334 00000100:00100000:3.0:1746147263.797138:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16335 00000100:00100000:2.0:1746147263.798854:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467167232:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.798886:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2df6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcba expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.798899:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2df6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcba expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.798923:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef65e00, rc 0) 00000100:00100000:2.0:1746147263.799000:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466060800:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2709us (2866us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.799005:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16333 00000100:00100000:0.0:1746147263.801564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.801697:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466061312 00000100:00100000:3.0:1746147263.801706:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466061312 00000100:00100000:3.0:1746147263.801752:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11616 00000100:00100000:3.0:1746147263.801759:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32292:x1830967466061312:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147263.801777:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.801795:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e200/0xb4b2209fbdad2e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edccf expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.801902:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.801915:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.801921:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.801995:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.802006:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 10 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.802017:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467167360:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.802118:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.803382:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467167360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.803402:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147263.803788:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.804000:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466061440 00000100:00100000:1.0:1746147263.804007:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466061440 00010000:00010000:1.0:1746147263.804032:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 11 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.804075:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8365 00000100:00100000:1.0:1746147263.804082:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466061440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.804094:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.804099:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 11 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.804109:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 11 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.804128:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65400/0xb4b2209fbdad2de8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edca5 expref: 11 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.804162:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147263.804167:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147263.804175:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147263.804181:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147263.804204:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.804240:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466061440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 159us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.804246:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8365 00010000:00010000:3.0:1746147263.804378:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.804385:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.804405:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.804548:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e200/0xb4b2209fbdad2e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.804566:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.804572:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.804574:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147263.804577:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c52f800, rc 0) 00000100:00100000:3.0:1746147263.804874:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32292:x1830967466061312:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3115us (3317us total) trans 8589945662 rc 0/0 00000100:00100000:3.0:1746147263.804881:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11616 00000100:00100000:0.0:1746147263.807386:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.807628:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466061568 00000100:00100000:3.0:1746147263.807638:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466061568 00000100:00100000:3.0:1746147263.807678:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11617 00000100:00100000:3.0:1746147263.807685:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32292:x1830967466061568:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147263.807712:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.807729:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f200/0xb4b2209fbdad2e20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcd6 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.807807:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.807820:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.807827:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.807858:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.807870:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 11 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.807881:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467167488:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.808000:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147263.811992:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467167488:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.812026:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147263.812366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.812551:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466061696 00000100:00100000:2.0:1746147263.812558:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466061696 00010000:00010000:2.0:1746147263.812589:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 12 pid: 14049 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.812625:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8366 00000100:00100000:2.0:1746147263.812633:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466061696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.812645:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.812651:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 12 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.812662:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 12 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.812685:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f800/0xb4b2209fbdad2e12 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edccf expref: 12 pid: 14049 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.812711:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147263.812715:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.812723:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.812730:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147263.812746:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.812801:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466061696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 169us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.812808:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8366 00010000:00010000:3.0:1746147263.812995:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.813002:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147263.813044:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:3.0:1746147263.813048:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147263.813072:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147263.813102:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52f200/0xb4b2209fbdad2e20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcd6 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.813118:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcd6 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.813124:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.813126:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147263.813129:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c52e000, rc 0) 00000100:00100000:3.0:1746147263.813326:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32292:x1830967466061568:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5484us (5790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.813336:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11617 00000100:00100000:0.0:1746147263.816284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.816482:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466061824 00000100:00100000:2.0:1746147263.816491:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466061824 00000100:00100000:2.0:1746147263.816543:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16336 00000100:00100000:2.0:1746147263.816550:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466061824:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147263.816568:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.816585:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef65600/0xb4b2209fbdad2e2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcdd expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.816849:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467167616:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147263.817074:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.822462:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967467167616:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147263.822502:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef65600/0xb4b2209fbdad2e2e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcdd expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.822517:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef65600/0xb4b2209fbdad2e2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcdd expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.823130:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef65600, rc 0) 00000100:00100000:2.0:1746147263.823180:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466061824:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6628us (6903us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147263.823189:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16336 00000100:00100000:0.0:1746147263.829895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.830323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.830396:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062080 00000100:00100000:3.0:1746147263.830406:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062080 00000100:00100000:3.0:1746147263.830462:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062336 00000100:00100000:3.0:1746147263.830464:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062336 00000100:00100000:3.0:1746147263.830490:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11618 00000100:00100000:3.0:1746147263.830497:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32292:x1830967466062080:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147263.830506:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11619 00000100:00100000:2.0:1746147263.830514:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32296:x1830967466062336:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.830517:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147263.830531:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.830534:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2e35 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edce4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.830539:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65a00/0xb4b2209fbdad2e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edceb expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.830625:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147263.830638:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147263.830649:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147263.830660:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147263.830713:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.830764:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094423e00/0xb4b2209fbdad2e35 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.830783:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.830790:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.830793:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.830797:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4bf8400, rc 0) 00000100:00100000:3.0:1746147263.830842:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32292:x1830967466062080:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 346us (956us total) trans 8589945663 rc 0/0 00000100:00100000:3.0:1746147263.830848:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11618 00010000:00010000:2.0:1746147263.830888:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.830895:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.830906:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.830911:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.830917:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.831015:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.831024:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.831030:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147263.831058:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.831096:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 11 pid: 14125 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.831108:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467167744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.831162:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.833376:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467167744:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.833395:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147263.834181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.834457:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062464 00000100:00100000:0.0:1746147263.834465:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062464 00010000:00010000:0.0:1746147263.834496:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 12 pid: 14125 timeout: 750 lvb_type: 0 00000100:00100000:0.0:1746147263.834535:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8367 00000100:00100000:0.0:1746147263.834543:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466062464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147263.834556:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.834562:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 12 pid: 14125 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.834820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.834853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.834878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.834892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.834905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.834920:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062592 00000100:00100000:2.0:1746147263.834923:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062592 00000100:00100000:2.0:1746147263.834962:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062848 00000100:00100000:2.0:1746147263.834964:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062848 00000100:00100000:2.0:1746147263.834976:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063104 00000100:00100000:2.0:1746147263.834977:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063104 00000100:00100000:2.0:1746147263.834986:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062720 00000100:00100000:2.0:1746147263.834987:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062720 00000100:00100000:2.0:1746147263.834997:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16337 00000100:00100000:2.0:1746147263.835002:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466062592:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147263.835036:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835051:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.835073:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 24 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.835081:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 44 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147263.835082:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466062976 00000100:00100000:3.0:1746147263.835087:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466062976 00010000:00010000:2.0:1746147263.835088:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.835089:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.835092:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.835108:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16338 00000100:00100000:3.0:1746147263.835113:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967466062848:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147263.835120:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 44 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.835131:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 44 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:3.0:1746147263.835135:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.835144:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b409f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467167872:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.835146:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.835154:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835162:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835167:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.835168:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.835170:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.835188:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835201:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 13 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.835211:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467168000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.835212:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 24 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.835222:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 24 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.835229:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467168128:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.835241:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835249:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 21 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.835253:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147263.835256:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467168256:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.835260:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 12 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.835267:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467168384:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.835277:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.835283:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f000 going to sleep for 11 seconds 00010000:00010000:3.0:1746147263.835285:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 24 pid: 4444 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.835293:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467168512:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.835298:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16339 00000100:00100000:2.0:1746147263.835304:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967466063104:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:3.0:1746147263.835307:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147263.835319:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.835323:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16340 00000100:00100000:3.0:1746147263.835328:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967466062720:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147263.835333:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 44 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835340:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835342:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835347:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835352:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.835353:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.835354:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835380:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835388:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 24 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.835396:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467168640:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.835421:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147263.835428:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.835440:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467168768:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.835457:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 44 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835463:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 44 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.835470:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467168896:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.835480:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.835494:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16341 00000100:00100000:2.0:1746147263.835499:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967466062976:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147263.835514:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835523:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835529:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.835530:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147263.835532:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835544:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 44 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.835555:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 44 pid: 17530 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.835563:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467169024:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.835582:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147263.835613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147263.835631:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.835642:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835649:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147263.835650:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063232 00010000:00010000:3.0:1746147263.835655:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147263.835656:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147263.835656:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063232 00010000:00010000:3.0:1746147263.835658:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.835674:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147263.835676:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16342 00000100:00100000:1.0:1746147263.835680:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967466063232:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147263.835682:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 21 pid: 21080 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.835690:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467169152:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147263.835697:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.835708:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.835713:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.835714:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147263.835720:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 14 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.835720:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.835725:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.835726:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.835727:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.835732:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467169280:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147263.835742:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.835749:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 21 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:1.0:1746147263.835756:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467169408:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.835765:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.835773:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.835781:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467169536:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147263.835786:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147263.835793:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 14 pid: 8480 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.835795:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147263.835800:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467169664:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147263.835834:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.835841:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.835851:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467169792:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147263.835880:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 12 pid: 14125 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.835881:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147263.835898:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf8400/0xb4b2209fbdad2e43 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edce4 expref: 12 pid: 14125 timeout: 750 lvb_type: 0 00010000:00010000:0.0:1746147263.835919:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147263.835924:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147263.835932:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147263.835950:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147263.835973:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.835996:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466062464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1453us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.836002:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8367 00010000:00010000:3.0:1746147263.836300:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836306:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147263.836321:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.836428:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836435:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836441:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836447:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef64200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.836450:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836460:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836468:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.836471:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147263.836473:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836479:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdad2e5f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836509:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836514:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836520:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836524:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef65800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.836526:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836531:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836538:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.836540:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.836543:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836547:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65800/0xb4b2209fbdad2e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836556:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836561:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836566:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836570:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef64800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.836572:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836576:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836581:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d76400) 00010000:00010000:3.0:1746147263.836582:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.836584:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836588:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64800/0xb4b2209fbdad2e58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.836627:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65a00/0xb4b2209fbdad2e3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edceb expref: 27 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.836633:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef65a00/0xb4b2209fbdad2e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edceb expref: 27 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.836639:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef65a00, rc 0) 00000100:00100000:3.0:1746147263.836671:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32296:x1830967466062336:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6158us (6348us total) trans 8589945664 rc 301/301 00000100:00100000:3.0:1746147263.836678:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11619 00000100:00100000:2.0:1746147263.840927:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b409f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467167872:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147263.847078:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467168640:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147263.847096:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467168768:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147263.847104:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467168896:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147263.847128:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.847157:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467169024:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147263.847166:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.847169:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467168128:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.847173:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467168000:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.847179:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467168384:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.847182:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467168256:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.847189:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967467168512:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.847196:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.847215:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.847234:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467169152:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.847242:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467169280:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147263.848398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.848427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.848452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.848471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.848482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.848492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.848511:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063360 00000100:00100000:1.0:1746147263.848517:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063360 00010000:00010000:1.0:1746147263.848550:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 45 pid: 21080 timeout: 750 lvb_type: 1 00000100:00100000:1.0:1746147263.848574:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063488 00000100:00100000:1.0:1746147263.848577:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063488 00010000:00010000:1.0:1746147263.848585:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 15 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:1.0:1746147263.848593:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063744 00000100:00100000:1.0:1746147263.848594:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063744 00010000:00010000:1.0:1746147263.848601:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 13 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:1.0:1746147263.848606:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064000 00000100:00100000:1.0:1746147263.848607:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064000 00010000:00010000:1.0:1746147263.848614:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 25 pid: 4444 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.848621:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064384 00000100:00100000:1.0:1746147263.848622:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064384 00010000:00010000:1.0:1746147263.848629:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.848637:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8368 00000100:00100000:1.0:1746147263.848642:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967466063360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.848655:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.848676:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 45 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.848685:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 45 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.848705:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdad2a30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edae5 expref: 45 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.848723:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.848804:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8369 00000100:00100000:2.0:1746147263.848811:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1959:x1830967466063488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.848820:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.848835:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 15 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.848845:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 15 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.848858:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbf600/0xb4b2209fbdad29e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edaad expref: 15 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.848879:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.848912:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8370 00000100:00100000:0.0:1746147263.848919:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466063744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147263.848927:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.848934:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 13 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.848958:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 13 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.848969:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b94a400/0xb4b2209fbdad29ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda9f expref: 13 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.849001:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8371 00000100:00100000:3.0:1746147263.849006:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466064000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147263.849013:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.849020:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 25 pid: 4444 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.849027:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 25 pid: 4444 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.849037:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eb82800/0xb4b2209fbdad299d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eda7c expref: 25 pid: 4444 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.849048:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147263.849099:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.849397:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967466063360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 752us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.849404:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8368 00000100:00100000:1.0:1746147263.849423:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8372 00000100:00100000:1.0:1746147263.849428:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466064384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.849435:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.849445:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.849454:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.849465:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c985e00/0xb4b2209fbdad2db0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc89 expref: 25 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.849474:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.849508:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1959:x1830967466063488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 697us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.849512:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466064000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 506us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.849514:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8369 00000100:00100000:3.0:1746147263.849518:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8371 00000100:00100000:2.0:1746147263.849557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.849572:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063616 00000100:00100000:2.0:1746147263.849575:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063616 00010000:00010000:2.0:1746147263.849587:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 25 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.849600:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8373 00000100:00100000:2.0:1746147263.849603:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466063616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147263.849604:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466063744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 685us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.849609:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8370 00010000:00010000:2.0:1746147263.849610:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.849618:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 25 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.849625:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 25 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.849635:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094060000/0xb4b2209fbdad2a99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb0f expref: 25 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.849647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.849658:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466063872 00000100:00100000:0.0:1746147263.849661:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466063872 00010000:00010000:0.0:1746147263.849672:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 14 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.849690:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8374 00000100:00100000:0.0:1746147263.849694:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967466063872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147263.849700:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.849709:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 14 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.849718:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 14 pid: 17530 timeout: 750 lvb_type: 1 00010000:00010000:0.0:1746147263.849729:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c984800/0xb4b2209fbdad2def lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcb3 expref: 14 pid: 17530 timeout: 750 lvb_type: 1 00000100:00100000:3.0:1746147263.849881:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064256 00000100:00100000:3.0:1746147263.849884:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064256 00002000:00100000:3.0:1746147263.849911:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1302528->1515519) req@ffff88009f3f3480 x1830967466064256/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.849920:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3480 with x1830967466064256 ext(1302528->1515519) 00010000:00010000:3.0:1746147263.849926:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 44 pid: 17530 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.849934:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 44 pid: 17530 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.849955:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3f3480 00000100:00100000:3.0:1746147263.849973:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2667 00000100:00100000:3.0:1746147263.849979:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967466064256:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147263.850090:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466064384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 661us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.850096:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8372 00010000:00010000:0.0:1746147263.850176:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.850192:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466063872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 497us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.850198:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8374 00010000:00010000:2.0:1746147263.850215:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.850217:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.850222:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.850229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147263.850235:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.850241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147263.850252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147263.850254:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.850267:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466063616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 662us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850272:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8373 00000100:00100000:0.0:1746147263.850290:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467169408:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.850300:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064128 00000100:00100000:2.0:1746147263.850303:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064128 00010000:00010000:2.0:1746147263.850311:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.850321:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064512 00000100:00100000:2.0:1746147263.850323:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064512 00000100:00100000:0.0:1746147263.850327:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467169664:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147263.850331:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 22 pid: 21080 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.850339:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064640 00000100:00100000:2.0:1746147263.850341:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064640 00010000:00010000:2.0:1746147263.850348:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 750 lvb_type: 0 00000100:00100000:0.0:1746147263.850348:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467169792:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147263.850357:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8375 00000100:00100000:2.0:1746147263.850361:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466064128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.850367:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147263.850368:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850373:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850381:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.850388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147263.850391:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065000/0xb4b2209fbdad2e04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc1 expref: 12 pid: 4444 timeout: 750 lvb_type: 1 00000100:00100000:0.0:1746147263.850397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147263.850399:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147263.850408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.850410:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466064128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850415:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8375 00000100:00100000:2.0:1746147263.850422:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064768 00000100:00100000:2.0:1746147263.850424:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064768 00010000:00010000:2.0:1746147263.850432:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 23 pid: 4445 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.850440:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466065024 00000100:00100000:2.0:1746147263.850441:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466065024 00010000:00010000:2.0:1746147263.850447:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 24 pid: 8478 timeout: 750 lvb_type: 1 00000100:00100000:2.0:1746147263.850455:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466065152 00000100:00100000:2.0:1746147263.850456:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466065152 00010000:00010000:2.0:1746147263.850463:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.850471:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8376 00000100:00100000:2.0:1746147263.850474:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466064512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.850482:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.850489:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 24 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850495:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 24 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850505:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdad2d47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc43 expref: 24 pid: 21080 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850512:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.850521:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466064512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850525:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8376 00000100:00100000:2.0:1746147263.850533:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8377 00000100:00100000:2.0:1746147263.850536:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967466064640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.850541:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.850547:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.850553:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.850562:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad2da2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc7b expref: 45 pid: 8480 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.850572:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.850573:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.850576:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850581:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850592:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.850599:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967466064640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850603:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8377 00000100:00100000:2.0:1746147263.850609:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8378 00000100:00100000:2.0:1746147263.850613:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466064768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.850618:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.850623:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 22 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850630:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 22 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850637:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d800/0xb4b2209fbdad2aa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edb1d expref: 22 pid: 4445 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850643:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.850645:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.850647:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850652:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850661:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.850668:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466064768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850671:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8378 00000100:00100000:2.0:1746147263.850677:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8379 00000100:00100000:2.0:1746147263.850680:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1957:x1830967466065024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.850685:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.850694:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 20 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850701:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 20 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850709:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdad2d40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc51 expref: 20 pid: 8478 timeout: 750 lvb_type: 1 00010000:00010000:2.0:1746147263.850714:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.850721:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+19:1957:x1830967466065024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850725:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8379 00000100:00100000:2.0:1746147263.850731:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8380 00000100:00100000:2.0:1746147263.850735:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967466065152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.850739:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.850743:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.850750:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.850758:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0e400/0xb4b2209fbdad2cde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc19 expref: 24 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.850767:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147263.850773:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466065152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850777:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8380 00010000:00010000:2.0:1746147263.850797:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850803:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850820:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850827:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850837:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850843:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef65e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147263.850847:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850854:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850862:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.850868:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef65e00/0xb4b2209fbdad2e66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.850900:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466062592:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15897us (16080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.850906:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16337 00000100:00100000:3.0:1746147263.850994:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967467169536:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147263.851019:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851033:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851039:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851057:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851071:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851077:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851081:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094423800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147263.851084:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851086:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851090:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851093:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851099:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.851104:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094423800/0xb4b2209fbdad2e6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851109:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851115:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851120:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851124:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801301db600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147263.851127:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.851129:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967466062848:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 16016us (16276us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147263.851132:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.851135:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16338 00010000:00010000:1.0:1746147263.851140:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851145:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801301db600/0xb4b2209fbdad2e74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.851170:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466063104:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15866us (16291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.851175:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16339 00000100:00100000:0.0:1746147263.851208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.851215:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466064896 00000100:00100000:1.0:1746147263.851219:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466064896 00010000:00010000:1.0:1746147263.851236:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 12 pid: 8480 timeout: 750 lvb_type: 1 00000100:00100000:1.0:1746147263.851257:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8381 00000100:00100000:1.0:1746147263.851262:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1958:x1830967466064896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.851270:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.851277:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 12 pid: 8480 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.851285:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 12 pid: 8480 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.851301:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef64600/0xb4b2209fbdad2dfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcc8 expref: 12 pid: 8480 timeout: 750 lvb_type: 1 00010000:00010000:1.0:1746147263.851308:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.851309:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.851311:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851317:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.851336:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147263.851344:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.851346:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1958:x1830967466064896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.851351:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8381 00010000:00010000:0.0:1746147263.851352:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851364:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851370:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851375:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851380:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c984200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147263.851382:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851387:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851394:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147263.851399:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c984200/0xb4b2209fbdad2e89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147263.851422:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466063232:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15741us (15808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147263.851428:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16342 00000100:00100000:0.0:1746147263.851887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.852023:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466065280 00000100:00100000:1.0:1746147263.852026:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466065280 00010000:00010000:1.0:1746147263.852038:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 750 lvb_type: 0 00000100:00100000:1.0:1746147263.852052:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8382 00000100:00100000:1.0:1746147263.852057:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466065280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147263.852077:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147263.852085:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.852095:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.852106:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad2cd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc12 expref: 23 pid: 21080 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.852115:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.852117:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.852119:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.852126:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.852144:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147263.852162:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466065280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.852172:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8382 00010000:00010000:3.0:1746147263.852276:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852285:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852299:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852305:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852311:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852316:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369ae400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147263.852319:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852325:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852334:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.852340:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369ae400/0xb4b2209fbdad2e7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.852374:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466062720:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 17045us (17480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147263.852380:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16340 00000100:00100000:3.0:1746147263.857617:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967466064256:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7626us (9151us total) trans 17179874176 rc 0/0 00000100:00100000:3.0:1746147263.857629:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2667 00002000:00100000:3.0:1746147263.857642:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1302528->1515519) req@ffff88009f3f3480 x1830967466064256/t17179874176(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.857650:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3480 with x1830967466064256 ext(1302528->1515519) 00010000:00010000:3.0:1746147263.857660:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.857675:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.857682:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3f3480 00000100:00100000:0.0:1746147263.860444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.860850:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466065408 00000100:00100000:2.0:1746147263.860859:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466065408 00010000:00010000:2.0:1746147263.860895:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.861114:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8383 00000100:00100000:2.0:1746147263.861122:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967466065408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.861138:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.861160:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.861172:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.861195:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948bc200/0xb4b2209fbdad2db7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1515519) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc90 expref: 45 pid: 17530 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.861221:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.861223:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.861228:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.861237:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.861264:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147263.861288:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861298:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.861299:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967466065408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 179us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.861306:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8383 00010000:00010000:1.0:1746147263.861320:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861328:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861336:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861342:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bbac00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147263.861346:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861352:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861362:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.861367:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bbac00/0xb4b2209fbdad2e82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147263.861415:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967466062976:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 25915us (26508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.861423:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16341 00000100:00100000:0.0:1746147263.863314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.863359:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466065664 00000100:00100000:3.0:1746147263.863365:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466065664 00000100:00100000:3.0:1746147263.863556:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11620 00000100:00100000:3.0:1746147263.863564:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32292:x1830967466065664:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147263.863615:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147263.863636:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c52e000/0xb4b2209fbdad2e27 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcd6 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.863652:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.863655:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147263.863696:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32292:x1830967466065664:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 134us (388us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746147263.863702:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11620 00000100:00100000:0.0:1746147263.865832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.866540:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466065920 00000100:00100000:1.0:1746147263.866552:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466065920 00000100:00100000:1.0:1746147263.866608:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4897 00000100:00100000:1.0:1746147263.866615:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32292:x1830967466065920:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147263.866793:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32292:x1830967466065920:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 179us (966us total) trans 8589945665 rc 0/0 00000100:00100000:1.0:1746147263.866800:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4897 00000100:00100000:0.0:1746147263.870448:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.873398:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466066176 00000100:00100000:1.0:1746147263.873412:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466066176 00000100:00100000:1.0:1746147263.873473:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4898 00000100:00100000:1.0:1746147263.873481:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32292:x1830967466066176:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147263.873733:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32292:x1830967466066176:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 251us (3294us total) trans 8589945666 rc 0/0 00000100:00100000:1.0:1746147263.873740:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4898 00000100:00100000:0.0:1746147263.962102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.962635:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466066304 00000100:00100000:1.0:1746147263.962647:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466066304 00000100:00100000:1.0:1746147263.962707:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16343 00000100:00100000:1.0:1746147263.962716:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32296:x1830967466066304:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147263.962737:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147263.962758:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcf2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147263.962787:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417bf, atime: 0x681417bf, ctime: 0x681417bf, blocks: 0x821 00010000:00010000:1.0:1746147263.962808:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.962810:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.962818:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.962842:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.962852:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984200, rc 0) 00000100:00100000:1.0:1746147263.962910:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32296:x1830967466066304:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 195us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.962917:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16343 00000100:00100000:0.0:1746147263.968352:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.968536:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466066560 00000100:00100000:3.0:1746147263.968545:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466066560 00002000:00100000:3.0:1746147263.968585:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1257472->1261567) req@ffff88012c9f1880 x1830967466066560/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.968592:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967466066560 ext(1257472->1261567) 00002000:00010000:3.0:1746147263.968597:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1880 00000100:00100000:3.0:1746147263.968627:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7812 00000100:00100000:3.0:1746147263.968634:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466066560:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147263.968816:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466066560:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 182us (474us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147263.968823:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7812 00002000:00100000:3.0:1746147263.968828:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1257472->1261567) req@ffff88012c9f1880 x1830967466066560/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.968834:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967466066560 ext(1257472->1261567) 00002000:00010000:3.0:1746147263.968836:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1880 00000100:00100000:0.0:1746147263.971928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.972047:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466066816 00000100:00100000:3.0:1746147263.972070:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466066816 00000100:00100000:3.0:1746147263.972136:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11621 00000100:00100000:3.0:1746147263.972144:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:32300:x1830967466066816:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.972173:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.972192:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad2e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edcf9 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.972309:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972321:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972330:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972342:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972347:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972351:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972453:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972460:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972466:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147263.972473:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147263.972561:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972567:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972577:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972582:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7be000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.972585:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972591:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972601:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147263.972604:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.972613:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972618:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972641:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972646:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972651:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972655:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7be800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147263.972657:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972663:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972672:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4d00) 00010000:00010000:3.0:1746147263.972674:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147263.972676:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972680:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be800/0xb4b2209fbdad2eac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147263.972714:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad2e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 323 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.972724:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 322 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.972730:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147263.972732:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147263.972734:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bea00, rc 0) 00000100:00100000:3.0:1746147263.972794:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+322:32300:x1830967466066816:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 651us (871us total) trans 8589945667 rc 0/0 00000100:00100000:3.0:1746147263.972800:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11621 00000100:00100000:0.0:1746147263.976698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.976783:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466066944 00000100:00100000:1.0:1746147263.976790:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466066944 00000100:00100000:1.0:1746147263.976838:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16344 00000100:00100000:1.0:1746147263.976845:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32296:x1830967466066944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147263.976859:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147263.976874:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd00 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147263.976891:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417bf, atime: 0x681417bf, ctime: 0x681417bf, blocks: 0x163f 00010000:00010000:1.0:1746147263.976906:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.976908:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147263.976914:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.976930:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147263.976965:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984800, rc 0) 00000100:00100000:1.0:1746147263.977001:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32296:x1830967466066944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 157us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147263.977006:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16344 00000100:00100000:0.0:1746147263.981052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.981448:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466067072 00000100:00100000:3.0:1746147263.981456:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466067072 00000100:00100000:3.0:1746147263.981501:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16345 00000100:00100000:3.0:1746147263.981507:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+44:32300:x1830967466067072:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147263.981545:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147263.981560:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd07 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.981586:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.981592:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147263.981594:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147263.981596:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 45 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.981619:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 24 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147263.981629:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 24 pid: 11147 timeout: 750 lvb_type: 0 00000100:00100000:3.0:1746147263.981638:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467169920:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.981718:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147263.982821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147263.983007:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466067328 00000100:00100000:3.0:1746147263.983013:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466067328 00002000:00100000:3.0:1746147263.983038:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2154496->2158591) req@ffff8800a478e680 x1830967466067328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.983046:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478e680 with x1830967466067328 ext(2154496->2158591) 00010000:00010000:3.0:1746147263.983051:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.983069:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.983075:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a478e680 00000100:00100000:2.0:1746147263.983424:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467169920:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147263.983455:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2668 00010000:00010000:2.0:1746147263.983455:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 45 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147263.983463:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466067328:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:2.0:1746147263.983470:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bec00, rc 0) 00000100:00100000:2.0:1746147263.983522:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+45:32300:x1830967466067072:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2014us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147263.983531:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16345 00000100:00100000:3.0:1746147263.983578:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466067328:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 116us (762us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147263.983583:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2668 00002000:00100000:3.0:1746147263.983588:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2154496->2158591) req@ffff8800a478e680 x1830967466067328/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147263.983594:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478e680 with x1830967466067328 ext(2154496->2158591) 00010000:00010000:3.0:1746147263.983598:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:3.0:1746147263.983617:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 750 lvb_type: 0 00002000:00010000:3.0:1746147263.983623:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a478e680 00000100:00100000:0.0:1746147263.985410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147263.985478:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466067584 00000100:00100000:1.0:1746147263.985486:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466067584 00000100:00100000:0.0:1746147263.985488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:1.0:1746147263.985516:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2158591) req@ffff88009f730e00 x1830967466067584/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/0 e 0 to 0 dl 1746147274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.985523:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967466067584 ext(2097152->2158591) 00010000:00010000:1.0:1746147263.985530:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.985541:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 25 pid: 11147 timeout: 750 lvb_type: 0 00002000:00010000:1.0:1746147263.985547:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f730e00 00000100:00100000:1.0:1746147263.985573:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2669 00000100:00100000:1.0:1746147263.985579:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466067584:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147263.985647:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466067840 00000100:00100000:2.0:1746147263.985653:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466067840 00000100:00100000:2.0:1746147263.985697:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4899 00000100:00100000:2.0:1746147263.985703:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+26:32296:x1830967466067840:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147263.986030:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32296:x1830967466067840:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 326us (540us total) trans 8589945668 rc 0/0 00000100:00100000:2.0:1746147263.986037:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4899 00000100:00100000:1.0:1746147263.987756:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1959:x1830967466067584:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2171us (2345us total) trans 17179874177 rc 0/0 00000100:00100000:1.0:1746147263.987766:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2669 00002000:00100000:1.0:1746147263.987774:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (2097152->2158591) req@ffff88009f730e00 x1830967466067584/t17179874177(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:639/0 lens 488/448 e 0 to 0 dl 1746147274 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147263.987781:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967466067584 ext(2097152->2158591) 00010000:00010000:1.0:1746147263.987788:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 27 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:1.0:1746147263.987799:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 27 pid: 11147 timeout: 750 lvb_type: 0 00002000:00010000:1.0:1746147263.987805:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f730e00 00000100:00100000:0.0:1746147263.994104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147263.994975:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466067968 00000100:00100000:2.0:1746147263.994986:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466067968 00010000:00010000:2.0:1746147263.995024:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 27 pid: 11147 timeout: 750 lvb_type: 0 00000100:00100000:2.0:1746147263.995145:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8384 00000100:00100000:2.0:1746147263.995154:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466067968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147263.995171:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147263.995194:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 27 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.995206:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 27 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.995230:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c984800/0xb4b2209fbdad2ec1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd00 expref: 27 pid: 11147 timeout: 750 lvb_type: 0 00010000:00010000:2.0:1746147263.995418:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.995421:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147263.995430:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 44 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.995438:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 44 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147263.995479:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 44 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147263.995497:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467170048:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147263.996315:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.002342:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467170048:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147264.002374:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.002450:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967466067968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7291us (8350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.002462:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8384 00000100:00100000:0.0:1746147264.002836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.002976:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466068224 00000100:00100000:1.0:1746147264.002985:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466068224 00002000:00100000:1.0:1746147264.003045:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3129344->3133439) req@ffff88009f731880 x1830967466068224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.003067:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731880 with x1830967466068224 ext(3129344->3133439) 00002000:00010000:1.0:1746147264.003072:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f731880 00000100:00100000:1.0:1746147264.003115:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7813 00000100:00100000:1.0:1746147264.003122:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967466068224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.003294:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967466068224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 172us (463us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147264.003299:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7813 00002000:00100000:1.0:1746147264.003305:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (3129344->3133439) req@ffff88009f731880 x1830967466068224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.003318:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731880 with x1830967466068224 ext(3129344->3133439) 00002000:00010000:1.0:1746147264.003321:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f731880 00000100:00080000:0.0:1746147264.003658:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147264.003760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.003849:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466068480 00000100:00100000:3.0:1746147264.003853:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466068480 00000100:00100000:3.0:1746147264.003882:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11622 00000100:00100000:3.0:1746147264.003887:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+322:32305:x1830967466068480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.003902:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.003919:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd0e expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147264.004354:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147264.004517:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.004530:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.004541:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147264.004551:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.004680:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 325 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.004755:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 324 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.004763:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.004766:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147264.004769:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bf800, rc 0) 00000100:00100000:3.0:1746147264.005079:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:32305:x1830967466068480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1041us (1170us total) trans 8589945669 rc 0/0 00000100:00100000:3.0:1746147264.005085:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11622 00000100:00100000:0.0:1746147264.005293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.005410:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466068608 00000100:00100000:3.0:1746147264.005415:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466068608 00000100:00100000:3.0:1746147264.005452:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16346 00000100:00100000:3.0:1746147264.005457:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:32300:x1830967466068608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.005467:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.005481:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd15 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147264.005501:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417bf, atime: 0x681417be, ctime: 0x681417bf, blocks: 0x102b 00010000:00010000:3.0:1746147264.005514:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.005516:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.005522:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.005532:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.005539:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bfa00, rc 0) 00000100:00080000:0.0:1746147264.005768:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147264.005819:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32300:x1830967466068608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 360us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.005824:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16346 00000100:00100000:0.0:1746147264.007090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.007198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.007226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.007245:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466068736 00000100:00100000:0.0:1746147264.007250:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466068736 00000100:00100000:1.0:1746147264.007254:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466068864 00000100:00100000:1.0:1746147264.007259:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466068864 00000100:00100000:0.0:1746147264.007272:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466068992 00000100:00100000:0.0:1746147264.007274:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466068992 00000100:00100000:1.0:1746147264.007297:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16347 00000100:00100000:0.0:1746147264.007307:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16348 00000100:00100000:0.0:1746147264.007315:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466068864:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147264.007325:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16349 00010000:00010000:0.0:1746147264.007327:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147264.007332:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466068992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.007339:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.007341:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd23 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.007348:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd2a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147264.007362:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x81d 00002000:00010000:0.0:1746147264.007362:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417bf, atime: 0x681417bf, ctime: 0x681417bf, blocks: 0x821 00010000:00010000:3.0:1746147264.007374:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.007374:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.007376:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.007376:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.007382:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 26 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.007382:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.007393:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.007396:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 26 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.007401:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f68800, rc 0) 00010000:00010000:3.0:1746147264.007403:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bf200, rc 0) 00000100:00100000:0.0:1746147264.007432:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967466068864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.007436:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967466068992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 104us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.007436:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967466068736:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147264.007437:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16348 00000100:00100000:3.0:1746147264.007441:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16349 00010000:00010000:1.0:1746147264.007444:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.007456:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd1c expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147264.007488:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x81f 00010000:00010000:1.0:1746147264.007498:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.007500:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.007505:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 46 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.007515:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 46 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147264.007533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.007542:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c985c00, rc 0) 00000100:00100000:1.0:1746147264.007561:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967466068736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 258us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.007566:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16347 00000100:00100000:1.0:1746147264.007577:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466069120 00000100:00100000:1.0:1746147264.007580:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466069120 00000100:00100000:1.0:1746147264.007620:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16350 00000100:00100000:1.0:1746147264.007625:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967466069120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.007630:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.007638:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c984000/0xb4b2209fbdad2f00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd31 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.007797:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467170176:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147264.008228:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.010398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.010420:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.010437:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466069632 00000100:00100000:2.0:1746147264.010437:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466069376 00000100:00100000:3.0:1746147264.010445:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466069632 00000100:00100000:2.0:1746147264.010445:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466069376 00000100:00100000:3.0:1746147264.010481:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11623 00002000:00100000:2.0:1746147264.010482:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2314240->2318335) req@ffff88009ee5e300 x1830967466069376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147264.010487:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32307:x1830967466069632:12345-192.168.203.36@tcp:101:cat.0 00002000:00100000:2.0:1746147264.010492:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e300 with x1830967466069376 ext(2314240->2318335) 00002000:00010000:2.0:1746147264.010497:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5e300 00010000:00010000:3.0:1746147264.010504:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147264.010510:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7814 00000100:00100000:2.0:1746147264.010514:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466069376:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147264.010519:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfc00/0xb4b2209fbdad2f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd38 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.010613:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010625:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010634:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010644:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010652:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010656:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147264.010702:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466069376:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 182us (306us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.010709:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7814 00002000:00100000:2.0:1746147264.010714:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2314240->2318335) req@ffff88009ee5e300 x1830967466069376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.010720:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e300 with x1830967466069376 ext(2314240->2318335) 00002000:00010000:2.0:1746147264.010728:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5e300 00010000:00010000:3.0:1746147264.010765:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010772:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010778:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147264.010786:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00080000:0.0:1746147264.010850:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147264.010864:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010871:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010876:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010881:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7bf400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.010885:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010891:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010900:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.010904:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.010907:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010911:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2f0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010921:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010925:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010929:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010933:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7be600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.010934:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010956:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010962:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800904b5500) 00010000:00010000:3.0:1746147264.010964:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.010966:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.010969:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be600/0xb4b2209fbdad2f15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147264.010973:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467170176:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147264.011000:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfc00/0xb4b2209fbdad2f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 30 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.011014:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 29 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.011019:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.011021:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147264.011023:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bee00, rc 0) 00000100:00100000:3.0:1746147264.011043:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32307:x1830967466069632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 556us (623us total) trans 8589945670 rc 0/0 00000100:00100000:3.0:1746147264.011047:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11623 00010000:00010000:1.0:1746147264.011079:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c984000/0xb4b2209fbdad2f00 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd31 expref: 47 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.011096:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c984000/0xb4b2209fbdad2f00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd31 expref: 47 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.011117:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984000, rc 0) 00000100:00100000:1.0:1746147264.011146:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967466069120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3520us (3613us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.011158:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16350 00000100:00100000:0.0:1746147264.013354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.013686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.014033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.014138:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466069760 00000100:00100000:2.0:1746147264.014147:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466069760 00000100:00100000:2.0:1746147264.014190:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466069888 00000100:00100000:2.0:1746147264.014192:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466069888 00000100:00100000:2.0:1746147264.014210:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466070016 00000100:00100000:2.0:1746147264.014212:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466070016 00000100:00100000:2.0:1746147264.014226:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16351 00000100:00100000:2.0:1746147264.014232:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1958:x1830967466069760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.014255:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.014278:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd3f expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.014306:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.014308:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.014317:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.014336:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.014347:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bba600, rc 0) 00000100:00100000:0.0:1746147264.014569:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16352 00000100:00100000:0.0:1746147264.014576:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967466069888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147264.014591:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.014601:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd46 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.014613:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.014614:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.014625:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.014636:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.014643:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f68600, rc 0) 00000100:00100000:1.0:1746147264.014788:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16353 00000100:00100000:1.0:1746147264.014796:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466070016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.014802:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.014816:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd4d expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.014826:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.014827:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.014831:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 22 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.014851:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 22 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.014858:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c985000, rc 0) 00000100:00100000:2.0:1746147264.015104:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466069760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 871us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.015111:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16351 00000100:00100000:0.0:1746147264.015194:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466069888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 612us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.015200:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16352 00000100:00100000:1.0:1746147264.015256:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466070016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 461us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.015268:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16353 00000100:00100000:2.0:1746147264.016274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.016319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.016368:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466070272 00000100:00100000:0.0:1746147264.016375:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466070272 00000100:00100000:2.0:1746147264.016485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.016516:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466070400 00000100:00100000:2.0:1746147264.016524:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466070400 00000100:00100000:2.0:1746147264.016542:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466070528 00000100:00100000:2.0:1746147264.016544:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466070528 00000100:00100000:2.0:1746147264.016554:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16354 00000100:00100000:0.0:1746147264.016620:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4900 00000100:00100000:0.0:1746147264.016628:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+324:32300:x1830967466070272:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147264.016726:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466070400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.016735:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.016748:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bbb800/0xb4b2209fbdad2f3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd54 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.016807:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467170304:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147264.016863:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:32300:x1830967466070272:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 235us (589us total) trans 8589945671 rc 0/0 00000100:00100000:0.0:1746147264.016869:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4900 00000100:00100000:1.0:1746147264.016918:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16355 00000100:00100000:1.0:1746147264.016926:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466070528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.016932:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.016960:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c984c00/0xb4b2209fbdad2f46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd5b expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.017056:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.017214:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467170432:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147264.017297:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.019598:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467170304:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147264.019643:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bbb800/0xb4b2209fbdad2f3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd54 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.019656:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bbb800/0xb4b2209fbdad2f3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd54 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147264.019990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147264.020119:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147262 -> 1746147263 00000100:00100000:1.0:1746147264.020142:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967467170432:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147264.020163:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c984c00/0xb4b2209fbdad2f46 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd5b expref: 22 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.020177:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c984c00/0xb4b2209fbdad2f46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd5b expref: 22 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.020192:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984c00, rc 0) 00000100:00100000:1.0:1746147264.020244:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466070528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3318us (3758us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.020251:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16355 00010000:00010000:2.0:1746147264.020417:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbb800, rc 0) 00000100:00100000:2.0:1746147264.020445:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466070400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3718us (4119us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.020450:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16354 00000100:00100000:0.0:1746147264.020618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.020653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.020677:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466070784 00000100:00100000:0.0:1746147264.020683:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466070784 00002000:00100000:0.0:1746147264.020731:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009f732d80 x1830967466070784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.020741:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732d80 with x1830967466070784 ext(0->1048575) 00002000:00010000:0.0:1746147264.020746:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f732d80 00000100:00100000:0.0:1746147264.021824:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466071040 00000100:00100000:0.0:1746147264.021830:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466071040 00002000:00100000:0.0:1746147264.021849:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f733100 x1830967466071040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.021856:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967466071040 ext(1048576->2097151) 00002000:00010000:0.0:1746147264.021860:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f733100 00000100:00100000:3.0:1746147264.021913:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466071296 00000100:00100000:3.0:1746147264.021918:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466071296 00000100:00100000:3.0:1746147264.021949:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7815 00000100:00100000:3.0:1746147264.021961:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967466070784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.022146:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7816 00000100:00100000:0.0:1746147264.022151:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967466071040:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:0.0:1746147264.023406:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00100000:3.0:1746147264.023545:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008f9fdc00 x1830967466071296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.023554:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdc00 with x1830967466071296 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.023567:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fdc00 00000100:00100000:3.0:1746147264.023596:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7817 00000100:00100000:3.0:1746147264.023602:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466071296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.032181:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466071040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10018us (11551us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.032195:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7816 00002000:00100000:1.0:1746147264.032216:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f733100 x1830967466071040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.032225:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967466071040 ext(1048576->2097151) 00002000:00010000:1.0:1746147264.032236:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f733100 00000100:00100000:1.0:1746147264.033894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.033914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.033968:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466071552 00000100:00100000:1.0:1746147264.033972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.033977:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466071552 00000100:00100000:1.0:1746147264.033994:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466071808 00000100:00100000:1.0:1746147264.033998:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466071808 00002000:00100000:0.0:1746147264.034015:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009f3f3100 x1830967466071552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.034022:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3100 with x1830967466071552 ext(0->1048575) 00002000:00100000:1.0:1746147264.034023:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f3f3800 x1830967466071808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746147264.034027:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3f3100 00002000:00100000:1.0:1746147264.034031:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3800 with x1830967466071808 ext(1048576->2097151) 00002000:00010000:1.0:1746147264.034035:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3f3800 00000100:00100000:0.0:1746147264.034042:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072064 00000100:00100000:0.0:1746147264.034045:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072064 00000100:00100000:1.0:1746147264.034055:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7818 00002000:00100000:0.0:1746147264.034055:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f3f3b80 x1830967466072064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147264.034071:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466071552:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147264.034071:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3b80 with x1830967466072064 ext(1048576->2097151) 00002000:00010000:0.0:1746147264.034074:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3f3b80 00000100:00100000:0.0:1746147264.034091:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7819 00000100:00100000:0.0:1746147264.034097:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466071808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.034678:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7820 00000100:00100000:2.0:1746147264.034687:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466072064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.035676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.035770:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072320 00000100:00100000:3.0:1746147264.035776:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072320 00002000:00100000:3.0:1746147264.035803:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1257471) req@ffff8800a478f100 x1830967466072320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.035810:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478f100 with x1830967466072320 ext(1048576->1257471) 00002000:00010000:3.0:1746147264.035816:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a478f100 00000100:00100000:3.0:1746147264.035833:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7821 00000100:00100000:3.0:1746147264.035838:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967466072320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.046073:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967466070784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24095us (26068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.046085:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7815 00002000:00100000:3.0:1746147264.046098:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009f732d80 x1830967466070784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.046194:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732d80 with x1830967466070784 ext(0->1048575) 00002000:00010000:3.0:1746147264.046201:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f732d80 00000100:00100000:3.0:1746147264.048001:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466071296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24391us (27340us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.048010:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7817 00002000:00100000:3.0:1746147264.048020:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008f9fdc00 x1830967466071296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.048028:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdc00 with x1830967466071296 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.048033:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fdc00 00000100:00100000:1.0:1746147264.049897:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967466071552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15826us (16003us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.049909:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7818 00002000:00100000:1.0:1746147264.049919:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009f3f3100 x1830967466071552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.049929:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3100 with x1830967466071552 ext(0->1048575) 00002000:00010000:1.0:1746147264.049934:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3f3100 00000100:00100000:3.0:1746147264.054974:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466072320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19095us (19259us total) trans 0 rc 208896/208896 00000100:00100000:3.0:1746147264.054988:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7821 00002000:00100000:3.0:1746147264.055000:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1257471) req@ffff8800a478f100 x1830967466072320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 208896/208896 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.055020:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478f100 with x1830967466072320 ext(1048576->1257471) 00002000:00010000:3.0:1746147264.055027:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a478f100 00000100:00100000:2.0:1746147264.055353:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967466072064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20666us (21379us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.055361:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7820 00002000:00100000:2.0:1746147264.055368:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f3f3b80 x1830967466072064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.055376:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3b80 with x1830967466072064 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.055379:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3f3b80 00000100:00100000:2.0:1746147264.059544:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1958:x1830967466071808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25434us (25615us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.059556:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7819 00002000:00100000:2.0:1746147264.059568:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f3f3800 x1830967466071808/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.059577:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3f3800 with x1830967466071808 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.059584:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3f3800 00000100:00100000:0.0:1746147264.064116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.064411:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072448 00000100:00100000:2.0:1746147264.064422:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072448 00000100:00100000:2.0:1746147264.064592:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16356 00000100:00100000:2.0:1746147264.064601:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+46:32305:x1830967466072448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.064621:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.064640:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd62 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.064669:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.064676:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.064678:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.064681:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 47 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.064711:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 26 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.064724:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 26 pid: 11147 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.064736:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467170560:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.065482:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.067751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.067920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.068019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.068701:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467170560:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.068734:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 47 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.068757:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1b400, rc 0) 00000100:00100000:2.0:1746147264.068802:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+47:32305:x1830967466072448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4202us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.068811:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16356 00000100:00100000:0.0:1746147264.068979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.069039:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072832 00000100:00100000:2.0:1746147264.069045:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072832 00000100:00100000:2.0:1746147264.069081:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072704 00000100:00100000:2.0:1746147264.069082:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072704 00000100:00100000:3.0:1746147264.069083:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072960 00000100:00100000:3.0:1746147264.069088:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072960 00000100:00100000:1.0:1746147264.069090:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16357 00000100:00100000:1.0:1746147264.069099:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967466072832:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147264.069100:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16358 00000100:00100000:2.0:1746147264.069103:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1959:x1830967466072704:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147264.069113:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16359 00000100:00100000:3.0:1746147264.069118:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967466072960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.069119:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147264.069123:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466072576 00000100:00100000:2.0:1746147264.069125:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466072576 00010000:00010000:3.0:1746147264.069127:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.069131:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.069137:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2f5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd77 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.069137:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c984600/0xb4b2209fbdad2f54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd69 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147264.069144:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1257472->2097151) req@ffff88008f9fc000 x1830967466072576/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.069152:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc000 with x1830967466072576 ext(1257472->2097151) 00010000:00010000:2.0:1746147264.069157:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 30 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.069168:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 30 pid: 11147 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.069173:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fc000 00000100:00100000:1.0:1746147264.069176:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467170688:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147264.069178:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467170816:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147264.069184:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2670 00000100:00100000:2.0:1746147264.069188:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466072576:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147264.069225:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00010000:00010000:1.0:1746147264.069236:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c984e00/0xb4b2209fbdad2f62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd70 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.069260:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a478ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467170944:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147264.069673:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.069822:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.071045:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467170688:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147264.071079:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c984600/0xb4b2209fbdad2f54 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd69 expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.071090:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c984600/0xb4b2209fbdad2f54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd69 expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.071121:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984600, rc 0) 00000100:00100000:1.0:1746147264.071157:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967466072704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2052us (3236us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.071164:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16358 00000100:00100000:1.0:1746147264.073598:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a478ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467170944:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147264.073637:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c984e00/0xb4b2209fbdad2f62 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd70 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.073663:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c984e00/0xb4b2209fbdad2f62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd70 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.073681:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c984e00, rc 0) 00000100:00100000:1.0:1746147264.073756:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967466072832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4656us (6010us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.073764:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16357 00000100:00100000:3.0:1746147264.074457:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467170816:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147264.074479:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2f5b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd77 expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.074490:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2f5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd77 expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.075007:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bf000, rc 0) 00000100:00100000:3.0:1746147264.075050:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967466072960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5930us (7029us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147264.075056:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16359 00000100:00100000:0.0:1746147264.076876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.077035:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466073088 00000100:00100000:3.0:1746147264.077044:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466073088 00000100:00100000:3.0:1746147264.077100:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16360 00000100:00100000:3.0:1746147264.077108:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32307:x1830967466073088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.077181:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.077195:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd7e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.077415:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 46 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.077424:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147264.077425:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147264.077429:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.077502:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 46 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.077513:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 46 pid: 21080 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.077524:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467171072:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.077606:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.078900:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467171072:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.079007:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967466072576:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9816us (10026us total) trans 17179874178 rc 0/0 00000100:00100000:2.0:1746147264.079022:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2670 00002000:00100000:2.0:1746147264.079032:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1257472->2097151) req@ffff88008f9fc000 x1830967466072576/t17179874178(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.079042:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc000 with x1830967466072576 ext(1257472->2097151) 00010000:00010000:2.0:1746147264.079053:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 31 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.079075:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 31 pid: 11147 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.079081:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9fc000 00010000:00010000:3.0:1746147264.079107:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.079121:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7be800, rc 0) 00000100:00100000:3.0:1746147264.079141:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32307:x1830967466073088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2035us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.079148:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16360 00000100:00100000:0.0:1746147264.079830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.080094:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466073216 00000100:00100000:2.0:1746147264.080110:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466073216 00002000:00100000:2.0:1746147264.080147:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3129344->3145727) req@ffff88008f9ff800 x1830967466073216/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 16872/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.080155:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff800 with x1830967466073216 ext(3129344->3145727) 00010000:00010000:2.0:1746147264.080160:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 47 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.080170:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 47 pid: 21080 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.080175:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9ff800 00000100:00100000:2.0:1746147264.080203:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2671 00000100:00100000:2.0:1746147264.080209:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967466073216:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147264.080610:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466073216:12345-192.168.203.36@tcp:4:cat.0 Request processed in 401us (781us total) trans 17179874179 rc 0/0 00000100:00100000:2.0:1746147264.080625:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2671 00002000:00100000:2.0:1746147264.080630:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3129344->3145727) req@ffff88008f9ff800 x1830967466073216/t17179874179(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 16872/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.080637:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff800 with x1830967466073216 ext(3129344->3145727) 00010000:00010000:2.0:1746147264.080641:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 49 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.080655:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 49 pid: 21080 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.080661:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9ff800 00000100:00100000:0.0:1746147264.081750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.081808:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466073344 00000100:00100000:2.0:1746147264.081813:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466073344 00010000:00010000:2.0:1746147264.081834:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 30 pid: 11147 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.081866:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8385 00000100:00100000:2.0:1746147264.081872:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967466073344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.081880:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.081895:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 30 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.081902:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 30 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.081924:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c984200/0xb4b2209fbdad2e97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf2 expref: 30 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.081963:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.081964:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.081970:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 48 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.081976:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 48 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.082000:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 48 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.082008:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467171200:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.082073:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.082233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.082364:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466073472 00000100:00100000:2.0:1746147264.082367:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466073472 00010000:00010000:2.0:1746147264.082381:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 49 pid: 21080 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.082407:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8386 00000100:00100000:2.0:1746147264.082412:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1959:x1830967466073472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.082419:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.082428:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 49 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.082435:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 49 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.082444:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2ec8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd07 expref: 49 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.082451:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.082452:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.082455:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.082460:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.082568:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.082576:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467171328:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.082608:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.083858:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467171328:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147264.083875:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.083973:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967467171200:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147264.083982:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.084072:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1959:x1830967466073472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1648us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.084081:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8386 00000100:00100000:0.0:1746147264.084170:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967466073344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2298us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.084176:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8385 00000100:00100000:0.0:1746147264.085631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.085695:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466073728 00000100:00100000:2.0:1746147264.085709:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466073728 00002000:00100000:2.0:1746147264.085755:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008f9fdf80 x1830967466073728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.085770:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdf80 with x1830967466073728 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.085774:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fdf80 00000100:00100000:2.0:1746147264.085810:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7822 00000100:00100000:2.0:1746147264.085816:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967466073728:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.089181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.089208:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466073984 00000100:00100000:1.0:1746147264.089217:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466073984 00002000:00100000:1.0:1746147264.089261:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a478ed80 x1830967466073984/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.089272:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478ed80 with x1830967466073984 ext(2097152->3145727) 00002000:00010000:1.0:1746147264.089278:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a478ed80 00000100:00100000:1.0:1746147264.089315:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7823 00000100:00100000:1.0:1746147264.089324:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967466073984:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.094114:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967466073728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8284us (8474us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.094128:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7822 00002000:00100000:3.0:1746147264.094141:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88008f9fdf80 x1830967466073728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.094151:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fdf80 with x1830967466073728 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.094157:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fdf80 00000100:00100000:1.0:1746147264.095784:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967466073984:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6456us (6606us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.095792:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7823 00002000:00100000:1.0:1746147264.095801:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a478ed80 x1830967466073984/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.095809:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a478ed80 with x1830967466073984 ext(2097152->3145727) 00002000:00010000:1.0:1746147264.095814:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a478ed80 00000100:00100000:0.0:1746147264.102514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.102558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.102608:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466074112 00000100:00100000:1.0:1746147264.102608:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466074240 00000100:00100000:3.0:1746147264.102618:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466074112 00000100:00100000:1.0:1746147264.102618:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466074240 00000100:00100000:1.0:1746147264.102713:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16361 00000100:00100000:1.0:1746147264.102721:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+48:32305:x1830967466074240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.102739:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.102757:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd8c expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.102767:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16362 00000100:00100000:3.0:1746147264.102774:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32307:x1830967466074112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.102783:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.102783:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.102785:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.102792:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 49 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.102793:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd85 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.102806:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 49 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.102812:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.102817:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551fa00, rc 0) 00010000:00010000:3.0:1746147264.102819:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147264.102821:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147264.102824:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.102852:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.102864:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 24 pid: 21080 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.102877:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467171456:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.103365:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:32305:x1830967466074240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 643us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.103375:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16361 00000100:00100000:3.0:1746147264.104321:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.105393:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467171456:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.105423:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.105438:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7be000, rc 0) 00000100:00100000:3.0:1746147264.105485:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32307:x1830967466074112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2711us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.105493:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16362 00000100:00100000:0.0:1746147264.106900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.107008:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466074368 00000100:00100000:1.0:1746147264.107015:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466074368 00002000:00100000:1.0:1746147264.107055:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2318335) req@ffff88008f9fe300 x1830967466074368/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.107073:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe300 with x1830967466074368 ext(2097152->2318335) 00010000:00010000:1.0:1746147264.107081:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 25 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.107094:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 25 pid: 21080 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746147264.107101:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fe300 00000100:00100000:1.0:1746147264.107132:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2672 00000100:00100000:1.0:1746147264.107139:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967466074368:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147264.109770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.109853:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466074624 00000100:00100000:3.0:1746147264.109862:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466074624 00002000:00100000:3.0:1746147264.109900:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009ee5ce00 x1830967466074624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.109911:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ce00 with x1830967466074624 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.109915:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ce00 00000100:00100000:3.0:1746147264.109955:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7824 00000100:00100000:3.0:1746147264.109961:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967466074624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.110575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.110623:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466074880 00000100:00100000:2.0:1746147264.110628:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466074880 00000100:00100000:2.0:1746147264.110658:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11624 00000100:00100000:2.0:1746147264.110664:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32310:x1830967466074880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147264.110680:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.110699:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48c00/0xb4b2209fbdad2f7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd93 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.110786:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.110800:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 324 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.110807:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 30 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.110814:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.110846:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 30 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.110857:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 30 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.110876:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467171584:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.110967:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 324 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.110976:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 324 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.110984:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467171712:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.111006:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.111240:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466074368:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4100us (4341us total) trans 21474841515 rc 0/0 00000100:00100000:0.0:1746147264.111249:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2672 00002000:00100000:0.0:1746147264.111256:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2097152->2318335) req@ffff88008f9fe300 x1830967466074368/t21474841515(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.111264:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fe300 with x1830967466074368 ext(2097152->2318335) 00010000:00010000:0.0:1746147264.111272:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 27 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.111283:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 27 pid: 21080 timeout: 751 lvb_type: 0 00002000:00010000:0.0:1746147264.111288:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f9fe300 00000100:00100000:0.0:1746147264.114217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.114312:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466075008 00000100:00100000:1.0:1746147264.114319:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466075008 00000100:00100000:2.0:1746147264.114328:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467171584:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147264.114328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.114338:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467171712:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.114352:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.114360:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147264.114368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.114376:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466075136 00000100:00100000:1.0:1746147264.114378:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466075136 00010000:00010000:1.0:1746147264.114386:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 31 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.114398:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466075264 00000100:00100000:1.0:1746147264.114400:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466075264 00010000:00010000:1.0:1746147264.114410:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 27 pid: 21080 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.114412:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8387 00000100:00100000:3.0:1746147264.114422:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1959:x1830967466075008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.114435:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.114442:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.114452:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.114472:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2eb3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edcf9 expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.114502:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.114507:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.114513:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.114519:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.114562:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1959:x1830967466075008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.114565:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8388 00000100:00100000:3.0:1746147264.114571:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8387 00000100:00100000:2.0:1746147264.114572:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967466075136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.114580:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.114585:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 31 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.114593:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 31 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.114604:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2f1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd38 expref: 31 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.114622:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.114625:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.114632:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.114639:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.114658:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.114674:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466075136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.114680:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8388 00010000:00010000:3.0:1746147264.114727:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.114733:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147264.114754:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:1.0:1746147264.114768:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8389 00000100:00100000:1.0:1746147264.114774:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967466075264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.114782:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.114802:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 27 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.114811:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 27 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.114893:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48c00/0xb4b2209fbdad2f7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 31 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.114906:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 30 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.114913:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.114915:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147264.114917:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc48a00, rc 0) 00000100:00100000:3.0:1746147264.114971:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32310:x1830967466074880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4307us (4396us total) trans 8589945672 rc 0/0 00000100:00100000:3.0:1746147264.114977:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11624 00010000:00010000:1.0:1746147264.115182:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2ee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2318335) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd15 expref: 27 pid: 21080 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.115226:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.115228:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.115236:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.115244:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.115448:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.115462:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467171840:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.115563:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967466074624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5601us (5802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.115572:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7824 00002000:00100000:2.0:1746147264.115580:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009ee5ce00 x1830967466074624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147264.115585:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00002000:00100000:2.0:1746147264.115589:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ce00 with x1830967466074624 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.115593:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ce00 00000100:00100000:1.0:1746147264.118878:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467171840:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147264.118902:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.118973:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967466075264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4198us (4603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.118984:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8389 00000100:00100000:0.0:1746147264.120007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.120101:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466075392 00000100:00100000:3.0:1746147264.120113:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466075392 00000100:00100000:3.0:1746147264.120173:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16363 00000100:00100000:3.0:1746147264.120182:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:32305:x1830967466075392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.120197:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.120211:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edd9a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.120233:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.120235:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.120241:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.120254:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.120264:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bec00, rc 0) 00000100:00100000:3.0:1746147264.120316:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32305:x1830967466075392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 135us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.120323:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16363 00000100:00100000:0.0:1746147264.121718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.122338:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466075776 00000100:00100000:2.0:1746147264.122351:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466075776 00002000:00100000:2.0:1746147264.122392:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fed80 x1830967466075776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.122402:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fed80 with x1830967466075776 ext(3145728->4194303) 00002000:00010000:2.0:1746147264.122407:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fed80 00000100:00100000:2.0:1746147264.122429:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7825 00000100:00100000:2.0:1746147264.122436:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466075776:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.124406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.124450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.124536:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466075648 00000100:00100000:3.0:1746147264.124546:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466075648 00000100:00100000:0.0:1746147264.124580:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466076160 00002000:00100000:3.0:1746147264.124584:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012ecefb80 x1830967466075648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147264.124586:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466076160 00002000:00100000:3.0:1746147264.124594:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecefb80 with x1830967466075648 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.124598:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecefb80 00002000:00100000:0.0:1746147264.124610:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012eced500 x1830967466076160/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.124618:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967466076160 ext(3145728->4194303) 00000100:00100000:3.0:1746147264.124622:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7826 00002000:00010000:0.0:1746147264.124622:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:3.0:1746147264.124630:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967466075648:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147264.124641:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7827 00000100:00100000:0.0:1746147264.124646:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967466076160:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.125224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.125486:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466076544 00000100:00100000:2.0:1746147264.125491:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466076544 00002000:00100000:2.0:1746147264.125511:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f0e00 x1830967466076544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.125520:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967466076544 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.125524:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:2.0:1746147264.125542:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7828 00000100:00100000:2.0:1746147264.125547:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967466076544:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.126097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.126137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.126151:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466076672 00000100:00100000:1.0:1746147264.126155:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466076672 00002000:00100000:1.0:1746147264.126516:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9ffb80 x1830967466076672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.126524:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ffb80 with x1830967466076672 ext(3145728->4194303) 00002000:00010000:1.0:1746147264.126528:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ffb80 00000100:00100000:1.0:1746147264.126543:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466076928 00000100:00100000:1.0:1746147264.126546:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466076928 00002000:00100000:1.0:1746147264.126558:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c85c000 x1830967466076928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.126565:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c000 with x1830967466076928 ext(3145728->4194303) 00002000:00010000:1.0:1746147264.126568:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85c000 00000100:00100000:1.0:1746147264.126589:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7829 00000100:00100000:1.0:1746147264.126594:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967466076672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.127459:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7830 00000100:00100000:0.0:1746147264.127466:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1959:x1830967466076928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.134720:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466075776:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12271us (12991us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147264.134739:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7825 00002000:00100000:0.0:1746147264.134753:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fed80 x1830967466075776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.134764:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fed80 with x1830967466075776 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.134770:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fed80 00000100:00100000:0.0:1746147264.135178:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1958:x1830967466076160:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10530us (10726us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147264.135184:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7827 00002000:00100000:0.0:1746147264.135189:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012eced500 x1830967466076160/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.135196:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967466076160 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.135199:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:3.0:1746147264.136910:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466076544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11355us (11677us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.136920:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7828 00002000:00100000:3.0:1746147264.136929:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012c9f0e00 x1830967466076544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.136954:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967466076544 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.137306:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:1.0:1746147264.143176:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967466076672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16569us (17067us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.143190:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7829 00002000:00100000:1.0:1746147264.143203:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9ffb80 x1830967466076672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.143211:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ffb80 with x1830967466076672 ext(3145728->4194303) 00002000:00010000:1.0:1746147264.143218:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9ffb80 00000100:00100000:3.0:1746147264.143563:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466075648:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18931us (19160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.143571:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7826 00002000:00100000:3.0:1746147264.143577:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012ecefb80 x1830967466075648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.143584:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecefb80 with x1830967466075648 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.143587:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecefb80 00000100:00100000:2.0:1746147264.148129:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1959:x1830967466076928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20649us (21977us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.148142:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7830 00002000:00100000:2.0:1746147264.148154:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012c85c000 x1830967466076928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.148164:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85c000 with x1830967466076928 ext(3145728->4194303) 00002000:00010000:2.0:1746147264.148170:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85c000 00000100:00100000:0.0:1746147264.149297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.149367:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466077056 00000100:00100000:3.0:1746147264.149377:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466077056 00000100:00100000:3.0:1746147264.149432:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16364 00000100:00100000:3.0:1746147264.149439:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32310:x1830967466077056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.149458:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.149479:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edda1 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.149508:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.149517:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.149523:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.149526:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.149529:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3829760->4018175] (req 3829760->4018175) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.149561:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.149574:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 26 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.149588:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467171968:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.150964:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.150978:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.150989:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467172096:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.151279:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.151534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.151660:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466077184 00000100:00100000:1.0:1746147264.151668:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466077184 00000100:00100000:1.0:1746147264.151716:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16365 00000100:00100000:1.0:1746147264.151723:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967466077184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.151737:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.151751:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edda8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.151769:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.151772:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.151781:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.151795:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.151805:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f68c00, rc 0) 00000100:00100000:1.0:1746147264.151846:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967466077184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.151851:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16365 00000100:00100000:3.0:1746147264.152482:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467171968:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.152490:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467172096:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.152519:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3829760->4018175] (req 3829760->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.152528:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bfa00, rc 0) 00000100:00100000:3.0:1746147264.152557:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32310:x1830967466077056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3119us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.152564:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16364 00000100:00100000:0.0:1746147264.153324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.153375:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466077440 00000100:00100000:2.0:1746147264.153380:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466077440 00002000:00100000:2.0:1746147264.153416:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85ce00 x1830967466077440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.153425:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ce00 with x1830967466077440 ext(4194304->4976639) 00002000:00010000:2.0:1746147264.153429:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85ce00 00000100:00100000:2.0:1746147264.153452:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7831 00000100:00100000:2.0:1746147264.153458:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466077440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.155563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.155765:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466077568 00000100:00100000:1.0:1746147264.155773:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466077568 00010000:00010000:1.0:1746147264.155804:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.155841:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8390 00000100:00100000:1.0:1746147264.155849:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466077568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.155862:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.155883:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.155894:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.155916:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad2f93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd9a expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.155958:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.155988:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967466077568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.155993:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8390 00000100:00100000:2.0:1746147264.156209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.156308:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466077696 00000100:00100000:3.0:1746147264.156312:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466077696 00010000:00010000:3.0:1746147264.156327:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.156386:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8391 00000100:00100000:3.0:1746147264.156393:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466077696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.156401:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.156410:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.156420:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.156432:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2f77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd85 expref: 23 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.156643:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.156645:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.156653:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.156661:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.156692:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.156704:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467172224:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147264.157341:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.157390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.157436:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466077952 00000100:00100000:3.0:1746147264.157440:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466077952 00002000:00100000:3.0:1746147264.157465:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85e680 x1830967466077952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.157474:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e680 with x1830967466077952 ext(4194304->4976639) 00002000:00010000:3.0:1746147264.157478:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85e680 00000100:00100000:3.0:1746147264.157591:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7832 00000100:00100000:3.0:1746147264.157598:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466077952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.159165:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466077440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5702us (5837us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147264.159174:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7831 00002000:00100000:3.0:1746147264.159181:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85ce00 x1830967466077440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.159189:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ce00 with x1830967466077440 ext(4194304->4976639) 00002000:00010000:3.0:1746147264.159194:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85ce00 00000100:00100000:3.0:1746147264.159911:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967467172224:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147264.159962:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.159988:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466077696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3594us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.159996:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8391 00000100:00100000:0.0:1746147264.160762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.160833:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466078208 00000100:00100000:3.0:1746147264.160840:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466078208 00002000:00100000:3.0:1746147264.160868:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3829760->3833855) req@ffff88012c85fb80 x1830967466078208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.160877:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85fb80 with x1830967466078208 ext(3829760->3833855) 00002000:00010000:3.0:1746147264.160881:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85fb80 00000100:00100000:3.0:1746147264.160910:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7833 00000100:00100000:3.0:1746147264.160918:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466078208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.161073:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466078208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 155us (312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147264.161079:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7833 00002000:00100000:3.0:1746147264.161084:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3829760->3833855) req@ffff88012c85fb80 x1830967466078208/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.161090:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85fb80 with x1830967466078208 ext(3829760->3833855) 00002000:00010000:3.0:1746147264.161093:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85fb80 00000100:00100000:2.0:1746147264.163464:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466077952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5861us (6069us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147264.163472:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7832 00002000:00100000:2.0:1746147264.163480:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85e680 x1830967466077952/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.163487:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85e680 with x1830967466077952 ext(4194304->4976639) 00002000:00010000:2.0:1746147264.163491:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85e680 00000100:00100000:0.0:1746147264.164130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.164180:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466078336 00000100:00100000:3.0:1746147264.164189:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466078336 00000100:00100000:3.0:1746147264.164233:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16366 00000100:00100000:3.0:1746147264.164240:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967466078336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.164255:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.164272:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddaf expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.164351:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467172352:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147264.164390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.164428:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466078592 00000100:00100000:2.0:1746147264.164431:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466078592 00002000:00100000:2.0:1746147264.164453:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (4014080->4018175) req@ffff88012c85ea00 x1830967466078592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.164461:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ea00 with x1830967466078592 ext(4014080->4018175) 00002000:00010000:2.0:1746147264.164464:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85ea00 00000100:00100000:2.0:1746147264.164483:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7834 00000100:00100000:2.0:1746147264.164489:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466078592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.164579:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.164609:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466078592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 119us (218us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.164614:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7834 00002000:00100000:2.0:1746147264.164618:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (4014080->4018175) req@ffff88012c85ea00 x1830967466078592/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.164625:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85ea00 with x1830967466078592 ext(4014080->4018175) 00002000:00010000:2.0:1746147264.164628:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85ea00 00000100:00100000:3.0:1746147264.165545:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467172352:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147264.165571:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fa8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddaf expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.165580:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddaf expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.165592:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7be200, rc 0) 00000100:00100000:3.0:1746147264.165620:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967466078336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1380us (1490us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147264.165625:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16366 00000100:00100000:0.0:1746147264.169906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.170044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.170159:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466078976 00000100:00100000:3.0:1746147264.170170:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466078976 00000100:00100000:3.0:1746147264.170212:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16367 00000100:00100000:3.0:1746147264.170220:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967466078976:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147264.170232:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466078848 00000100:00100000:2.0:1746147264.170237:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466078848 00010000:00010000:3.0:1746147264.170239:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.170256:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2faf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddb6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.170271:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4901 00000100:00100000:2.0:1746147264.170276:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32307:x1830967466078848:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147264.170326:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467172480:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147264.170398:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.170541:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32307:x1830967466078848:12345-192.168.203.36@tcp:35:cat.0 Request processed in 265us (644us total) trans 8589945673 rc 0/0 00000100:00100000:2.0:1746147264.170547:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4901 00000100:00100000:3.0:1746147264.173204:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467172480:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147264.173246:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2faf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddb6 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.173260:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2faf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddb6 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.173828:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bf400, rc 0) 00000100:00100000:3.0:1746147264.173884:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967466078976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3662us (3837us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147264.173896:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16367 00000100:00100000:0.0:1746147264.241167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.241451:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466079232 00000100:00100000:3.0:1746147264.241463:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466079232 00000100:00100000:3.0:1746147264.241526:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11625 00000100:00100000:3.0:1746147264.241534:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:32315:x1830967466079232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.241563:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.241583:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfc00/0xb4b2209fbdad2fb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddbd expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.241697:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241710:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241721:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241735:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241741:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241745:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241859:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241867:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.241874:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147264.241883:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.242087:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242094:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242099:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242105:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7bfe00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.242109:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242116:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242126:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.242130:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.242133:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242139:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfe00/0xb4b2209fbdad2fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242472:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242478:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242487:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242491:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7bf600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.242494:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242498:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242504:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012da84b00) 00010000:00010000:3.0:1746147264.242507:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.242509:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242513:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf600/0xb4b2209fbdad2fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.242553:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bfc00/0xb4b2209fbdad2fb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 327 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.242563:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 326 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.242568:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.242570:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147264.242572:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bf400, rc 0) 00000100:00100000:3.0:1746147264.242634:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+326:32315:x1830967466079232:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1100us (1480us total) trans 8589945674 rc 0/0 00000100:00100000:3.0:1746147264.242640:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11625 00000100:00100000:0.0:1746147264.255780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.255892:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466079360 00000100:00100000:3.0:1746147264.255903:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466079360 00000100:00100000:3.0:1746147264.255982:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16368 00000100:00100000:3.0:1746147264.255990:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+49:32315:x1830967466079360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.256009:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.256027:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddc4 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.256055:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.256074:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.256081:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.256082:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.256086:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3710976->4014079] (req 3710976->4014079) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 50 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.256116:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.256128:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.256139:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467172608:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.256710:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.256721:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.256729:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467172736:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.257573:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.263448:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467172608:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.263460:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467172736:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.263502:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3710976->4014079] (req 3710976->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 50 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.263519:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7be200, rc 0) 00000100:00100000:3.0:1746147264.266483:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+50:32315:x1830967466079360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10480us (10701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.266495:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16368 00000100:00100000:0.0:1746147264.266802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.266856:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466079616 00000100:00100000:3.0:1746147264.266864:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466079616 00010000:00010000:3.0:1746147264.266897:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.266949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.267471:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466079488 00000100:00100000:3.0:1746147264.267475:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466079488 00010000:00010000:3.0:1746147264.267494:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.267513:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8392 00000100:00100000:3.0:1746147264.267520:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466079616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.267535:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147264.267535:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8393 00000100:00100000:1.0:1746147264.267544:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967466079488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.267553:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.267559:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.267563:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.267571:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.267581:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.267603:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be800/0xb4b2209fbdad2f69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd7e expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.267816:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a551fa00/0xb4b2209fbdad2f70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd8c expref: 50 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.267817:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.267820:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.267828:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.267836:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.268072:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147264.268091:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.268104:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467172864:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147264.268125:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466079488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 582us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.268131:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8393 00000100:00100000:3.0:1746147264.269996:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.270032:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467172864:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147264.270054:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.270487:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967466079616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2964us (3685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.270496:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8392 00000100:00100000:0.0:1746147264.272615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.272687:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466079872 00000100:00100000:2.0:1746147264.272696:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466079872 00002000:00100000:2.0:1746147264.272742:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3710976->3715071) req@ffff88012df78e00 x1830967466079872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.272750:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78e00 with x1830967466079872 ext(3710976->3715071) 00002000:00010000:2.0:1746147264.272754:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df78e00 00000100:00100000:2.0:1746147264.272787:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7835 00000100:00100000:2.0:1746147264.272794:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967466079872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147264.272981:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967466079872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 186us (374us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.272987:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7835 00002000:00100000:2.0:1746147264.272993:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3710976->3715071) req@ffff88012df78e00 x1830967466079872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.273000:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df78e00 with x1830967466079872 ext(3710976->3715071) 00002000:00010000:2.0:1746147264.273003:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df78e00 00000100:00100000:0.0:1746147264.275767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.275865:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466080128 00000100:00100000:2.0:1746147264.275877:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466080128 00002000:00100000:2.0:1746147264.275921:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4009984->4014079) req@ffff88012df79880 x1830967466080128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.275930:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79880 with x1830967466080128 ext(4009984->4014079) 00002000:00010000:2.0:1746147264.276235:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79880 00000100:00100000:2.0:1746147264.276441:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7836 00000100:00100000:2.0:1746147264.276451:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1958:x1830967466080128:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147264.277303:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1958:x1830967466080128:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 852us (1545us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.277311:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7836 00002000:00100000:2.0:1746147264.277440:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (4009984->4014079) req@ffff88012df79880 x1830967466080128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.277449:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79880 with x1830967466080128 ext(4009984->4014079) 00002000:00010000:2.0:1746147264.277453:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79880 00000100:00100000:0.0:1746147264.279289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.279383:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466080384 00000100:00100000:2.0:1746147264.279393:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466080384 00000100:00100000:2.0:1746147264.279447:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4902 00000100:00100000:2.0:1746147264.279455:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+326:32315:x1830967466080384:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147264.279733:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+327:32315:x1830967466080384:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 278us (451us total) trans 8589945675 rc 0/0 00000100:00100000:2.0:1746147264.279739:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4902 00000100:00100000:0.0:1746147264.284286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.284359:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466080640 00000100:00100000:3.0:1746147264.284372:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466080640 00000100:00100000:3.0:1746147264.284434:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11626 00000100:00100000:3.0:1746147264.284442:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32317:x1830967466080640:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.284623:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.284643:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2fe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddcb expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.284762:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284774:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284784:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284798:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284804:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284809:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284914:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284923:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.284933:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147264.284980:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.285078:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285085:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285090:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285096:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7be000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.285099:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285106:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285116:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.285119:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.285123:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285128:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad2fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285146:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285151:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285160:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285164:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7bf000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.285166:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285170:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285174:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8a4e00) 00010000:00010000:3.0:1746147264.285176:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.285178:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285181:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad2fee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.285215:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad2fe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.285224:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 33 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.285229:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.285231:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147264.285233:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bea00, rc 0) 00000100:00100000:3.0:1746147264.285635:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32317:x1830967466080640:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1193us (1359us total) trans 8589945676 rc 0/0 00000100:00100000:3.0:1746147264.285642:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11626 00000100:00100000:0.0:1746147264.289624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.289844:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466080896 00000100:00100000:3.0:1746147264.289854:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466080896 00000100:00100000:3.0:1746147264.289907:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4903 00000100:00100000:3.0:1746147264.289914:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32317:x1830967466080896:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147264.290593:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32317:x1830967466080896:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 677us (978us total) trans 8589945677 rc 0/0 00000100:00100000:3.0:1746147264.290601:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4903 00000100:00100000:2.0:1746147264.294396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.294916:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466081280 00000100:00100000:3.0:1746147264.294927:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466081280 00000100:00100000:3.0:1746147264.294999:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11627 00000100:00100000:3.0:1746147264.295007:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32322:x1830967466081280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.295036:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.295055:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad3003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddd2 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147264.295079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.295131:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466081152 00000100:00100000:2.0:1746147264.295134:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466081152 00000100:00100000:2.0:1746147264.295361:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11628 00000100:00100000:2.0:1746147264.295368:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32321:x1830967466081152:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.295379:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.295386:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f447400/0xb4b2209fbdad300a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddd9 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147264.295649:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147264.295687:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.295700:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.295710:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.295723:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.295728:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.295733:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.295822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.295849:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466081536 00000100:00100000:1.0:1746147264.295852:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466081536 00010000:00010000:2.0:1746147264.295868:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.295877:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 35 pid: 14048 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147264.295878:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2408448->2412543) req@ffff88012c9f0380 x1830967466081536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147264.295884:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.295887:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00002000:00100000:1.0:1746147264.295887:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967466081536 ext(2408448->2412543) 00002000:00010000:1.0:1746147264.295891:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0380 00010000:00010000:3.0:1746147264.295893:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.295899:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147264.295904:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7837 00010000:00010000:3.0:1746147264.295905:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147264.295908:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466081536:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147264.295909:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.295914:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.295914:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 35 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.295926:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 35 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.295951:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467172992:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.295991:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad3034 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.295998:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad3034 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296003:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad3034 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147264.296011:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:2.0:1746147264.296020:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.296054:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1959:x1830967466081536:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 139us (226us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147264.296072:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7837 00002000:00100000:1.0:1746147264.296077:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2408448->2412543) req@ffff88012c9f0380 x1830967466081536/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.296089:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967466081536 ext(2408448->2412543) 00002000:00010000:1.0:1746147264.296091:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0380 00010000:00010000:3.0:1746147264.296102:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296108:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296113:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296119:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7bee00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.296122:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296128:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296139:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.296141:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.296144:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296149:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad3026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296174:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296178:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296183:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296186:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7bf000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.296188:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296193:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296198:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6c00) 00010000:00010000:3.0:1746147264.296200:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.296202:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296206:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad302d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.296237:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad3003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd2 expref: 37 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.296247:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad3034 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd2 expref: 36 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.296253:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.296255:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147264.296257:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.296262:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.296267:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7be000, rc 0) 00000100:00100000:3.0:1746147264.296289:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+36:32322:x1830967466081280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1283us (1904us total) trans 8589945678 rc 0/0 00000100:00100000:3.0:1746147264.296295:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11627 00000100:00100000:0.0:1746147264.298885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.298933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.299044:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466081664 00000100:00100000:1.0:1746147264.299053:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466081664 00000100:00100000:2.0:1746147264.299100:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467172992:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.299101:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 36 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.299121:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.299126:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466081792 00000100:00100000:1.0:1746147264.299128:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466081792 00000100:00100000:1.0:1746147264.299145:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8394 00000100:00100000:1.0:1746147264.299150:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+37:1956:x1830967466081664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.299161:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.299167:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 37 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.299178:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 37 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.299198:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc48a00/0xb4b2209fbdad2f85 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd93 expref: 37 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.299216:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.299221:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.299229:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.299239:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.299254:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.299299:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+36:1956:x1830967466081664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.299306:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8394 00000100:00100000:0.0:1746147264.299342:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 800 00000100:00100000:0.0:1746147264.299348:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1956:x1830967466081792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.299354:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.299358:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.299363:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7be000/0xb4b2209fbdad3034 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd2 expref: 35 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.299365:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.299368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147264.299378:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147264.299381:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.299393:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1956:x1830967466081792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.299399:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 800 00000004:00200000:2.0:1746147264.299405:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:2.0:1746147264.299409:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746147264.299417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00010000:2.0:1746147264.299427:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147264.299432:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466082176 00000100:00100000:0.0:1746147264.299435:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466082176 00010000:00010000:2.0:1746147264.299436:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.299445:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.299451:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.299457:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00002000:00100000:0.0:1746147264.299459:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2506752->2510847) req@ffff88012c9f2a00 x1830967466082176/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147264.299463:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f446200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.299466:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00002000:00100000:0.0:1746147264.299468:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967466082176 ext(2506752->2510847) 00010000:00010000:2.0:1746147264.299473:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00002000:00010000:0.0:1746147264.299474:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2a00 00010000:00010000:2.0:1746147264.299482:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00000100:00100000:1.0:1746147264.299483:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466081920 00010000:00010000:2.0:1746147264.299485:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147264.299485:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7838 00000100:00100000:1.0:1746147264.299486:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466081920 00010000:00010000:2.0:1746147264.299488:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147264.299490:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466082176:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:2.0:1746147264.299492:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.299503:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16369 00010000:00010000:2.0:1746147264.299506:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.299507:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967466081920:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.299510:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.299514:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.299515:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.299518:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85c3c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.299520:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.299525:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.299526:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f69a00/0xb4b2209fbdad3042 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edde0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.299531:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6c00) 00010000:00010000:2.0:1746147264.299533:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.299536:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.299540:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad3018 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.299559:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467173120:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147264.299571:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f447400/0xb4b2209fbdad300a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.299580:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 13 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.299585:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.299587:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147264.299589:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486400, rc 0) 00000100:00100000:1.0:1746147264.299606:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.299612:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32321:x1830967466081152:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4244us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.299618:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11628 00000100:00100000:0.0:1746147264.299905:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466082176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 413us (487us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147264.299911:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7838 00002000:00100000:0.0:1746147264.299916:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2506752->2510847) req@ffff88012c9f2a00 x1830967466082176/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.299922:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967466082176 ext(2506752->2510847) 00002000:00010000:0.0:1746147264.299925:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2a00 00002000:00010000:1.0:1746147264.301721:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147263 -> 1746147264 00002000:00010000:1.0:1746147264.301727:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147263 -> 1746147264 00000100:00100000:1.0:1746147264.301746:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467173120:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147264.301769:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f69a00/0xb4b2209fbdad3042 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde0 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.301780:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f69a00/0xb4b2209fbdad3042 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde0 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.301791:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f69a00, rc 0) 00000100:00100000:1.0:1746147264.301836:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967466081920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2327us (2466us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.301843:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16369 00000100:00100000:2.0:1746147264.302327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302407:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466082688 00000100:00100000:2.0:1746147264.302413:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466082688 00000100:00100000:2.0:1746147264.302451:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466082944 00000100:00100000:2.0:1746147264.302453:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466082944 00000100:00100000:2.0:1746147264.302467:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466082560 00000100:00100000:2.0:1746147264.302468:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466082560 00000100:00100000:2.0:1746147264.302479:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16370 00000100:00100000:2.0:1746147264.302485:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466082688:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.302500:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.302513:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddee expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.302529:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302531:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302537:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302549:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302556:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486c00, rc 0) 00000100:00100000:2.0:1746147264.302574:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466082688:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.302578:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16370 00000100:00100000:2.0:1746147264.302587:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16371 00000100:00100000:2.0:1746147264.302590:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466082944:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.302596:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.302604:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddfc expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.302614:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302615:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302619:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302631:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302637:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486600, rc 0) 00000100:00100000:2.0:1746147264.302647:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466082944:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 57us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.302651:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16371 00000100:00100000:2.0:1746147264.302658:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16372 00000100:00100000:2.0:1746147264.302662:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466082560:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.302667:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.302671:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edde7 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.302679:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302680:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302683:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302690:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302695:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00000100:00100000:2.0:1746147264.302705:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466082560:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 44us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.302709:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16372 00000100:00100000:2.0:1746147264.302734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302746:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466082816 00000100:00100000:2.0:1746147264.302748:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466082816 00000100:00100000:2.0:1746147264.302760:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16373 00000100:00100000:2.0:1746147264.302765:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466082816:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.302770:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.302776:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eddf5 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.302785:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302786:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.302790:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302798:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.302804:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486a00, rc 0) 00000100:00100000:2.0:1746147264.302816:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466082816:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 51us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.302820:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16373 00000100:00100000:2.0:1746147264.302849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302858:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466083072 00000100:00100000:2.0:1746147264.302861:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466083072 00000100:00100000:2.0:1746147264.302877:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16374 00000100:00100000:2.0:1746147264.302881:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466083072:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.302886:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.302892:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad3065 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede03 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.302929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.302931:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467173248:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147264.302958:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466083200 00000100:00100000:1.0:1746147264.302961:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466083200 00000100:00100000:1.0:1746147264.302984:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16375 00000100:00100000:1.0:1746147264.302990:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466083200:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147264.302996:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.303002:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f68e00/0xb4b2209fbdad306c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede0a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.303010:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.303025:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467173376:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147264.303046:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.303125:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466082432 00000100:00100000:3.0:1746147264.303128:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466082432 00000100:00100000:3.0:1746147264.303152:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4904 00000100:00100000:3.0:1746147264.303156:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32317:x1830967466082432:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147264.303323:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:32317:x1830967466082432:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 166us (997us total) trans 8589945679 rc 0/0 00000100:00100000:3.0:1746147264.303328:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4904 00000100:00080000:0.0:1746147264.303403:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147264.303406:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746147264.306301:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147263 -> 1746147264 00002000:00010000:1.0:1746147264.306311:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147263 -> 1746147264 00000100:00100000:1.0:1746147264.306338:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467173376:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147264.306370:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f68e00/0xb4b2209fbdad306c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede0a expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.306386:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f68e00/0xb4b2209fbdad306c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede0a expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.306401:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f68e00, rc 0) 00000100:00100000:1.0:1746147264.306448:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466083200:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3456us (3519us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.306457:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16375 00000100:00100000:2.0:1746147264.306649:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467173248:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147264.306667:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad3065 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede03 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.306676:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487200/0xb4b2209fbdad3065 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede03 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.306688:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:2.0:1746147264.306708:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466083072:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3825us (3858us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.306714:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16374 00000100:00100000:0.0:1746147264.308492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.308674:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466083456 00000100:00100000:2.0:1746147264.308682:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466083456 00000100:00100000:2.0:1746147264.308729:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11629 00000100:00100000:2.0:1746147264.308737:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:32321:x1830967466083456:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.308754:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.308771:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede11 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.308862:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.308878:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.308884:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.308914:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.308925:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 14 pid: 14047 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.308960:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467173504:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.309039:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.309607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.309701:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466083712 00000100:00100000:2.0:1746147264.309705:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466083712 00002000:00100000:2.0:1746147264.309730:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df7b800 x1830967466083712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.309739:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b800 with x1830967466083712 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.309744:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7b800 00000100:00100000:2.0:1746147264.310313:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7839 00000100:00100000:2.0:1746147264.310321:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967466083712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.312633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.312995:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467173504:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.313022:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:3.0:1746147264.313045:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466083840 00000100:00100000:3.0:1746147264.313051:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466083840 00010000:00010000:3.0:1746147264.313096:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 15 pid: 14047 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.313138:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8395 00000100:00100000:3.0:1746147264.313146:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1957:x1830967466083840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.313160:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.313166:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 15 pid: 14047 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.313177:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 15 pid: 14047 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.313314:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdad301f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddd9 expref: 15 pid: 14047 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.313332:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.313336:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.313344:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.313351:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.313371:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.313409:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1957:x1830967466083840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 263us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.313416:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8395 00010000:00010000:3.0:1746147264.313438:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.313444:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147264.313462:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.313606:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446200/0xb4b2209fbdad3073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede11 expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.313618:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede11 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.313624:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.313627:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147264.313629:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f446a00, rc 0) 00000100:00100000:3.0:1746147264.313648:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32321:x1830967466083456:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4912us (5162us total) trans 8589945680 rc 0/0 00000100:00100000:3.0:1746147264.313654:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11629 00000100:00100000:0.0:1746147264.322311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.322387:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084096 00000100:00100000:3.0:1746147264.322397:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084096 00000100:00100000:3.0:1746147264.322452:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11630 00000100:00100000:3.0:1746147264.322460:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:32321:x1830967466084096:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147264.322483:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.322486:0:14047:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147264.322514:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f446a00/0xb4b2209fbdad307a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede11 expref: 14 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.322548:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.322552:0:14047:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147264.322566:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad3088 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede18 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.322656:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad308f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.322672:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad308f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.322679:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad308f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:3.0:1746147264.322689:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.322793:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf000/0xb4b2209fbdad3088 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede18 expref: 16 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.322807:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad308f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede18 expref: 15 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.322813:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.322816:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147264.322818:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bee00, rc 0) 00000100:00100000:3.0:1746147264.322876:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:32321:x1830967466084096:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 416us (575us total) trans 8589945681 rc 0/0 00000100:00100000:3.0:1746147264.322883:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11630 00000100:00100000:2.0:1746147264.322969:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967466083712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12647us (13361us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.322978:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7839 00002000:00100000:2.0:1746147264.322987:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df7b800 x1830967466083712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.322995:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7b800 with x1830967466083712 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.323000:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7b800 00000100:00100000:0.0:1746147264.324427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.324515:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084224 00000100:00100000:3.0:1746147264.324859:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084224 00000100:00100000:3.0:1746147264.324903:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11631 00000100:00100000:3.0:1746147264.324911:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:32321:x1830967466084224:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147264.324933:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.324975:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad309d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede1f expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.325028:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad309d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede1f expref: 16 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.325040:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad309d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede1f expref: 16 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.325065:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.325068:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147264.325071:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bec00, rc 0) 00000100:00100000:3.0:1746147264.325123:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:32321:x1830967466084224:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 212us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.325129:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11631 00000100:00100000:0.0:1746147264.329459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.329587:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084480 00000100:00100000:2.0:1746147264.329598:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084480 00000100:00100000:0.0:1746147264.329688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.329741:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084352 00000100:00100000:2.0:1746147264.329744:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084352 00000100:00100000:0.0:1746147264.329755:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16376 00000100:00100000:0.0:1746147264.329762:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:32322:x1830967466084480:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147264.329778:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16377 00010000:00010000:0.0:1746147264.329780:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147264.329782:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466084352:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147264.329798:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede26 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.329808:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.329822:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 48 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.329822:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 48 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.329829:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.329830:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 10 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.329831:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147264.329834:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.329836:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.329863:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 48 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.329874:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 48 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.329886:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467173632:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.329982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.329983:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.329997:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084608 00000100:00100000:1.0:1746147264.330000:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084608 00000100:00100000:0.0:1746147264.330006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.330016:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084736 00000100:00100000:1.0:1746147264.330018:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084736 00000100:00100000:0.0:1746147264.330018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.330037:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084864 00000100:00100000:1.0:1746147264.330039:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084864 00000100:00100000:1.0:1746147264.330053:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16378 00000100:00100000:1.0:1746147264.330068:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466084608:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147264.330088:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.330092:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16379 00000100:00100000:3.0:1746147264.330099:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466084736:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147264.330099:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.330106:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330113:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.330113:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.330118:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.330120:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.330121:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.330122:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.330128:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330134:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 21 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.330137:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330140:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.330141:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.330144:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.330144:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 21 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.330153:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467173760:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.330156:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 21 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330162:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 21 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.330170:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467173888:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.330178:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.330185:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 12 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.330189:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147264.330192:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467174016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.330195:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 12 pid: 8480 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.330201:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467174144:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.330210:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330217:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.330217:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 25 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.330224:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.330224:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467174272:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.330230:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467174400:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.330236:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.330241:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.330254:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16380 00000100:00100000:3.0:1746147264.330259:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466084864:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147264.330287:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.330289:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.330290:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.330314:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.330322:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 30 pid: 8478 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.330329:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467174528:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.330356:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.330364:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 11 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.330371:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467174656:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.330392:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 48 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.330400:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 48 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.330407:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467174784:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147264.330413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.330434:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466084992 00000100:00100000:2.0:1746147264.330436:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466084992 00010000:00010000:3.0:1746147264.330448:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.330493:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 48 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.330499:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330505:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330509:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.330510:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.330512:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.330527:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330534:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 30 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.330542:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467174912:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.330565:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.330577:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 12 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.330583:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467175040:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.330601:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 48 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.330608:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 48 pid: 6881 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.330615:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467175168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.330633:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.330657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.330677:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085120 00000100:00100000:2.0:1746147264.330680:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085120 00000100:00100000:2.0:1746147264.330695:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16381 00000100:00100000:2.0:1746147264.330700:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466084992:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147264.330715:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.330721:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.330724:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.330729:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147264.330731:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.330750:0:4444:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.330757:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.330770:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.330909:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16382 00000100:00100000:1.0:1746147264.330915:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1959:x1830967466085120:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147264.330931:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.330975:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.330980:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147264.330982:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147264.330984:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.331001:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 21 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.331008:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 21 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.331016:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467175424:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.331051:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.341702:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467173632:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.341733:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 30 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.341750:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487a00, rc 0) 00000100:00100000:2.0:1746147264.341801:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32322:x1830967466084480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12038us (12352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.341811:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16376 00000100:00100000:0.0:1746147264.342667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.342743:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467173760:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.342746:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467173888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.342753:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467174144:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.342753:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467174016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.342760:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467174400:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.342760:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467174272:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.342780:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.342780:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147264.343074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.343088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.343099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.343118:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085504 00000100:00100000:0.0:1746147264.343123:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085504 00010000:00010000:0.0:1746147264.343150:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 14 pid: 8480 timeout: 751 lvb_type: 1 00000100:00100000:0.0:1746147264.343172:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085376 00000100:00100000:0.0:1746147264.343173:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085376 00010000:00010000:0.0:1746147264.343179:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 15 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:0.0:1746147264.343188:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085632 00000100:00100000:0.0:1746147264.343189:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085632 00010000:00010000:0.0:1746147264.343196:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 26 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.343368:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085248 00000100:00100000:2.0:1746147264.343372:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085248 00002000:00100000:2.0:1746147264.343407:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3710976->4014079) req@ffff880099f69c00 x1830967466085248/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.343416:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967466085248 ext(3710976->4014079) 00010000:00010000:2.0:1746147264.343422:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.343432:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.343437:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69c00 00000100:00100000:2.0:1746147264.343452:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2673 00000100:00100000:2.0:1746147264.343458:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466085248:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147264.343775:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8396 00000100:00100000:0.0:1746147264.343780:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967466085504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.343789:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.343806:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 15 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343815:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 15 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343833:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486a00/0xb4b2209fbdad305e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddf5 expref: 15 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343849:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.343867:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967466085504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.343873:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8396 00000100:00100000:0.0:1746147264.343890:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8397 00000100:00100000:0.0:1746147264.343893:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466085376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.343899:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.343905:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343912:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343920:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486c00/0xb4b2209fbdad3049 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddee expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343926:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.343934:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466085376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.343952:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8397 00000100:00100000:0.0:1746147264.343959:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8398 00000100:00100000:0.0:1746147264.343962:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967466085632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.343967:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.343972:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 26 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343979:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 26 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343990:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f68800/0xb4b2209fbdad2eeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd23 expref: 26 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:0.0:1746147264.343998:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.344091:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466085632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.344096:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8398 00000100:00100000:0.0:1746147264.344128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.344182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.344199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.344526:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085888 00000100:00100000:1.0:1746147264.344531:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085888 00010000:00010000:1.0:1746147264.344546:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.344559:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086016 00000100:00100000:1.0:1746147264.344560:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086016 00010000:00010000:1.0:1746147264.344569:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 22 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.344998:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466085760 00000100:00100000:1.0:1746147264.345001:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466085760 00010000:00010000:1.0:1746147264.345013:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 23 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.345201:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8399 00000100:00100000:2.0:1746147264.345208:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967466085888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.345216:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.345226:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.345235:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.345549:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8400 00000100:00100000:3.0:1746147264.345557:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967466086016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.345563:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147264.345576:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8401 00000100:00100000:0.0:1746147264.345581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.345582:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466085760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.345588:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.345595:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 23 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:0.0:1746147264.345600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.345604:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 23 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.345616:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f68600/0xb4b2209fbdad2f31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd46 expref: 23 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:0.0:1746147264.345623:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.345635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.345642:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.345644:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147264.345648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.345649:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147264.345656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.345657:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.345677:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.345691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.345699:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466085760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.345705:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8401 00000100:00100000:1.0:1746147264.345717:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086656 00000100:00100000:1.0:1746147264.345719:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086656 00010000:00010000:1.0:1746147264.345728:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 30 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.345736:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086272 00000100:00100000:1.0:1746147264.345737:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086272 00010000:00010000:1.0:1746147264.345743:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 31 pid: 8478 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.345749:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086400 00000100:00100000:1.0:1746147264.345750:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086400 00010000:00010000:1.0:1746147264.345756:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 51 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.345762:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086144 00000100:00100000:1.0:1746147264.345764:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086144 00010000:00010000:1.0:1746147264.345770:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.345776:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086528 00000100:00100000:1.0:1746147264.345777:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086528 00010000:00010000:1.0:1746147264.345782:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 14 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.345787:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086912 00000100:00100000:1.0:1746147264.345788:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086912 00010000:00010000:1.0:1746147264.345794:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 52 pid: 6881 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.345800:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8402 00000100:00100000:1.0:1746147264.345803:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967466086656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.345809:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.345819:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 31 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.345826:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 31 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.345837:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bf200/0xb4b2209fbdad2ef2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd2a expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.345837:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147264.346045:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 21 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346054:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 21 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346077:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c985000/0xb4b2209fbdad2f38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd4d expref: 21 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346090:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.346091:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.346094:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346100:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346139:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f68c00/0xb4b2209fbdad2fa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda8 expref: 31 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.346149:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467174912:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.346160:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467175040:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.346167:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467175168:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.346195:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.346215:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8403 00000100:00100000:3.0:1746147264.346221:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967466086272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.346228:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.346239:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 30 pid: 8478 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346245:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 30 pid: 8478 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346255:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.346273:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1959:x1830967466086272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 52us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346278:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8403 00000100:00100000:3.0:1746147264.346289:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8404 00000100:00100000:3.0:1746147264.346293:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1956:x1830967466086400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.346299:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.346305:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 52 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346313:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 52 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346322:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.346335:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1956:x1830967466086400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346340:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8404 00000100:00100000:3.0:1746147264.346349:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8405 00000100:00100000:3.0:1746147264.346353:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967466086144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.346361:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.346367:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 14 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346374:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 14 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346384:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.346385:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.346387:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346393:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346401:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.346413:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967466086144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346419:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8405 00000100:00100000:3.0:1746147264.346427:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8406 00000100:00100000:3.0:1746147264.346431:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466086528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.346437:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.346443:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346451:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346465:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486600/0xb4b2209fbdad3050 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddfc expref: 13 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.346474:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.346485:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466086528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346489:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8406 00000100:00100000:3.0:1746147264.346498:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8407 00000100:00100000:3.0:1746147264.346502:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466086912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.346508:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.346514:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 51 pid: 6881 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.346521:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 51 pid: 6881 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.346531:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b400/0xb4b2209fbdad2f4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd62 expref: 51 pid: 6881 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.346537:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.346538:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.346540:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346546:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346559:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.346571:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967466086912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346576:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8407 00010000:00010000:3.0:1746147264.346589:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346596:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346615:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346622:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346628:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346635:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f446200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147264.346638:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346645:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346660:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346665:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f446200/0xb4b2209fbdad30c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.346704:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466084864:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 16444us (16684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346711:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16380 00010000:00010000:3.0:1746147264.346733:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147264.346744:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346751:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346765:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346771:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346777:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346782:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7be400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147264.346785:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346791:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346800:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.346806:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7be400/0xb4b2209fbdad30b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.346833:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466084736:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 16736us (16827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346838:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16379 00000100:00100000:3.0:1746147264.346856:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1958:x1830967466086016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1300us (2673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.346861:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8400 00000100:00100000:1.0:1746147264.346892:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1959:x1830967466086656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1087us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.346897:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8402 00000100:00100000:1.0:1746147264.346995:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467175424:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.347006:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347030:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347034:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147264.347036:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347048:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347054:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347070:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.347071:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967466085888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1863us (2942us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147264.347075:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134f69400 already unused, calling callback (ffffffffa07dcd70) 00000100:00100000:2.0:1746147264.347077:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8399 00010000:00010000:1.0:1746147264.347078:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347083:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347091:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.347101:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f69400/0xb4b2209fbdad30b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347129:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bba600/0xb4b2209fbdad2f2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd3f expref: 28 pid: 8478 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.347131:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466084608:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 17072us (17149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.347136:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16378 00000100:00100000:2.0:1746147264.347137:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467174528:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.347147:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487e00/0xb4b2209fbdad3057 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edde7 expref: 10 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.347154:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467174656:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.347162:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c985c00/0xb4b2209fbdad2ef9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd1c expref: 49 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.347175:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467174784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.347189:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347196:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347202:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347217:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347226:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347232:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347236:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c434400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147264.347239:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347244:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347253:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.347258:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdad30ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.347286:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466084352:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 17503us (17697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.347292:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16377 00000100:00100000:2.0:1746147264.349303:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466086784 00000100:00100000:2.0:1746147264.349313:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466086784 00002000:00100000:2.0:1746147264.349626:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2408448->4018175) req@ffff880099f6ad80 x1830967466086784/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 504/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.349643:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6ad80 with x1830967466086784 ext(2408448->4018175) 00010000:00010000:2.0:1746147264.349652:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 20 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.349664:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 20 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.349672:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099f6ad80 00000100:00100000:2.0:1746147264.349691:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2674 00000100:00100000:2.0:1746147264.349698:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+20:1956:x1830967466086784:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147264.350598:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466085248:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7138us (7934us total) trans 17179874180 rc 0/0 00000100:00100000:1.0:1746147264.350605:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2673 00002000:00100000:1.0:1746147264.350610:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (3710976->4014079) req@ffff880099f69c00 x1830967466085248/t17179874180(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.350616:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967466085248 ext(3710976->4014079) 00010000:00010000:1.0:1746147264.350621:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.350629:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746147264.350633:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69c00 00000100:00100000:1.0:1746147264.353155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.353791:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466087040 00000100:00100000:2.0:1746147264.353801:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466087040 00010000:00010000:2.0:1746147264.353833:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.353874:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8408 00000100:00100000:2.0:1746147264.353881:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1959:x1830967466087040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.353893:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.353911:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.353922:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.353961:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7be200/0xb4b2209fbdad2fd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3710976->4014079) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddc4 expref: 49 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.353975:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.353977:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.353984:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.353993:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.354026:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.354035:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.354046:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467175552:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.354127:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.356029:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466086784:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6327us (10387us total) trans 21474841516 rc 0/0 00000100:00100000:0.0:1746147264.356038:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2674 00002000:00100000:0.0:1746147264.356046:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2408448->4018175) req@ffff880099f6ad80 x1830967466086784/t21474841516(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 504/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.356053:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6ad80 with x1830967466086784 ext(2408448->4018175) 00010000:00010000:0.0:1746147264.356074:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.356086:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:0.0:1746147264.356093:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099f6ad80 00000100:00100000:2.0:1746147264.356905:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467175552:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147264.356920:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.356972:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1959:x1830967466087040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3092us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.356980:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8408 00000100:00100000:0.0:1746147264.360098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.360263:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466087168 00000100:00100000:2.0:1746147264.360274:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466087168 00010000:00010000:2.0:1746147264.360312:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.360352:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8409 00000100:00100000:2.0:1746147264.360360:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466087168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.360376:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.360399:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.360410:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.360432:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad2f9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->4018175) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edda1 expref: 22 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.360451:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.360453:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.360457:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.360465:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.360488:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.360528:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1956:x1830967466087168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 168us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.360534:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8409 00010000:00010000:0.0:1746147264.361011:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361019:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361041:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361047:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361054:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361070:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134f69e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147264.361073:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361080:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361094:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.361105:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f69e00/0xb4b2209fbdad30ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147264.361152:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466085120:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 30238us (30495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.361160:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16382 00000100:00100000:0.0:1746147264.361577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.361635:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466087424 00000100:00100000:2.0:1746147264.361640:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466087424 00002000:00100000:2.0:1746147264.361691:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880099f68000 x1830967466087424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.361704:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967466087424 ext(2097152->3145727) 00010000:00010000:2.0:1746147264.361712:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.361737:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.361753:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f68000 00000100:00100000:2.0:1746147264.361791:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2675 00000100:00100000:2.0:1746147264.361798:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967466087424:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.370599:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1957:x1830967466087424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8793us (9013us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.370608:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2675 00002000:00100000:2.0:1746147264.370619:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880099f68000 x1830967466087424/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.370626:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967466087424 ext(2097152->3145727) 00010000:00010000:2.0:1746147264.370635:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.370646:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.370651:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f68000 00000100:00100000:0.0:1746147264.375578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.375622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.375625:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466087552 00000100:00100000:2.0:1746147264.375635:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466087552 00000100:00100000:2.0:1746147264.375688:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16383 00000100:00100000:2.0:1746147264.375696:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32322:x1830967466087552:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147264.375711:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466087680 00000100:00100000:1.0:1746147264.375716:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466087680 00010000:00010000:1.0:1746147264.375743:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.375774:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8410 00000100:00100000:1.0:1746147264.375780:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1958:x1830967466087680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.375795:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.375818:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.375830:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.375857:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487a00/0xb4b2209fbdad30a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede26 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.375885:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.375887:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.375891:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.375899:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.375921:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.375985:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1958:x1830967466087680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 205us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.375991:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8410 00010000:00010000:2.0:1746147264.376003:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.376020:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede2d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.376020:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.376029:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147264.376040:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417c0, atime: 0x681417bf, ctime: 0x681417c0, blocks: 0x102b 00010000:00010000:1.0:1746147264.376048:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.376051:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.376053:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.376055:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.376070:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.376072:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.376076:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a551fe00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147264.376081:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.376085:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.376089:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.376094:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551fa00, rc 0) 00010000:00010000:1.0:1746147264.376097:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.376103:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a551fe00/0xb4b2209fbdad30c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.376144:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967466084992:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 45442us (45729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.376150:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16381 00000100:00100000:2.0:1746147264.376355:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32322:x1830967466087552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 659us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.376361:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16383 00000100:00100000:0.0:1746147264.378008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.378125:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466087936 00000100:00100000:3.0:1746147264.378133:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466087936 00000100:00100000:3.0:1746147264.378185:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11632 00000100:00100000:3.0:1746147264.378192:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+16:32321:x1830967466087936:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:3.0:1746147264.378238:0:14047:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.378262:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bec00/0xb4b2209fbdad309d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede1f expref: 16 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378292:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.378297:0:14047:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147264.378351:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.378363:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 326 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378369:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 326 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378376:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378382:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 326 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378388:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 326 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378394:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378400:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 9/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.378425:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378433:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 34 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.378447:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467175680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.378541:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 326 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378549:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 326 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.378556:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467175808:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.378581:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 326 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378587:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 326 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.378594:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467175936:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.378615:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378622:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.378630:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467176064:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.378652:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 326 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378663:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 326 pid: 14047 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.378669:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467176192:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.378690:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 326 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.378697:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 326 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746147264.378703:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467176320:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.378718:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.379223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.379303:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466088192 00000100:00100000:2.0:1746147264.379308:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466088192 00002000:00100000:2.0:1746147264.379338:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880099f6bb80 x1830967466088192/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.379347:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6bb80 with x1830967466088192 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.379351:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6bb80 00000100:00100000:2.0:1746147264.379377:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7840 00000100:00100000:2.0:1746147264.379382:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466088192:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.382777:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467175680:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.382784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.382790:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467175808:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.382797:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467175936:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.382803:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467176064:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.382803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.382809:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467176192:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.382815:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467176320:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.382824:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466088320 00000100:00100000:2.0:1746147264.382829:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466088320 00010000:00010000:3.0:1746147264.382855:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.382859:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 35 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.382893:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8411 00000100:00100000:2.0:1746147264.382901:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+35:1958:x1830967466088320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147264.382910:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466088704 00010000:00010000:2.0:1746147264.382913:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147264.382915:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466088704 00010000:00010000:2.0:1746147264.382918:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 35 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.382929:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 35 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.382963:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4905 00010000:00010000:2.0:1746147264.382964:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad2ff5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddcb expref: 35 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.382970:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+327:7642:x1830967466088704:12345-192.168.203.36@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746147264.382982:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.382986:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.382994:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.383024:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1958:x1830967466088320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.383034:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8411 00000100:00100000:2.0:1746147264.383081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.383091:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466088832 00000100:00100000:2.0:1746147264.383094:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466088832 00010000:00010000:2.0:1746147264.383102:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.383115:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8412 00000100:00100000:2.0:1746147264.383120:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1958:x1830967466088832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.383125:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.383129:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.383136:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.383146:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad2da9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edc82 expref: 34 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.383154:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.383157:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147264.383157:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:7642:x1830967466088704:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 187us (373us total) trans 8589945682 rc 0/0 00010000:00010000:2.0:1746147264.383162:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.383163:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4905 00000100:00100000:2.0:1746147264.383176:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967466088832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.383181:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8412 00000100:00100000:0.0:1746147264.383201:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.383208:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466088448 00000100:00100000:2.0:1746147264.383211:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466088448 00000100:00100000:0.0:1746147264.383218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147264.383219:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 328 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.383231:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466088960 00000100:00100000:2.0:1746147264.383232:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466088960 00010000:00010000:2.0:1746147264.383239:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 329 pid: 14047 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.383249:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8413 00000100:00100000:2.0:1746147264.383254:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1958:x1830967466088448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147264.383254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147264.383259:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.383263:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 329 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.383268:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089088 00010000:00010000:2.0:1746147264.383270:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 329 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.383271:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089088 00010000:00010000:2.0:1746147264.383281:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf400/0xb4b2209fbdad2fcb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949eddbd expref: 330 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.383283:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 330 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.383289:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.383292:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.383297:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.383298:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8414 00000100:00100000:0.0:1746147264.383303:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1958:x1830967466088960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147264.383309:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1958:x1830967466088448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147264.383309:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.383313:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 329 pid: 14047 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.383318:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8413 00010000:00010000:0.0:1746147264.383321:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 329 pid: 14047 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.383327:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8415 00000100:00100000:2.0:1746147264.383331:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+328:1959:x1830967466089088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.383331:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdad2a22 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edad7 expref: 328 pid: 14047 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.383338:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.383339:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.383342:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 327 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.383342:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.383347:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147264.383349:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 327 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.383358:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdad2a14 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edac9 expref: 327 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.383362:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+327:1958:x1830967466088960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (143us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147264.383365:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.383368:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147264.383368:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8414 00010000:00010000:2.0:1746147264.383372:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.383383:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1959:x1830967466089088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.383388:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8415 00000100:00100000:0.0:1746147264.392762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.392843:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089216 00000100:00100000:1.0:1746147264.392853:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089216 00010000:00010000:1.0:1746147264.392889:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.392907:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466088192:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13522us (13682us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.392918:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7840 00000100:00100000:1.0:1746147264.392927:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8416 00002000:00100000:2.0:1746147264.392928:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880099f6bb80 x1830967466088192/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.392965:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6bb80 with x1830967466088192 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.392970:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6bb80 00000100:00100000:1.0:1746147264.393083:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1959:x1830967466089216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.393100:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.393107:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.393118:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.393140:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bf800/0xb4b2209fbdad2ed6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edd0e expref: 325 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.393158:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.393164:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.393171:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.393177:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.393206:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147264.393228:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:3.0:1746147264.393242:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000100:00100000:1.0:1746147264.393244:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1959:x1830967466089216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 308us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.393250:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8416 00000040:00080000:3.0:1746147264.394238:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3504, 88 off293848 00000004:00080000:3.0:1746147264.394247:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651381309200ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.394308:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3491, 88 off292704 00000004:00080000:3.0:1746147264.394313:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651381375683ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.394337:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3492, 88 off292792 00000004:00080000:3.0:1746147264.394340:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651381402586ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.394348:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3505, 88 off293936 00000004:00080000:3.0:1746147264.394351:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651381413356ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.394356:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3506, 88 off294024 00000004:00080000:3.0:1746147264.394359:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651381421426ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.394365:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3493, 88 off292880 00000004:00080000:3.0:1746147264.394367:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651381430250ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.394482:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3494, 88 off292968 00000004:00080000:3.0:1746147264.394486:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651381549090ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.396688:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3495, 88 off293056 00000004:00080000:3.0:1746147264.396700:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651383762748ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.396734:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3507, 88 off294112 00000004:00080000:3.0:1746147264.396738:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651383800762ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.396750:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3496, 88 off293144 00000004:00080000:3.0:1746147264.396753:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651383815371ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.396761:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3508, 88 off294200 00000004:00080000:3.0:1746147264.396763:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651383826269ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.396771:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3497, 88 off293232 00000004:00080000:3.0:1746147264.396775:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651383837692ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147264.396784:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3509, 88 off294288 00000004:00080000:3.0:1746147264.396787:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651383849452ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.396796:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3510, 88 off294376 00000004:00080000:3.0:1746147264.396799:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651383861779ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.396808:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3511, 88 off294464 00000004:00080000:3.0:1746147264.396811:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651383873536ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.396819:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3512, 88 off294552 00000004:00080000:3.0:1746147264.396824:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651383887259ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147264.396834:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3498, 88 off293320 00000004:00080000:3.0:1746147264.396836:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651383898979ns, next at 607576201812ns, rc = 0 00000100:00100000:1.0:1746147264.397091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.397162:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089344 00000100:00100000:2.0:1746147264.397170:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089344 00000100:00100000:2.0:1746147264.397224:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16384 00000100:00100000:2.0:1746147264.397232:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+27:32322:x1830967466089344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.397245:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.397260:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede34 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147264.397277:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417c0, atime: 0x681417bf, ctime: 0x681417c0, blocks: 0x163f 00010000:00010000:2.0:1746147264.397293:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.397295:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.397302:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.397314:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.397323:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e800, rc 0) 00000100:00100000:2.0:1746147264.397369:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+28:32322:x1830967466089344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.397374:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16384 00000100:00100000:1.0:1746147264.400507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.400719:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089472 00000100:00100000:0.0:1746147264.400729:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089472 00000100:00100000:0.0:1746147264.400778:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11633 00000100:00100000:0.0:1746147264.400785:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+33:32322:x1830967466089472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147264.400810:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.400832:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede3b expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.400886:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.400895:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.400911:0:14048:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.400921:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.400932:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147264.400934:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147264.400967:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.400974:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c985c00, rc 0) 00000100:00100000:0.0:1746147264.401017:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+34:32322:x1830967466089472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 233us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.401023:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11633 00000100:00100000:3.0:1746147264.402251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.402285:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089728 00000100:00100000:3.0:1746147264.402292:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089728 00000100:00100000:3.0:1746147264.402323:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11634 00000100:00100000:3.0:1746147264.402330:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:32326:x1830967466089728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.402348:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.402362:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad30f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede42 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.402447:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.402457:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.402467:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.402476:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.402482:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.402486:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00010000:0.0:1746147264.429128:0:14047:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099f6aa00 reply state ffff880092afa400 transno 8589945683 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00000001:00080000:1.0:1746147264.429187:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945682 is committed 00000001:00080000:1.0:1746147264.429205:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945630 is committed 00000001:00080000:1.0:1746147264.429212:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945666 is committed 00000100:00100000:0.0:1746147264.429216:0:14047:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746147264.429220:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945661 is committed 00000001:00080000:1.0:1746147264.429250:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945673 is committed 00000001:00080000:1.0:1746147264.429288:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945683 is committed 00000004:00080000:1.0:1746147264.429291:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2624 committed 00000004:00080000:1.0:1746147264.429300:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2634 committed 00000004:00080000:1.0:1746147264.429307:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2633 committed 00000004:00080000:1.0:1746147264.429310:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2632 committed 00000004:00080000:1.0:1746147264.429312:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2631 committed 00000004:00080000:1.0:1746147264.429313:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2623 committed 00000004:00080000:1.0:1746147264.429315:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2630 committed 00000004:00080000:1.0:1746147264.429317:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2622 committed 00000004:00080000:1.0:1746147264.429319:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2629 committed 00000004:00080000:1.0:1746147264.429320:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2621 committed 00000004:00080000:1.0:1746147264.429322:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2620 committed 00000004:00080000:1.0:1746147264.429323:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2619 committed 00000004:00080000:1.0:1746147264.429324:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2628 committed 00000004:00080000:1.0:1746147264.429326:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2627 committed 00000004:00080000:1.0:1746147264.429327:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2618 committed 00000004:00080000:1.0:1746147264.429328:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2617 committed 00000004:00080000:1.0:1746147264.429329:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2626 committed 00000001:00080000:1.0:1746147264.429343:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945679 is committed 00010000:00010000:2.0:1746147264.429365:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429383:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429395:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147264.429407:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00080000:0.0:1746147264.429418:0:14047:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147264.429450:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32321:x1830967466087936:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 51238us (51428us total) trans 8589945683 rc 0/0 00000100:00100000:0.0:1746147264.429462:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11632 00010000:00010000:2.0:1746147264.429535:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429542:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429549:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429554:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a477c000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.429558:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429564:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429575:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.429578:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147264.429582:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429587:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a477c000/0xb4b2209fbdad3106 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147264.429589:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467176704:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147264.429601:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429610:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429615:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429619:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0f400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.429621:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429626:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429632:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147264.429634:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.429636:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429640:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0f400/0xb4b2209fbdad30f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429647:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.429648:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.429653:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429655:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.429658:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429660:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.429661:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0ea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.429664:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429665:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e0ee00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.429667:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.429671:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429673:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.429676:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f37e100) 00010000:00010000:2.0:1746147264.429678:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.429680:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429681:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.429683:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147264.429684:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad30ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147264.429687:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.429696:0:3279:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.429703:0:3279:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.429727:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad30f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede42 expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.429732:0:3279:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 6 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.429739:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad30f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede42 expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.429742:0:3279:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830967467178496:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147264.429747:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0fa00, rc 0) 00000100:00100000:0.0:1746147264.429805:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.430326:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467176448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.430352:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147264.430357:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467177216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.430370:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467176960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.430377:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.430389:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147264.430389:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.430401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.430403:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467177472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.430411:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467178240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.430418:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.430424:0:3279:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.430432:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467176704 00000100:00100000:2.0:1746147264.430435:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32326:x1830967466089728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 28104us (28189us total) trans 8589945684 rc 301/301 00000100:00100000:1.0:1746147264.430436:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467177984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.430437:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467176832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.430439:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467176704 00000100:00100000:2.0:1746147264.430441:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11634 00000100:00100000:1.0:1746147264.430452:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147264.430462:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467176576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.430474:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467176448 00000100:00100000:3.0:1746147264.430475:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177216 00000100:00100000:0.0:1746147264.430475:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467176448 00000100:00100000:3.0:1746147264.430478:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177216 00000100:00100000:0.0:1746147264.430485:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467176960 00000100:00100000:2.0:1746147264.430487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147264.430487:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467176960 00000100:00100000:1.0:1746147264.430493:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177728 00000100:00100000:3.0:1746147264.430495:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177472 00000100:00100000:0.0:1746147264.430496:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177984 00000100:00100000:3.0:1746147264.430497:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177472 00000100:00100000:1.0:1746147264.430497:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177728 00000100:00100000:0.0:1746147264.430498:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177984 00000100:00100000:2.0:1746147264.430502:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467177088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.430504:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467176576 00000100:00100000:3.0:1746147264.430506:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467176576 00000100:00100000:0.0:1746147264.430507:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385 00000100:00100000:0.0:1746147264.430513:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3295:x1830967467176704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.430515:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00000100:00100000:2.0:1746147264.430516:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.430520:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3293:x1830967467176448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.430520:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387 00000100:00100000:2.0:1746147264.430522:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467177600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.430525:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3295:x1830967467177216:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746147264.430560:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147264.430561:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177088 00000100:00080000:0.0:1746147264.430563:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147264.430564:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177088 00000100:00100000:0.0:1746147264.430575:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16388 00000100:00100000:1.0:1746147264.430580:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389 00000100:00100000:0.0:1746147264.430581:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3293:x1830967467176960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.430584:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3293:x1830967467177472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.430687:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3293:x1830967467176448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (333us total) trans 17179874181 rc 0/0 00000100:00100000:1.0:1746147264.430692:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3293:x1830967467177472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (272us total) trans 17179874182 rc 0/0 00000100:00100000:3.0:1746147264.430693:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386 00000100:00100000:1.0:1746147264.430698:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389 00000100:00100000:3.0:1746147264.430704:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390 00000100:00100000:3.0:1746147264.430709:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967467177984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.430709:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391 00000100:00100000:1.0:1746147264.430714:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3295:x1830967467177728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.430714:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967467176960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (324us total) trans 21474841517 rc 0/0 00000100:00100000:0.0:1746147264.430720:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16388 00000100:00100000:0.0:1746147264.430731:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16392 00000100:00100000:0.0:1746147264.430735:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3294:x1830967467176576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.430787:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3293:x1830967467177984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (334us total) trans 21474841518 rc 0/0 00000100:00100000:3.0:1746147264.430792:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390 00000100:00100000:3.0:1746147264.430801:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16393 00000100:00100000:3.0:1746147264.430805:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967467177088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.430807:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3295:x1830967467177728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (404us total) trans 17179874183 rc 0/0 00000100:00100000:1.0:1746147264.430813:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391 00000100:00100000:3.0:1746147264.430846:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.430860:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467177344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.430876:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.430885:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467177856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.430898:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.430907:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467178368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.430916:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467176832 00000100:00100000:1.0:1746147264.430919:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467176832 00000100:00100000:3.0:1746147264.430920:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147264.430924:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967467176576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (436us total) trans 17179874184 rc 0/0 00000100:00100000:0.0:1746147264.430930:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16392 00000100:00100000:1.0:1746147264.430931:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177344 00000100:00100000:1.0:1746147264.430933:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177344 00000100:00100000:3.0:1746147264.430949:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177856 00000100:00100000:3.0:1746147264.430952:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177856 00000100:00100000:0.0:1746147264.430953:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467178368 00000100:00100000:0.0:1746147264.430955:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467178368 00000100:00100000:1.0:1746147264.430960:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16394 00000100:00100000:1.0:1746147264.430965:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3296:x1830967467176832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.430967:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16395 00000100:00100000:3.0:1746147264.430970:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16396 00000100:00100000:0.0:1746147264.430971:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967467177344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.430974:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967467177856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.431041:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3294:x1830967467177088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (525us total) trans 17179874185 rc 0/0 00000100:00100000:0.0:1746147264.431046:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16393 00000100:00100000:1.0:1746147264.431075:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3296:x1830967467176832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (227us total) trans 17179874186 rc 0/0 00000100:00100000:0.0:1746147264.431080:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16397 00000100:00100000:1.0:1746147264.431083:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16394 00000100:00100000:0.0:1746147264.431087:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830967467178368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147264.431088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.431093:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467177600 00000100:00100000:1.0:1746147264.431096:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467177600 00000100:00100000:2.0:1746147264.431100:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467178112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.431107:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16398 00000100:00100000:1.0:1746147264.431110:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3294:x1830967467177600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147264.431113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147264.431136:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3480/2, rc 0, transno 17179874184 00000100:00100000:2.0:1746147264.431146:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467176576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.431146:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467178112 00000100:00100000:1.0:1746147264.431148:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467178112 00000004:00080000:2.0:1746147264.431152:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c85ca80/2, rc 0, transno 17179874185 00000100:00100000:2.0:1746147264.431155:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467177088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.431160:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16399 00000100:00100000:1.0:1746147264.431164:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3294:x1830967467178112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.431175:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3296:x1830967467178368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (253us total) trans 21474841519 rc 0/0 00000100:00100000:0.0:1746147264.431181:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16397 00002000:00010000:1.0:1746147264.431246:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:1.0:1746147264.431249:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147264.431251:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147264.431254:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147264.431256:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:0.0:1746147264.431261:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967467177344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (384us total) trans 21474841521 rc 0/0 00000100:00100000:0.0:1746147264.431266:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16395 00000100:00100000:0.0:1746147264.431285:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.431292:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3294:x1830967467178112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (177us total) trans 21474841520 rc 0/0 00000100:00100000:1.0:1746147264.431298:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16399 00000100:00100000:1.0:1746147264.431307:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467178240 00000004:00080000:0.0:1746147264.431308:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5cbb80/2, rc 0, transno 17179874183 00000100:00100000:1.0:1746147264.431309:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467178240 00000004:00080000:2.0:1746147264.431310:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f6b480/2, rc 0, transno 21474841520 00000100:00100000:0.0:1746147264.431312:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147264.431314:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467178112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.431321:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16400 00000100:00100000:1.0:1746147264.431325:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3295:x1830967467178240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.431408:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967467178240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (120us total) trans 21474841522 rc 0/0 00000100:00100000:1.0:1746147264.431413:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16400 00000100:00100000:1.0:1746147264.431497:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3295:x1830967467177216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 972us (1119us total) trans 17179874187 rc 0/0 00000100:00100000:1.0:1746147264.431502:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387 00002000:00010000:1.0:1746147264.431603:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147264.431605:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147264 -> 1746147264 00002000:00010000:1.0:1746147264.431607:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147263 -> 1746147263 00002000:00010000:1.0:1746147264.431609:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147264 -> 1746147264 00002000:00010000:1.0:1746147264.431611:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746147264.431629:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3294:x1830967467177600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 517us (541us total) trans 21474841523 rc 0/0 00000100:00100000:1.0:1746147264.431634:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16398 00000100:00100000:1.0:1746147264.431650:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467178624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.431667:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147264.431686:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f1500/2, rc 0, transno 17179874181 00000100:00100000:1.0:1746147264.431689:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467176448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147264.431697:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f68700/2, rc 0, transno 21474841517 00000100:00100000:1.0:1746147264.431699:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467176960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147264.431705:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5ca300/2, rc 0, transno 17179874182 00000100:00100000:1.0:1746147264.431707:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467177472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147264.431713:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f6b100/2, rc 0, transno 21474841518 00000100:00100000:1.0:1746147264.431716:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467177984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.431730:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467178624 00000100:00100000:1.0:1746147264.431733:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467178624 00000100:00100000:1.0:1746147264.431745:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16401 00000100:00100000:1.0:1746147264.431749:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3293:x1830967467178624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.431829:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3293:x1830967467178624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (160us total) trans 17179874188 rc 0/0 00000100:00100000:1.0:1746147264.431834:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16401 00000004:00080000:1.0:1746147264.431853:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c8e00/2, rc 0, transno 17179874188 00000100:00100000:1.0:1746147264.431856:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467178624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147264.431961:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f68a80/2, rc 0, transno 21474841523 00000100:00100000:2.0:1746147264.431964:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467177600:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147264.431997:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00000004:00080000:1.0:1746147264.431999:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c85ed80/2, rc 0, transno 17179874187 00002000:00010000:0.0:1746147264.432000:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147264 -> 1746147264 00000100:00100000:1.0:1746147264.432002:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467177216:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147264.432002:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147263 -> 1746147263 00002000:00010000:0.0:1746147264.432004:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147264 -> 1746147264 00002000:00010000:0.0:1746147264.432006:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000004:00080000:1.0:1746147264.432009:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f69500/2, rc 0, transno 21474841522 00000100:00100000:1.0:1746147264.432012:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467178240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.432029:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3295:x1830967467176704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1516us (2225us total) trans 17179874189 rc 0/0 00000100:00100000:0.0:1746147264.432035:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385 00000004:00080000:1.0:1746147264.432040:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3100/2, rc 0, transno 17179874189 00000100:00100000:1.0:1746147264.432043:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467176704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.432444:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967467177856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1467us (1544us total) trans 21474841524 rc 0/0 00000100:00100000:3.0:1746147264.432452:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16396 00000004:00080000:3.0:1746147264.432480:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c85f800/2, rc 0, transno 17179874186 00000100:00100000:3.0:1746147264.432484:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467176832:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147264.432491:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f69880/2, rc 0, transno 21474841521 00000100:00100000:3.0:1746147264.432494:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467177344:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147264.432499:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099f6a680/2, rc 0, transno 21474841524 00000100:00100000:3.0:1746147264.432501:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467177856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147264.432508:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f84380/2, rc 0, transno 21474841519 00000100:00100000:3.0:1746147264.432510:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467178368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.433769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.433803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.433866:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089856 00000100:00100000:2.0:1746147264.433872:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089856 00000100:00100000:2.0:1746147264.433913:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11635 00000100:00100000:2.0:1746147264.433919:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32321:x1830967466089856:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147264.433958:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.433975:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede49 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.434027:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.434039:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.434053:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.434069:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147264.434072:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54a00, rc 0) 00000100:00100000:2.0:1746147264.434106:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32321:x1830967466089856:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 187us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.434111:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11635 00000100:00100000:3.0:1746147264.434405:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466089984 00000100:00100000:3.0:1746147264.434409:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466089984 00000100:00100000:3.0:1746147264.434434:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4906 00000100:00100000:3.0:1746147264.434439:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32322:x1830967466089984:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:2.0:1746147264.434737:0:3279:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830967467178496:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147264.434967:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32322:x1830967466089984:12345-192.168.203.36@tcp:49:cat.0 Request processed in 75us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.434974:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4906 00010000:00010000:2.0:1746147264.435138:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.435146:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ee00/0xb4b2209fbdad30dc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14047 initiator: MDT0 00000100:00100000:0.0:1746147264.438830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.438972:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090112 00000100:00100000:1.0:1746147264.438983:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090112 00000100:00100000:1.0:1746147264.439043:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11636 00000100:00100000:1.0:1746147264.439052:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32326:x1830967466090112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.439093:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.439112:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bba200/0xb4b2209fbdad311b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede50 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.439199:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bbbe00/0xb4b2209fbdad3122 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.439216:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bbbe00/0xb4b2209fbdad3122 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.439228:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bbbe00/0xb4b2209fbdad3122 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:1.0:1746147264.439254:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:1.0:1746147264.439259:0:14047:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147264.439273:0:14047:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bbbe00/0xb4b2209fbdad3122 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:1.0:1746147264.439296:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bba200/0xb4b2209fbdad311b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede50 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.439310:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bbbe00/0xb4b2209fbdad3122 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede50 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.439318:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.439321:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147264.439324:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbbe00, rc 0) 00000100:00100000:1.0:1746147264.439371:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32326:x1830967466090112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 320us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.439378:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11636 00000100:00100000:0.0:1746147264.445087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.445126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.445155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.445225:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090240 00000100:00100000:1.0:1746147264.445234:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090240 00000100:00100000:1.0:1746147264.445329:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 801 00000100:00100000:1.0:1746147264.445336:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32321:x1830967466090240:12345-192.168.203.36@tcp:103:mirror_io.0 00010000:00010000:1.0:1746147264.445351:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.445375:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7bee00/0xb4b2209fbdad308f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede18 expref: 8 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.445392:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.445396:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.445437:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32321:x1830967466090240:12345-192.168.203.36@tcp:103:mirror_io.0 Request processed in 102us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.445443:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 801 00000100:00100000:2.0:1746147264.445605:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090368 00000100:00100000:2.0:1746147264.445609:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090368 00000100:00100000:3.0:1746147264.445611:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090496 00000100:00100000:3.0:1746147264.445615:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090496 00000100:00100000:2.0:1746147264.445784:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16402 00000100:00100000:3.0:1746147264.445788:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16403 00000100:00100000:2.0:1746147264.445790:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967466090368:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147264.445793:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466090496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.445805:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.445805:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.445821:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede5e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.445821:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede57 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147264.445844:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417bf, atime: 0x681417bf, ctime: 0x681417bf, blocks: 0x821 00002000:00010000:2.0:1746147264.445844:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x81f 00010000:00010000:3.0:1746147264.445858:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.445858:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.445860:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.445860:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.445868:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.445868:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 49 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.445880:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.445880:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 49 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.445888:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094423e00, rc 0) 00010000:00010000:2.0:1746147264.445888:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477c000, rc 0) 00000100:00100000:3.0:1746147264.446051:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466090496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 112us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.446065:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16403 00000100:00100000:2.0:1746147264.446074:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967466090368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 284us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.446078:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16402 00000100:00100000:0.0:1746147264.446113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.446148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.446152:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090624 00000100:00100000:1.0:1746147264.446155:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090624 00000100:00100000:0.0:1746147264.446160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.446168:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090752 00000100:00100000:1.0:1746147264.446170:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090752 00000100:00100000:1.0:1746147264.446179:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466090880 00000100:00100000:1.0:1746147264.446180:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466090880 00000100:00100000:1.0:1746147264.446192:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16404 00000100:00100000:1.0:1746147264.446197:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466090624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.446203:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.446212:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede65 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147264.446223:0:17530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x81d 00010000:00010000:1.0:1746147264.446231:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.446233:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.446237:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.446246:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.446253:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbac00, rc 0) 00000100:00100000:1.0:1746147264.446272:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967466090624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.446277:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16404 00000100:00100000:1.0:1746147264.446287:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16405 00000100:00100000:1.0:1746147264.446292:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967466090752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.446297:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.446304:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede6c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.446311:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16406 00002000:00010000:1.0:1746147264.446315:0:17530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417bf, atime: 0x681417bf, ctime: 0x681417bf, blocks: 0x821 00000100:00100000:2.0:1746147264.446316:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967466090880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.446321:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.446322:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.446323:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.446327:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede73 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.446327:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 51 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.446335:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.446335:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 52 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.446336:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.446340:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 52 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.446342:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbaa00, rc 0) 00010000:00010000:2.0:1746147264.446347:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 52 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.446354:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54000, rc 0) 00000100:00100000:1.0:1746147264.446355:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1956:x1830967466090752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.446360:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16405 00000100:00100000:2.0:1746147264.446364:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967466090880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.446369:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16406 00000100:00100000:0.0:1746147264.446407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.446454:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466091008 00000100:00100000:0.0:1746147264.446457:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466091008 00000100:00100000:0.0:1746147264.446474:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16407 00000100:00100000:0.0:1746147264.446647:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967466091008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147264.446654:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.446661:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede7a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.446673:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.446675:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.446679:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.446841:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.446848:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d63aa00, rc 0) 00000100:00100000:0.0:1746147264.446866:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967466091008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 221us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.446871:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16407 00000100:00100000:0.0:1746147264.454506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.455241:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466091392 00000100:00100000:2.0:1746147264.455252:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466091392 00000100:00100000:0.0:1746147264.455296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147264.455298:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134f87100 x1830967466091392/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.455309:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87100 with x1830967466091392 ext(3145728->4194303) 00002000:00010000:2.0:1746147264.455315:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87100 00000100:00100000:2.0:1746147264.455350:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7841 00000100:00100000:2.0:1746147264.455358:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466091392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.455361:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466091776 00000100:00100000:0.0:1746147264.455361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.455366:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466091776 00000100:00100000:3.0:1746147264.455391:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4907 00000100:00100000:3.0:1746147264.455397:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32321:x1830967466091776:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147264.455584:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32321:x1830967466091776:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 187us (289us total) trans 8589945685 rc 0/0 00000100:00100000:3.0:1746147264.455590:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4907 00000100:00100000:3.0:1746147264.455610:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466091520 00000100:00100000:3.0:1746147264.455612:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466091520 00002000:00100000:3.0:1746147264.455626:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f84000 x1830967466091520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.455730:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84000 with x1830967466091520 ext(3145728->4194303) 00002000:00010000:3.0:1746147264.455733:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84000 00000100:00100000:3.0:1746147264.455744:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7842 00000100:00100000:3.0:1746147264.455748:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967466091520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.463672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.464159:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466092032 00000100:00100000:3.0:1746147264.464170:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466092032 00000100:00100000:3.0:1746147264.464224:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4908 00000100:00100000:3.0:1746147264.464231:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32321:x1830967466092032:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147264.465532:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32321:x1830967466092032:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 1299us (1869us total) trans 8589945686 rc 0/0 00000100:00100000:3.0:1746147264.465541:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4908 00000100:00100000:2.0:1746147264.470921:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466091392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15547us (16413us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.470977:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7841 00002000:00100000:2.0:1746147264.470995:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134f87100 x1830967466091392/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.471005:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f87100 with x1830967466091392 ext(3145728->4194303) 00002000:00010000:2.0:1746147264.471011:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f87100 00000100:00100000:3.0:1746147264.472186:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+28:1956:x1830967466091520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16427us (16815us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.472195:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7842 00002000:00100000:3.0:1746147264.472202:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134f84000 x1830967466091520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.472215:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84000 with x1830967466091520 ext(3145728->4194303) 00002000:00010000:3.0:1746147264.472219:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84000 00000100:00100000:0.0:1746147264.475724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.475757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.475795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.476678:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466092544 00000100:00100000:0.0:1746147264.476682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.476688:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466092544 00002000:00100000:2.0:1746147264.476736:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012c85df80 x1830967466092544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147264.476742:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466092800 00000100:00100000:1.0:1746147264.476746:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466092800 00002000:00100000:2.0:1746147264.476747:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85df80 with x1830967466092544 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.476752:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85df80 00000100:00100000:3.0:1746147264.476763:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466092288 00002000:00100000:1.0:1746147264.476764:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012c85f100 x1830967466092800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147264.476767:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466092288 00002000:00100000:1.0:1746147264.476771:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f100 with x1830967466092800 ext(1048576->2097151) 00000100:00100000:2.0:1746147264.476774:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466093056 00002000:00010000:1.0:1746147264.476775:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f100 00000100:00100000:2.0:1746147264.476776:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466093056 00002000:00100000:2.0:1746147264.476785:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012c85f480 x1830967466093056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.476786:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134f84a80 x1830967466092288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147264.476787:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7843 00002000:00100000:3.0:1746147264.476792:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84a80 with x1830967466092288 ext(0->1048575) 00002000:00100000:2.0:1746147264.476792:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f480 with x1830967466093056 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.476794:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85f480 00000100:00100000:1.0:1746147264.476794:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967466092544:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:3.0:1746147264.476795:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84a80 00000100:00100000:2.0:1746147264.476814:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7844 00000100:00100000:3.0:1746147264.476818:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7845 00000100:00100000:2.0:1746147264.476819:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967466092800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.476822:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967466093056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.476916:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7846 00000100:00100000:3.0:1746147264.476921:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967466092288:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.480595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.480630:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.480656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.480669:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466093312 00000100:00100000:1.0:1746147264.480679:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466093312 00000100:00100000:3.0:1746147264.480709:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466093568 00000100:00100000:3.0:1746147264.480713:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466093568 00000100:00100000:1.0:1746147264.480726:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466093184 00000100:00100000:1.0:1746147264.480732:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466093184 00000100:00100000:3.0:1746147264.480737:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16408 00000100:00100000:3.0:1746147264.480744:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1956:x1830967466093312:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147264.480751:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16409 00000100:00100000:1.0:1746147264.480756:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967466093568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.480763:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.480765:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147264.480766:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16410 00000100:00100000:2.0:1746147264.480774:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1956:x1830967466093184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.480779:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede88 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.480779:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.480779:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede96 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.480784:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede81 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.480800:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.480800:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.480800:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.480802:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.480802:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.480802:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.480810:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.480810:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 31 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.480810:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 31 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.480824:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 31 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.480824:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 31 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.480825:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.480833:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487a00, rc 0) 00010000:00010000:2.0:1746147264.480833:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7ac00, rc 0) 00010000:00010000:1.0:1746147264.480833:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbae00, rc 0) 00000100:00100000:3.0:1746147264.481054:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466093312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 310us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.481073:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16408 00000100:00100000:0.0:1746147264.481153:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.481155:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967466093184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 378us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.481155:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1956:x1830967466093568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 396us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.481160:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16409 00000100:00100000:1.0:1746147264.481171:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466093440 00000100:00100000:1.0:1746147264.481173:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466093440 00000100:00100000:2.0:1746147264.481216:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16410 00000100:00100000:1.0:1746147264.481225:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16411 00000100:00100000:1.0:1746147264.481230:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466093440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.481237:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.481244:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede8f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.481254:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.481255:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.481259:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.481268:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.481287:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbb200, rc 0) 00000100:00100000:1.0:1746147264.481306:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466093440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.481311:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16411 00000100:00100000:2.0:1746147264.487019:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967466093056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10181us (10323us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.487033:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7845 00002000:00100000:2.0:1746147264.487045:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012c85f480 x1830967466093056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.487064:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f480 with x1830967466093056 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.487070:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85f480 00000100:00100000:0.0:1746147264.487756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.487798:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466093824 00000100:00100000:2.0:1746147264.487806:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466093824 00002000:00100000:2.0:1746147264.487838:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c9f2680 x1830967466093824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.487845:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967466093824 ext(4194304->4976639) 00002000:00010000:2.0:1746147264.487849:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:2.0:1746147264.487873:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7847 00000100:00100000:2.0:1746147264.487880:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967466093824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.491852:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967466092288:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14918us (16126us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.491865:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7846 00002000:00100000:3.0:1746147264.491876:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff880134f84a80 x1830967466092288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.491885:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f84a80 with x1830967466092288 ext(0->1048575) 00002000:00010000:3.0:1746147264.491891:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134f84a80 00000100:00100000:1.0:1746147264.494280:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967466092544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17478us (18513us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.494292:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7843 00002000:00100000:1.0:1746147264.494301:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012c85df80 x1830967466092544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.494311:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85df80 with x1830967466092544 ext(1048576->2097151) 00002000:00010000:1.0:1746147264.494317:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85df80 00000100:00100000:2.0:1746147264.497119:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967466092800:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20288us (21311us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.497132:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7844 00002000:00100000:2.0:1746147264.497142:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88012c85f100 x1830967466092800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.497151:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85f100 with x1830967466092800 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.497156:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85f100 00000100:00100000:2.0:1746147264.500450:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967466093824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12560us (12687us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147264.500461:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7847 00002000:00100000:2.0:1746147264.500472:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c9f2680 x1830967466093824/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.500481:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967466093824 ext(4194304->4976639) 00002000:00010000:2.0:1746147264.500488:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:0.0:1746147264.507833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.507981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.508018:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466094336 00000100:00100000:2.0:1746147264.508027:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466094336 00000100:00100000:2.0:1746147264.508100:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11637 00000100:00100000:2.0:1746147264.508109:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32329:x1830967466094336:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147264.508129:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.508147:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad316f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ede9d expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.508255:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508266:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508276:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508288:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508293:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508297:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508397:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8c00/0xb4b2209fbdad3184 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508404:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8c00/0xb4b2209fbdad3184 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508410:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8c00/0xb4b2209fbdad3184 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147264.508418:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147264.508496:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508502:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508508:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508513:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb8800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.508517:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508523:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508534:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147264.508536:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.508540:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508545:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508560:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508565:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508569:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508573:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb8a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.508575:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508582:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508587:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6100) 00010000:00010000:2.0:1746147264.508589:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.508591:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508595:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad317d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147264.508627:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad316f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede9d expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.508636:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8c00/0xb4b2209fbdad3184 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede9d expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.508641:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.508643:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147264.508645:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8c00, rc 0) 00000100:00100000:2.0:1746147264.508690:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32329:x1830967466094336:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 583us (709us total) trans 8589945687 rc 0/0 00000100:00100000:2.0:1746147264.508696:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11637 00000100:00100000:3.0:1746147264.510150:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466094080 00000100:00100000:3.0:1746147264.510160:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466094080 00000100:00100000:3.0:1746147264.510206:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4909 00000100:00100000:3.0:1746147264.510213:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32322:x1830967466094080:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147264.510385:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32322:x1830967466094080:12345-192.168.203.36@tcp:35:cat.0 Request processed in 172us (2562us total) trans 8589945688 rc 0/0 00000100:00100000:3.0:1746147264.510391:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4909 00000100:00100000:0.0:1746147264.513204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.513430:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466094592 00000100:00100000:2.0:1746147264.513440:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466094592 00002000:00100000:2.0:1746147264.513486:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880099f6a300 x1830967466094592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.513497:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967466094592 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.513503:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:2.0:1746147264.513570:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7848 00000100:00100000:2.0:1746147264.513578:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967466094592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.513621:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.513648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.514807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.514832:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466094848 00000100:00100000:0.0:1746147264.514837:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466094848 00000100:00100000:3.0:1746147264.514844:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466095104 00000100:00100000:3.0:1746147264.514848:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466095104 00002000:00100000:0.0:1746147264.514866:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9ff480 x1830967466094848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.514867:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008f9fc700 x1830967466095104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.514875:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff480 with x1830967466094848 ext(3145728->4194303) 00002000:00100000:3.0:1746147264.514879:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc700 with x1830967466095104 ext(2097152->3145727) 00002000:00010000:0.0:1746147264.514879:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff480 00002000:00010000:3.0:1746147264.514882:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fc700 00000100:00100000:0.0:1746147264.514893:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466095488 00000100:00100000:0.0:1746147264.514895:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466095488 00002000:00100000:0.0:1746147264.514905:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fc380 x1830967466095488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.514912:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc380 with x1830967466095488 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.514914:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fc380 00000100:00100000:3.0:1746147264.515027:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7849 00000100:00100000:3.0:1746147264.515035:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967466094848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.515109:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7850 00000100:00100000:2.0:1746147264.515116:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967466095104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.515116:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7851 00000100:00100000:1.0:1746147264.515124:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967466095488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.515146:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.515168:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466095360 00000100:00100000:0.0:1746147264.515170:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466095360 00000100:00100000:0.0:1746147264.515206:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 802 00000100:00100000:0.0:1746147264.515212:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1958:x1830967466095360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.515222:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.515247:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8c00/0xb4b2209fbdad3184 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede9d expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.515306:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147264.515310:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.515335:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1958:x1830967466095360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.515341:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 802 00000100:00100000:2.0:1746147264.516417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.516496:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466095744 00000100:00100000:2.0:1746147264.516501:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466095744 00000100:00100000:2.0:1746147264.516527:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11638 00000100:00100000:2.0:1746147264.516532:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32329:x1830967466095744:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147264.516549:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.516552:0:14047:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147264.516567:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bbbe00/0xb4b2209fbdad3122 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede50 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.516582:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.516585:0:14047:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147264.516596:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3192 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edea4 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.516642:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.516653:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.516659:0:14047:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.516666:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.516692:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.516703:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 8 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.516715:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467178752:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.516798:0:14047:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.516805:0:14047:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 7 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.516813:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467178880:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.516831:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.522348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.522375:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466095872 00000100:00100000:0.0:1746147264.522383:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466095872 00010000:00010000:0.0:1746147264.522416:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 9 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.522441:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8417 00000100:00100000:0.0:1746147264.522447:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466095872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.522459:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.522465:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 9 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.522476:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 9 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.522495:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147264.522499:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.522505:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.522510:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.522556:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466095872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.522562:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8417 00000100:00100000:0.0:1746147264.522619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.522633:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096000 00000100:00100000:0.0:1746147264.522635:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096000 00010000:00010000:0.0:1746147264.522645:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 8 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.522662:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8418 00000100:00100000:0.0:1746147264.522666:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967466096000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.522672:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147264.522675:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 8 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.522682:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 8 pid: 14048 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.522692:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147264.522695:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.522701:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.522706:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14047 initiator: MDT0 00010000:00010000:0.0:1746147264.522720:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.522731:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967466096000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.522735:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8418 00010000:00010000:2.0:1746147264.524037:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdad3114 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede49 expref: 8 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.524054:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467178752:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.524074:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c985c00/0xb4b2209fbdad30ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede3b expref: 7 pid: 14048 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.524084:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467178880:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.524104:0:14047:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.524111:0:14047:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.524116:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000040:00080000:2.0:1746147264.524725:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3513, 88 off294640 00000004:00080000:2.0:1746147264.524731:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651511793482ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.524783:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3499, 88 off293408 00000004:00080000:2.0:1746147264.524786:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651511848720ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.524803:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3500, 88 off293496 00000004:00080000:2.0:1746147264.524806:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651511868327ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.524812:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3514, 88 off294728 00000004:00080000:2.0:1746147264.524814:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651511876812ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.524819:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3515, 88 off294816 00000004:00080000:2.0:1746147264.524822:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651511885129ns, next at 592568729900ns, rc = 0 00000100:00100000:1.0:1746147264.525630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000040:00080000:2.0:1746147264.525709:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3501, 88 off293584 00000004:00080000:2.0:1746147264.525715:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651512777762ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.525736:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3502, 88 off293672 00000004:00080000:2.0:1746147264.525739:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651512801681ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.525747:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3503, 88 off293760 00000004:00080000:2.0:1746147264.525749:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651512812040ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.525798:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3517, 88 off295000 00000004:00080000:2.0:1746147264.525802:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651512864471ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.525815:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3504, 88 off293848 00000004:00080000:2.0:1746147264.525818:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651512881250ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.525828:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3518, 88 off295088 00000004:00080000:2.0:1746147264.525830:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651512893193ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.525839:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3505, 88 off293936 00000004:00080000:2.0:1746147264.525841:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651512904083ns, next at 607576201812ns, rc = 0 00000040:00080000:2.0:1746147264.525850:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3519, 88 off295176 00000004:00080000:2.0:1746147264.525853:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651512915733ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.525861:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3520, 88 off295264 00000004:00080000:2.0:1746147264.525864:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651512926580ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.525873:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3521, 88 off295352 00000004:00080000:2.0:1746147264.525876:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651512938586ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.525884:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3522, 88 off295440 00000004:00080000:2.0:1746147264.525887:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651512949692ns, next at 592568729900ns, rc = 0 00000040:00080000:2.0:1746147264.525895:0:14047:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3506, 88 off294024 00000004:00080000:2.0:1746147264.525897:0:14047:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651512960143ns, next at 607576201812ns, rc = 0 00000100:00100000:0.0:1746147264.527727:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096256 00000100:00100000:0.0:1746147264.527738:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096256 00000100:00100000:0.0:1746147264.527797:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11639 00000100:00100000:0.0:1746147264.527804:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32332:x1830967466096256:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147264.527832:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.527849:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b400/0xb4b2209fbdad31a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edeab expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.527958:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.527969:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.527978:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.527988:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.527993:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.527998:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.528114:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.528121:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147264.528128:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147264.528136:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:3.0:1746147264.530236:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967466094592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16647us (17028us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.530249:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7848 00002000:00100000:3.0:1746147264.530261:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff880099f6a300 x1830967466094592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.530270:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967466094592 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.530276:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:1.0:1746147264.535406:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967466095104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20282us (21748us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.535419:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7850 00002000:00100000:1.0:1746147264.535431:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88008f9fc700 x1830967466095104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.535441:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc700 with x1830967466095104 ext(2097152->3145727) 00002000:00010000:1.0:1746147264.535447:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fc700 00000100:00100000:0.0:1746147264.536713:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466095488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21583us (21904us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147264.536726:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7851 00002000:00100000:0.0:1746147264.536733:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88008f9fc380 x1830967466095488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.536740:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fc380 with x1830967466095488 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.536745:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fc380 00000100:00100000:2.0:1746147264.536765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.536789:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096384 00000100:00100000:2.0:1746147264.536796:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096384 00000100:00100000:2.0:1746147264.536829:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11640 00000100:00100000:2.0:1746147264.536835:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32326:x1830967466096384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.536851:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.536868:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edeb2 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.536922:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.536930:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.536968:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147264.536979:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.536991:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.536994:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147264.536997:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.537004:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802800, rc 0) 00000100:00100000:2.0:1746147264.537022:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32326:x1830967466096384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 187us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.537027:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11640 00010000:00010000:1.0:1746147264.537424:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537433:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537439:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537444:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7aa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147264.537447:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537453:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537466:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.537468:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746147264.537471:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537479:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7aa00/0xb4b2209fbdad31b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537494:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537499:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537503:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537506:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7b200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147264.537508:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537512:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537518:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147264.537520:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147264.537522:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537526:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b200/0xb4b2209fbdad31a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537535:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537540:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537544:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537549:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7b000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147264.537550:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537555:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537560:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13500) 00010000:00010000:1.0:1746147264.537562:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147264.537564:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537569:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b000/0xb4b2209fbdad31ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147264.537609:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b400/0xb4b2209fbdad31a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeab expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.537617:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7b400/0xb4b2209fbdad31a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeab expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.537624:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7b400, rc 0) 00000100:00100000:1.0:1746147264.537955:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32332:x1830967466096256:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10132us (12309us total) trans 8589945690 rc 301/301 00000100:00100000:1.0:1746147264.537962:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11639 00000100:00100000:3.0:1746147264.539767:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967466094848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24728us (26141us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.539777:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7849 00002000:00100000:3.0:1746147264.539787:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9ff480 x1830967466094848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.539795:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff480 with x1830967466094848 ext(3145728->4194303) 00002000:00010000:3.0:1746147264.539801:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff480 00000001:00080000:1.0:1746147264.561298:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945689 is committed 00000004:00080000:1.0:1746147264.561307:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2632 committed 00000004:00080000:1.0:1746147264.561315:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2643 committed 00000004:00080000:1.0:1746147264.561320:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2642 committed 00000004:00080000:1.0:1746147264.561323:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2641 committed 00000004:00080000:1.0:1746147264.561325:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2640 committed 00000004:00080000:1.0:1746147264.561326:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2631 committed 00000004:00080000:1.0:1746147264.561328:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2639 committed 00000004:00080000:1.0:1746147264.561330:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2630 committed 00000004:00080000:1.0:1746147264.561332:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2638 committed 00000004:00080000:1.0:1746147264.561333:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2629 committed 00000004:00080000:1.0:1746147264.561334:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2628 committed 00000004:00080000:1.0:1746147264.561336:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2627 committed 00000004:00080000:1.0:1746147264.561338:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2637 committed 00000004:00080000:1.0:1746147264.561339:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2636 committed 00000004:00080000:1.0:1746147264.561341:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2626 committed 00000004:00080000:1.0:1746147264.561343:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2625 committed 00000004:00080000:1.0:1746147264.561344:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2635 committed 00000001:00080000:1.0:1746147264.561357:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945688 is committed 00000001:00080000:1.0:1746147264.561361:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945686 is committed 00000100:00100000:3.0:1746147264.561435:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467179008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.561498:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561502:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467179520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.561522:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561537:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467179264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.561538:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467179136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.561552:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.561554:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467179392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.561564:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467179776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.561570:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.561582:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467179904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.561584:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179008 00000100:00100000:1.0:1746147264.561589:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179008 00000100:00100000:3.0:1746147264.561596:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561623:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179520 00000100:00100000:1.0:1746147264.561625:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179520 00000100:00100000:1.0:1746147264.561634:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179264 00010000:00010000:2.0:1746147264.561636:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edea4 expref: 303 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.561636:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179264 00000100:00100000:1.0:1746147264.561646:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179392 00000100:00100000:1.0:1746147264.561648:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179392 00010000:00010000:2.0:1746147264.561650:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.561653:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746147264.561657:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179904 00010000:00010000:2.0:1746147264.561658:0:14047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.561659:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179904 00010000:00010000:2.0:1746147264.561667:0:14047:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.561671:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16412 00010000:00010000:2.0:1746147264.561673:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.561677:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3294:x1830967467179008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.561688:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16413 00000100:00100000:0.0:1746147264.561694:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3293:x1830967467179520:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147264.561698:0:14047:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.561707:0:14047:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467181056:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147264.561730:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414 00000100:00100000:0.0:1746147264.561734:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967467179264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147264.561758:0:14047:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.561773:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16415 00000100:00100000:2.0:1746147264.561779:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3296:x1830967467179392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.561823:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16416 00000100:00100000:1.0:1746147264.561827:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3296:x1830967467179904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147264.561838:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746147264.561839:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180032:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147264.561841:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147264.561843:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147264.561845:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:0.0:1746147264.561847:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746147264.561857:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561871:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.561871:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3295:x1830967467179264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (317us total) trans 21474841525 rc 0/0 00000100:00100000:0.0:1746147264.561877:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414 00000100:00100000:1.0:1746147264.561882:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561891:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746147264.561891:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180032 00000100:00100000:0.0:1746147264.561893:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180032 00000100:00100000:1.0:1746147264.561894:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467179648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.561902:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180544 00000100:00100000:0.0:1746147264.561903:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180544 00000100:00100000:1.0:1746147264.561907:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147264.561909:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179648 00000100:00100000:0.0:1746147264.561910:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179648 00000100:00100000:1.0:1746147264.561913:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.561916:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16417 00000100:00100000:0.0:1746147264.561920:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3293:x1830967467180032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.561924:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561930:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.561933:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180160 00000100:00100000:0.0:1746147264.561955:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180160 00000100:00100000:1.0:1746147264.561960:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147264.561962:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418 00000100:00100000:2.0:1746147264.561968:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3293:x1830967467180544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.561972:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180672 00000100:00100000:0.0:1746147264.561974:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180672 00000100:00100000:1.0:1746147264.561975:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16419 00000100:00100000:1.0:1746147264.561980:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3293:x1830967467179648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147264.561982:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16420 00000100:00100000:0.0:1746147264.561986:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3293:x1830967467180160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.561989:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.561998:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.562012:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.562018:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.562028:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147264.562050:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fd500/2, rc 0, transno 21474841525 00000100:00100000:1.0:1746147264.562065:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467179264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.562071:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147264.562074:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.562088:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.562095:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147264.562105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.562263:0:21080:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562270:0:21080:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost00_010' 00000100:00100000:3.0:1746147264.562278:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562282:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179776 00000100:00100000:3.0:1746147264.562285:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179776 00000100:00100000:3.0:1746147264.562294:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562298:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180288 00000100:00100000:3.0:1746147264.562299:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180288 00000100:00100000:3.0:1746147264.562304:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562306:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180800 00000100:00100000:3.0:1746147264.562308:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180800 00000100:00100000:3.0:1746147264.562313:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562315:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180416 00000100:00100000:3.0:1746147264.562317:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180416 00000100:00100000:3.0:1746147264.562322:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562324:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467180928 00000100:00100000:3.0:1746147264.562326:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467180928 00000100:00100000:3.0:1746147264.562337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.562353:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.562356:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467179136 00000100:00100000:3.0:1746147264.562358:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467179136 00000100:00100000:2.0:1746147264.562789:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3293:x1830967467180544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 820us (903us total) trans 21474841526 rc 0/0 00000100:00100000:2.0:1746147264.562796:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418 00000100:00100000:2.0:1746147264.562808:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16421 00000100:00100000:2.0:1746147264.562812:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3293:x1830967467180672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147264.562883:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb size from disk: 4186112 -> 4186112 00002000:00010000:2.0:1746147264.562886:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147264.562888:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147264.562890:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb ctime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147264.562892:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x424:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:2.0:1746147264.562907:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3293:x1830967467180672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (946us total) trans 21474841527 rc 0/0 00000100:00100000:2.0:1746147264.562912:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16421 00000100:00100000:2.0:1746147264.562922:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16422 00000100:00100000:2.0:1746147264.562926:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3295:x1830967467179776:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147264.562932:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134ed6680/2, rc 0, transno 21474841527 00000100:00100000:0.0:1746147264.562954:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147264.562965:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134ed7b80/2, rc 0, transno 21474841526 00000100:00100000:0.0:1746147264.562968:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180544:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147264.562977:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147264.562980:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147264.562981:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147264.562983:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147261 -> 1746147261 00002000:00010000:2.0:1746147264.562985:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147264.563012:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3294:x1830967467179008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1336us (1515us total) trans 17179874190 rc 0/0 00000100:00100000:2.0:1746147264.563017:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16412 00000100:00100000:2.0:1746147264.563026:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16423 00000100:00100000:2.0:1746147264.563029:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3295:x1830967467180288:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147264.563068:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5caa00/2, rc 0, transno 17179874190 00000100:00100000:3.0:1746147264.563084:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467179008:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147264.563113:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147264.563116:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147264 -> 1746147264 00002000:00010000:2.0:1746147264.563118:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563120:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147264 -> 1746147264 00002000:00010000:2.0:1746147264.563122:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746147264.563135:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147264.563140:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467181184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147264.563141:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3295:x1830967467180288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1128us total) trans 21474841528 rc 0/0 00000100:00100000:2.0:1746147264.563146:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16423 00000100:00100000:2.0:1746147264.563155:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16424 00000100:00100000:2.0:1746147264.563159:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3295:x1830967467180800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.563160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.563175:0:6881:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1746147264.563179:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467181184 00000100:00100000:1.0:1746147264.563179:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3296:x1830967467179904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1351us (1582us total) trans 17179874193 rc 0/0 00000100:00100000:3.0:1746147264.563183:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467181184 00000100:00100000:1.0:1746147264.563185:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16416 00000100:00100000:3.0:1746147264.563193:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16425 00000100:00100000:3.0:1746147264.563198:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3295:x1830967467180416:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147264.563208:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fca80/2, rc 0, transno 21474841528 00000004:00080000:3.0:1746147264.563210:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5cad80/2, rc 0, transno 17179874193 00000100:00100000:1.0:1746147264.563211:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147264.563212:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467179904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147264.563229:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3295:x1830967467180800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1199us total) trans 21474841529 rc 0/0 00000100:00100000:2.0:1746147264.563234:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16424 00000100:00100000:2.0:1746147264.563242:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16426 00000004:00080000:1.0:1746147264.563243:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134ed5880/2, rc 0, transno 21474841529 00000100:00100000:1.0:1746147264.563246:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147264.563259:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3295:x1830967467180928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147264.563330:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3295:x1830967467180928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1223us total) trans 21474841530 rc 0/0 00000100:00100000:2.0:1746147264.563335:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16426 00000100:00100000:2.0:1746147264.563343:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16427 00000100:00100000:2.0:1746147264.563347:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3294:x1830967467179136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147264.563404:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147264.563407:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563409:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563411:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563413:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147264.563430:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3294:x1830967467179136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1092us total) trans 21474841531 rc 0/0 00000100:00100000:2.0:1746147264.563434:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16427 00000100:00100000:2.0:1746147264.563441:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16428 00000100:00100000:2.0:1746147264.563445:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3294:x1830967467181184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147264.563488:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3295:x1830967467180416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (1397us total) trans 21474841532 rc 0/0 00000100:00100000:3.0:1746147264.563495:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16425 00000100:00100000:2.0:1746147264.563507:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:3294:x1830967467181184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (346us total) trans 17179874194 rc 0/0 00000100:00100000:2.0:1746147264.563512:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16428 00000004:00080000:3.0:1746147264.563522:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b0c1f80/2, rc 0, transno 17179874194 00000100:00100000:3.0:1746147264.563526:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467181184:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147264.563533:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f9fe680/2, rc 0, transno 21474841531 00000100:00100000:3.0:1746147264.563535:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467179136:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147264.563540:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147264.563542:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563544:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563545:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147263 -> 1746147263 00002000:00010000:2.0:1746147264.563547:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147264.563563:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3296:x1830967467179392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1784us (1992us total) trans 17179874191 rc 0/0 00000100:00100000:2.0:1746147264.563570:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16415 00000004:00080000:1.0:1746147264.563585:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134ed4700/2, rc 0, transno 21474841532 00000100:00100000:1.0:1746147264.563588:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147264.563594:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134ed5f80/2, rc 0, transno 21474841530 00000100:00100000:1.0:1746147264.563596:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467180928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147264.563676:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3293:x1830967467180032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1754us (1817us total) trans 17179874195 rc 0/0 00000100:00100000:1.0:1746147264.563681:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+70:3293:x1830967467179648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1702us (1773us total) trans 17179874196 rc 0/0 00000100:00100000:0.0:1746147264.563682:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16417 00000100:00100000:1.0:1746147264.563685:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16419 00000004:00080000:0.0:1746147264.563699:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5cb480/2, rc 0, transno 17179874196 00000100:00100000:0.0:1746147264.563702:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467179648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147264.563708:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb70e00/2, rc 0, transno 17179874195 00000100:00100000:0.0:1746147264.563710:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147264.563776:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3293:x1830967467180160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1789us (1850us total) trans 17179874197 rc 0/0 00000100:00100000:1.0:1746147264.563781:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16420 00000004:00080000:3.0:1746147264.563795:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c8a80/2, rc 0, transno 17179874191 00000100:00100000:3.0:1746147264.563798:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467179392:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147264.563829:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:1.0:1746147264.563831:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147264 -> 1746147264 00002000:00010000:1.0:1746147264.563834:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147263 -> 1746147263 00002000:00010000:1.0:1746147264.563836:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147264 -> 1746147264 00002000:00010000:1.0:1746147264.563838:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:1.0:1746147264.563854:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3293:x1830967467179520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2162us (2333us total) trans 17179874192 rc 0/0 00000100:00100000:1.0:1746147264.563859:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16413 00000004:00080000:0.0:1746147264.563893:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb71f80/2, rc 0, transno 17179874197 00000100:00100000:0.0:1746147264.563896:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467180160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147264.563899:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3295:x1830967467179776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 972us (1908us total) trans 17179874198 rc 0/0 00000004:00080000:0.0:1746147264.563903:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5cb100/2, rc 0, transno 17179874192 00000100:00100000:2.0:1746147264.563904:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16422 00000100:00100000:0.0:1746147264.563905:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467179520:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147264.563906:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c8380/2, rc 0, transno 17179874198 00000100:00100000:1.0:1746147264.563908:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467179776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147264.565298:0:14047:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14047:1830967467181056:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147264.565322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147264.565335:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3192 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edea4 expref: 303 pid: 14047 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147264.565356:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edea4 expref: 302 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.565383:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb9000, rc 0) 00000100:00100000:2.0:1746147264.565425:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32329:x1830967466095744:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 48892us (49011us total) trans 8589945689 rc 0/0 00000100:00100000:2.0:1746147264.565432:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11638 00000100:00100000:1.0:1746147264.565811:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096512 00000100:00100000:1.0:1746147264.565817:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096512 00000100:00100000:1.0:1746147264.566189:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4910 00000100:00100000:1.0:1746147264.566197:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32326:x1830967466096512:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147264.566276:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32326:x1830967466096512:12345-192.168.203.36@tcp:49:cat.0 Request processed in 80us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.566282:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4910 00000100:00100000:0.0:1746147264.566979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.567024:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096640 00000100:00100000:3.0:1746147264.567029:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096640 00000100:00100000:3.0:1746147264.567070:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4911 00000100:00100000:3.0:1746147264.567076:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32329:x1830967466096640:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:3.0:1746147264.567137:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32329:x1830967466096640:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.567144:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4911 00000100:00100000:0.0:1746147264.575765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.575865:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096768 00000100:00100000:2.0:1746147264.575875:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096768 00000100:00100000:2.0:1746147264.575924:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11641 00000100:00100000:2.0:1746147264.575931:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32332:x1830967466096768:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147264.575983:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.576002:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093803a00/0xb4b2209fbdad31ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edeb9 expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.576070:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093803a00/0xb4b2209fbdad31ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb9 expref: 8 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.576087:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093803a00/0xb4b2209fbdad31ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb9 expref: 8 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.576103:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.576106:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147264.576109:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803a00, rc 0) 00000100:00100000:2.0:1746147264.576156:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32332:x1830967466096768:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 225us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.576162:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11641 00000100:00100000:0.0:1746147264.577582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.577617:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466096896 00000100:00100000:2.0:1746147264.577623:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466096896 00000100:00100000:2.0:1746147264.577665:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16429 00000100:00100000:2.0:1746147264.577671:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32329:x1830967466096896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147264.577682:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.577695:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edec0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.577718:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.577727:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.577733:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.577735:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.577738:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2146304->2187263] (req 2146304->2187263) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.577766:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.577777:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.577789:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467181312:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.577870:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.577878:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 23 pid: 17548 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.577887:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467181440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.577903:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.581892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.581969:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466097024 00000100:00100000:1.0:1746147264.581977:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466097024 00000100:00100000:0.0:1746147264.581991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.582013:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466097152 00000100:00100000:0.0:1746147264.582016:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466097152 00000100:00100000:1.0:1746147264.582017:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16430 00000100:00100000:1.0:1746147264.582024:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32332:x1830967466097024:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147264.582040:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.582040:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 24 pid: 17548 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.582070:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edec7 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147264.582077:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8419 00000100:00100000:0.0:1746147264.582083:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466097152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147264.582095:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.582096:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.582111:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 50 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.582117:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.582119:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147264.582119:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 24 pid: 17548 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.582122:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3125247] (req 2600960->3125247) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.582130:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 24 pid: 17548 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746147264.582148:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147264.582151:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 50 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.582162:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 50 pid: 8480 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.582174:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467181568:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147264.582188:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466097152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.582194:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8419 00010000:00010000:1.0:1746147264.582248:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.582255:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 31 pid: 17548 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.582263:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467181696:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147264.582280:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.582366:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467181312:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.582377:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad30d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede2d expref: 23 pid: 17548 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.582393:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467181440:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.582412:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2146304->2187263] (req 2146304->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.582427:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803800, rc 0) 00000100:00100000:2.0:1746147264.582448:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32329:x1830967466096896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4778us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.582455:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16429 00000100:00100000:1.0:1746147264.585504:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467181696:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147264.586921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.587068:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466097280 00000100:00100000:1.0:1746147264.587076:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466097280 00010000:00010000:1.0:1746147264.587109:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 32 pid: 17548 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.587136:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8420 00000100:00100000:1.0:1746147264.587144:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466097280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.587156:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.587178:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 32 pid: 17548 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.587189:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 32 pid: 17548 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.587211:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a551e800/0xb4b2209fbdad30e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede34 expref: 32 pid: 17548 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.587241:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.588166:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967466097280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 138us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.588176:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8420 00000100:00100000:1.0:1746147264.588221:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467181568:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.588248:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2600960->3125247] (req 2600960->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.588259:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85c3c00, rc 0) 00000100:00100000:1.0:1746147264.588293:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32332:x1830967466097024:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6270us (6411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.588300:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16430 00000100:00100000:0.0:1746147264.590519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.590556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.591431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.591590:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466097536 00000100:00100000:3.0:1746147264.591599:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466097536 00002000:00100000:3.0:1746147264.591646:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134ed5c00 x1830967466097536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.591662:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5c00 with x1830967466097536 ext(2097152->3145727) 00010000:00010000:3.0:1746147264.591672:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.591685:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00002000:00010000:3.0:1746147264.591692:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134ed5c00 00000100:00100000:3.0:1746147264.591710:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466097792 00000100:00100000:3.0:1746147264.591712:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466097792 00002000:00100000:3.0:1746147264.591722:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134ed7480 x1830967466097792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.591729:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7480 with x1830967466097792 ext(3145728->4194303) 00010000:00010000:3.0:1746147264.591732:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 29 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.591740:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 29 pid: 11147 timeout: 751 lvb_type: 1 00002000:00010000:3.0:1746147264.591746:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134ed7480 00000100:00100000:3.0:1746147264.591753:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466098048 00000100:00100000:3.0:1746147264.591755:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466098048 00002000:00100000:3.0:1746147264.591766:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134ed6a00 x1830967466098048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.591772:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6a00 with x1830967466098048 ext(3145728->4194303) 00010000:00010000:3.0:1746147264.591778:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 51 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.591785:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 51 pid: 8480 timeout: 751 lvb_type: 1 00002000:00010000:3.0:1746147264.591791:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed6a00 00000100:00100000:3.0:1746147264.591916:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2676 00000100:00100000:3.0:1746147264.591923:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466097536:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.592004:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2677 00000100:00100000:2.0:1746147264.592012:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2678 00000100:00100000:1.0:1746147264.592012:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466097792:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147264.592231:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466098048:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.604627:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967466097792:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12607us (14061us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.604639:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2677 00002000:00100000:1.0:1746147264.604650:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff880134ed7480 x1830967466097792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.604659:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed7480 with x1830967466097792 ext(3145728->4194303) 00010000:00010000:1.0:1746147264.604669:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 30 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.604684:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 30 pid: 11147 timeout: 751 lvb_type: 1 00002000:00010000:1.0:1746147264.604690:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134ed7480 00000100:00100000:2.0:1746147264.606449:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466098048:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14422us (15011us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.606458:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2678 00002000:00100000:2.0:1746147264.606466:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff880134ed6a00 x1830967466098048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.606474:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed6a00 with x1830967466098048 ext(3145728->4194303) 00010000:00010000:2.0:1746147264.606481:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 51 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.606491:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 51 pid: 8480 timeout: 751 lvb_type: 1 00002000:00010000:2.0:1746147264.606497:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ed6a00 00000100:00100000:3.0:1746147264.610107:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967466097536:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18176us (19587us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.610117:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2676 00002000:00100000:3.0:1746147264.610126:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff880134ed5c00 x1830967466097536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.610135:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ed5c00 with x1830967466097536 ext(2097152->3145727) 00010000:00010000:3.0:1746147264.610144:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746147264.610155:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00002000:00010000:3.0:1746147264.610162:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134ed5c00 00000100:00100000:0.0:1746147264.616143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.616186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.616247:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466098304 00000100:00100000:2.0:1746147264.616255:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466098304 00000100:00100000:0.0:1746147264.616272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.616304:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16431 00000100:00100000:2.0:1746147264.616310:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:32326:x1830967466098304:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.616328:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.616342:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edece expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.616360:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.616362:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.616367:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 52 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.616378:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 52 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.616387:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803600, rc 0) 00000100:00100000:2.0:1746147264.616421:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+52:32326:x1830967466098304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.616426:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16431 00000100:00100000:1.0:1746147264.616542:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466098176 00000100:00100000:1.0:1746147264.616546:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466098176 00010000:00010000:1.0:1746147264.616563:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 52 pid: 8480 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.616588:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466098432 00000100:00100000:1.0:1746147264.616590:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466098432 00010000:00010000:1.0:1746147264.616602:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746147264.616613:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8421 00000100:00100000:1.0:1746147264.616617:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8422 00000100:00100000:2.0:1746147264.616620:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967466098176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147264.616622:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967466098432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.616627:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.616628:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.616641:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.616642:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 52 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.616649:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.616651:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 52 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.616663:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdad3145 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede73 expref: 52 pid: 8480 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.616663:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d63aa00/0xb4b2209fbdad314c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede7a expref: 28 pid: 11147 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.616685:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.616686:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.616688:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.616690:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.616691:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.616693:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.616697:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.616700:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.616720:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 29 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.616720:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.616730:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467181824:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147264.616730:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467181952:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.616782:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147264.617084:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.620610:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967467181824:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147264.620627:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.620671:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967466098176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4050us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.620680:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8421 00000100:00100000:0.0:1746147264.621236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.621283:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466098688 00000100:00100000:2.0:1746147264.621289:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466098688 00002000:00100000:2.0:1746147264.621317:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (2600960->2605055) req@ffff88008f9ff100 x1830967466098688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.621326:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff100 with x1830967466098688 ext(2600960->2605055) 00002000:00010000:2.0:1746147264.621330:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff100 00000100:00100000:2.0:1746147264.621344:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7852 00000100:00100000:2.0:1746147264.621351:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466098688:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147264.622321:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466098688:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 968us (1083us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.622328:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7852 00000100:00100000:0.0:1746147264.622432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.622466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.622480:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466098944 00000100:00100000:0.0:1746147264.622485:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466098944 00002000:00100000:0.0:1746147264.622513:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9fd880 x1830967466098944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.622521:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fd880 with x1830967466098944 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.622526:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fd880 00000100:00100000:0.0:1746147264.622539:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466099200 00000100:00100000:0.0:1746147264.622541:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466099200 00002000:00100000:0.0:1746147264.622553:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2146304->2150399) req@ffff88008f9fce00 x1830967466099200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.622559:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (2600960->2605055) req@ffff88008f9ff100 x1830967466098688/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.622559:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fce00 with x1830967466099200 ext(2146304->2150399) 00002000:00010000:0.0:1746147264.622562:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fce00 00002000:00100000:2.0:1746147264.622567:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9ff100 with x1830967466098688 ext(2600960->2605055) 00002000:00010000:2.0:1746147264.622570:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9ff100 00000100:00100000:2.0:1746147264.622583:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7853 00000100:00100000:2.0:1746147264.622589:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466098944:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147264.622625:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7854 00000100:00100000:0.0:1746147264.622633:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967466099200:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147264.622858:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967466099200:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 225us (389us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147264.622864:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7854 00002000:00100000:0.0:1746147264.622870:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2146304->2150399) req@ffff88008f9fce00 x1830967466099200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.622877:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fce00 with x1830967466099200 ext(2146304->2150399) 00002000:00010000:0.0:1746147264.622880:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9fce00 00000100:00100000:1.0:1746147264.623016:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467181952:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147264.623028:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.623069:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466098432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6445us (6795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.623076:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8422 00000100:00100000:0.0:1746147264.625903:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.626048:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466099456 00000100:00100000:1.0:1746147264.626064:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466099456 00002000:00100000:1.0:1746147264.626096:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2183168->2187263) req@ffff88009b208000 x1830967466099456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.626105:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967466099456 ext(2183168->2187263) 00002000:00010000:1.0:1746147264.626109:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b208000 00000100:00100000:1.0:1746147264.626137:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7855 00000100:00100000:1.0:1746147264.626144:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466099456:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.626272:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466099456:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 128us (374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147264.626277:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7855 00002000:00100000:1.0:1746147264.626282:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (2183168->2187263) req@ffff88009b208000 x1830967466099456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.626288:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967466099456 ext(2183168->2187263) 00002000:00010000:1.0:1746147264.626291:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b208000 00000100:00100000:0.0:1746147264.627041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.627709:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466099712 00000100:00100000:2.0:1746147264.627714:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466099712 00002000:00100000:2.0:1746147264.627735:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3121152->3125247) req@ffff88009b208a80 x1830967466099712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.627743:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967466099712 ext(3121152->3125247) 00002000:00010000:2.0:1746147264.627747:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:2.0:1746147264.627771:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7856 00000100:00100000:2.0:1746147264.627778:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967466099712:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147264.627871:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1956:x1830967466099712:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 93us (830us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.627877:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7856 00002000:00100000:2.0:1746147264.627882:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3121152->3125247) req@ffff88009b208a80 x1830967466099712/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.627894:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967466099712 ext(3121152->3125247) 00002000:00010000:2.0:1746147264.627897:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:3.0:1746147264.627907:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466098944:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 5307us (5469us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.627917:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7853 00002000:00100000:3.0:1746147264.627928:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88008f9fd880 x1830967466098944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.627958:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9fd880 with x1830967466098944 ext(3145728->4194303) 00000100:00100000:0.0:1746147264.627959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:3.0:1746147264.627963:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9fd880 00000100:00100000:2.0:1746147264.628888:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466099968 00000100:00100000:2.0:1746147264.628893:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466099968 00000100:00100000:2.0:1746147264.628926:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4912 00000100:00100000:2.0:1746147264.628931:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32329:x1830967466099968:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147264.629106:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32329:x1830967466099968:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 174us (1147us total) trans 8589945691 rc 0/0 00000100:00100000:2.0:1746147264.629112:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4912 00000100:00100000:0.0:1746147264.629603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.629667:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466100224 00000100:00100000:1.0:1746147264.629671:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466100224 00000100:00100000:1.0:1746147264.629700:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4913 00000100:00100000:1.0:1746147264.629706:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+8:32332:x1830967466100224:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147264.629798:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32332:x1830967466100224:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 92us (195us total) trans 8589945692 rc 0/0 00000100:00100000:1.0:1746147264.629804:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4913 00000100:00100000:0.0:1746147264.631526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.631592:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466100480 00000100:00100000:1.0:1746147264.631597:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466100480 00002000:00100000:1.0:1746147264.631622:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b20b100 x1830967466100480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.631630:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967466100480 ext(3145728->4194303) 00002000:00010000:1.0:1746147264.631634:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20b100 00000100:00100000:1.0:1746147264.631754:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7857 00000100:00100000:1.0:1746147264.631760:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466100480:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147264.645865:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967466100480:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14097us (14334us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.645876:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7857 00002000:00100000:1.0:1746147264.645886:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009b20b100 x1830967466100480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.645895:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967466100480 ext(3145728->4194303) 00002000:00010000:1.0:1746147264.645900:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20b100 00000100:00100000:0.0:1746147264.649430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.649518:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466100608 00000100:00100000:2.0:1746147264.649526:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466100608 00000100:00100000:2.0:1746147264.649573:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16432 00000100:00100000:2.0:1746147264.649581:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466100608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.649595:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.649609:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093803400/0xb4b2209fbdad31e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949eded5 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.649630:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093803400/0xb4b2209fbdad31e6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eded5 expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.649637:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093803400/0xb4b2209fbdad31e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949eded5 expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.649652:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803400, rc 0) 00000100:00100000:2.0:1746147264.649685:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466100608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 104us (266us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.649689:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16432 00000100:00100000:0.0:1746147264.653547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.653621:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466100864 00000100:00100000:1.0:1746147264.653631:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466100864 00002000:00100000:1.0:1746147264.653669:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b20a680 x1830967466100864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.653677:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967466100864 ext(4194304->4976639) 00002000:00010000:1.0:1746147264.653683:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:3.0:1746147264.655417:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7858 00000100:00100000:3.0:1746147264.655437:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967466100864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.662390:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147264.662410:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467182080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147264.662457:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147264.662499:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467182080 00000100:00100000:1.0:1746147264.662507:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467182080 00000100:00100000:1.0:1746147264.662540:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1746147264.662547:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3293:x1830967467182080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746147264.662564:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 653721600 pending 25559040 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746147264.662614:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3293:x1830967467182080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.662620:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1746147264.662669:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967466100864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7235us (9130us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147264.662678:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7858 00002000:00100000:2.0:1746147264.662684:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b20a680 x1830967466100864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147264.662684:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467182080:0@lo:13:osp-pre-0-0.0 00002000:00100000:2.0:1746147264.662693:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967466100864 ext(4194304->4976639) 00002000:00010000:2.0:1746147264.662697:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:0.0:1746147264.666053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.666138:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466100992 00000100:00100000:2.0:1746147264.666148:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466100992 00000100:00100000:2.0:1746147264.666190:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16433 00000100:00100000:2.0:1746147264.666196:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466100992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.666208:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.666357:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad31ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ededc expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.666382:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad31ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ededc expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.666391:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad31ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ededc expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.666403:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802c00, rc 0) 00000100:00100000:2.0:1746147264.666445:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466100992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 249us (402us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.666454:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16433 00000100:00100000:0.0:1746147264.670493:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.670597:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466101120 00000100:00100000:2.0:1746147264.670607:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466101120 00000100:00100000:2.0:1746147264.670649:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16434 00000100:00100000:2.0:1746147264.670657:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466101120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.670677:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.670695:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093802e00/0xb4b2209fbdad31f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edee3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.670728:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093802e00/0xb4b2209fbdad31f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edee3 expref: 52 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.670740:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093802e00/0xb4b2209fbdad31f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edee3 expref: 52 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.670914:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802e00, rc 0) 00000100:00100000:2.0:1746147264.671507:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466101120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 849us (1023us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.671514:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16434 00000100:00100000:0.0:1746147264.675587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.675712:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466101376 00000100:00100000:1.0:1746147264.675722:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466101376 00000100:00100000:1.0:1746147264.675887:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4914 00000100:00100000:1.0:1746147264.675895:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32326:x1830967466101376:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147264.676502:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32326:x1830967466101376:12345-192.168.203.36@tcp:35:cat.0 Request processed in 605us (924us total) trans 8589945693 rc 0/0 00000100:00100000:1.0:1746147264.676509:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4914 00000100:00100000:2.0:1746147264.677165:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830967467182592:0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.677207:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147264.677255:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147264.677260:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830967467182464:0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.677276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147264.677297:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467182592 00000100:00100000:2.0:1746147264.677302:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467182592 00000100:00100000:2.0:1746147264.677324:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467182464 00000100:00100000:2.0:1746147264.677326:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467182464 00000100:00100000:2.0:1746147264.677345:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1746147264.677350:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830967467182592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.677378:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830967467182592:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.677383:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1746147264.677392:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1746147264.677395:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830967467182464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.677411:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830967467182464:12345-0@lo:400:kworker.0 Request processed in 15us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.677415:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1746147264.677439:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967467182336:0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.677445:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830967467182464:0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.677452:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830967467182592:0@lo:400:kworker.0 00000100:00080000:2.0:1746147264.677474:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147264.677498:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147264.677531:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147264.677536:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967467182208:0@lo:400:kworker.0 00000100:00100000:3.0:1746147264.677557:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147264.677707:0:14045:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467182208 00000100:00100000:2.0:1746147264.677711:0:14045:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467182208 00000100:00100000:3.0:1746147264.678092:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467182336 00000100:00100000:3.0:1746147264.678096:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467182336 00000100:00100000:3.0:1746147264.678119:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1746147264.678124:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967467182336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147264.678154:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967467182336:12345-0@lo:400:kworker.0 Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.678159:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1746147264.678182:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967467182336:0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.678245:0:14045:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1746147264.678251:0:14045:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3296:x1830967467182208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147264.678344:0:14045:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3296:x1830967467182208:12345-0@lo:400:kworker.0 Request processed in 94us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.678350:0:14045:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1746147264.678365:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147264.678405:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967467182208:0@lo:400:kworker.0 00000100:00100000:1.0:1746147264.693206:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467182720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147264.693287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147264.694536:0:11221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467182720 00000100:00100000:2.0:1746147264.694546:0:11221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467182720 00000100:00100000:2.0:1746147264.694599:0:11221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1746147264.694607:0:11221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3295:x1830967467182720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746147264.694633:0:11221:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 701300736 pending 44302336 free 3843031040 avail 3840933888 00000100:00100000:2.0:1746147264.694693:0:11221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3295:x1830967467182720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.694699:0:11221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746147264.694805:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467182720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147264.732572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.732692:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466101632 00000100:00100000:3.0:1746147264.732703:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466101632 00000100:00100000:3.0:1746147264.732756:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11642 00000100:00100000:3.0:1746147264.732764:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32338:x1830967466101632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.732792:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.732810:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad31fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edeea expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.732924:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.732977:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.732987:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.732998:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733002:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733006:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733117:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733122:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733125:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147264.733132:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.733201:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733208:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733212:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733216:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb9800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.733218:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733222:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733229:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.733231:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.733233:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733236:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9800/0xb4b2209fbdad3202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733252:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733255:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733257:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733260:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb9200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.733261:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733267:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733271:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f37e400) 00010000:00010000:3.0:1746147264.733272:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.733274:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733279:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3209 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.733314:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad31fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.733324:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.733329:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.733331:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147264.733333:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb9c00, rc 0) 00000100:00100000:3.0:1746147264.733380:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32338:x1830967466101632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 617us (819us total) trans 8589945694 rc 0/0 00000100:00100000:3.0:1746147264.733387:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11642 00000100:00100000:0.0:1746147264.736962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.737028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.737262:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466101888 00000100:00100000:1.0:1746147264.737262:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466101760 00000100:00100000:3.0:1746147264.737271:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466101888 00000100:00100000:1.0:1746147264.737271:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466101760 00000100:00100000:3.0:1746147264.737317:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16435 00000100:00100000:1.0:1746147264.737322:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16436 00000100:00100000:3.0:1746147264.737324:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466101888:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147264.737327:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466101760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.737341:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.737341:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.737356:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3225 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edef8 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.737357:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bba000/0xb4b2209fbdad321e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edef1 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.737386:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bba000/0xb4b2209fbdad321e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edef1 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147264.737397:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bba000/0xb4b2209fbdad321e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edef1 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147264.737407:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467182848:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147264.737905:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147264.738195:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bba000, rc 0) 00000100:00100000:1.0:1746147264.738225:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466101760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 896us (1295us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.738231:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16436 00002000:00010000:3.0:1746147264.740005:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147263 -> 1746147264 00000100:00100000:2.0:1746147264.740047:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467182848:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147264.740094:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3225 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edef8 expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.740108:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3225 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edef8 expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.740701:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8e00, rc 0) 00000100:00100000:2.0:1746147264.740762:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466101888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3438us (3732us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.740771:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16435 00000100:00100000:0.0:1746147264.755273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.755370:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466102144 00000100:00100000:3.0:1746147264.755380:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466102144 00000100:00100000:3.0:1746147264.755420:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11643 00000100:00100000:3.0:1746147264.755426:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32342:x1830967466102144:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.755447:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.755465:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9600/0xb4b2209fbdad322c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edeff expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.755571:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755583:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755593:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755606:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755610:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755615:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755715:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755721:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755726:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147264.755733:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.755808:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755814:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755819:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755824:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb8200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.755827:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755832:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755841:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.755843:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.755846:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755850:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755874:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755878:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755883:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755886:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb9200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.755887:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755891:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755895:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f37e400) 00010000:00010000:3.0:1746147264.755897:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.755898:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755902:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad323a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.755933:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9600/0xb4b2209fbdad322c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.757113:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.757121:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.757124:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147264.757127:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8e00, rc 0) 00000100:00100000:3.0:1746147264.757875:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:32342:x1830967466102144:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2445us (2606us total) trans 8589945695 rc 0/0 00000100:00100000:3.0:1746147264.757885:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11643 00000100:00100000:0.0:1746147264.766260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.766308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.766346:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466102528 00000100:00100000:0.0:1746147264.766355:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466102528 00000100:00100000:0.0:1746147264.766397:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11644 00000100:00100000:0.0:1746147264.766405:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+11:32341:x1830967466102528:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147264.766431:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.766449:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad324f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf0d expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.766552:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147264.766565:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.766572:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.766578:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147264.766610:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.766622:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 305 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.766634:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467182976:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147264.766730:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.766738:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 12 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746147264.766746:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467183104:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147264.766765:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.766971:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466102272 00000100:00100000:3.0:1746147264.766975:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466102272 00000100:00100000:3.0:1746147264.767002:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16437 00000100:00100000:3.0:1746147264.767008:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:32342:x1830967466102272:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.767016:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.767026:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf06 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.767046:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.767066:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.767073:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.767075:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.767077:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1564672->1626111] (req 1564672->1626111) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.767095:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.767105:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 22 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.767115:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183232:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.767164:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.767172:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.767179:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183360:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.767195:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.771028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.771109:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.771112:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466102784 00000100:00100000:2.0:1746147264.771122:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466102784 00002000:00100000:2.0:1746147264.771170:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800a5a0d880 x1830967466102784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.771180:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967466102784 ext(0->1048575) 00002000:00010000:2.0:1746147264.771185:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d880 00000100:00100000:2.0:1746147264.771218:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466103168 00000100:00100000:2.0:1746147264.771220:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466103168 00002000:00100000:2.0:1746147264.771234:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a5a0c000 x1830967466103168/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.771246:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967466103168 ext(1048576->2097151) 00010000:00010000:2.0:1746147264.771255:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.771267:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 751 lvb_type: 1 00002000:00010000:2.0:1746147264.771273:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0c000 00000100:00100000:2.0:1746147264.771288:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2679 00000100:00100000:2.0:1746147264.771295:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466103168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.771327:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7859 00000100:00100000:1.0:1746147264.771335:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466102784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.771914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.771933:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466103296 00000100:00100000:0.0:1746147264.771953:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466103296 00002000:00100000:0.0:1746147264.771972:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5a0ed80 x1830967466103296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.771980:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967466103296 ext(1048576->2097151) 00002000:00010000:0.0:1746147264.771984:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:0.0:1746147264.771998:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7860 00000100:00100000:0.0:1746147264.772003:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466103296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.773554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.773667:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183232:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.773705:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467182976:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.773712:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467183104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.773745:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147264.777512:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466103680 00000100:00100000:1.0:1746147264.777526:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466103680 00010000:00010000:1.0:1746147264.777568:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 306 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.777606:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8423 00000100:00100000:1.0:1746147264.777612:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1959:x1830967466103680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.777625:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.777631:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 306 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.777642:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 306 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.777664:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad3241 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeff expref: 306 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.777695:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.777700:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147264.777707:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147264.777712:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.777764:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1959:x1830967466103680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 151us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.777770:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8423 00000100:00100000:2.0:1746147264.778596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.778634:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466103808 00000100:00100000:1.0:1746147264.778638:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466103808 00010000:00010000:1.0:1746147264.778654:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 13 pid: 14049 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.778671:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8424 00000100:00100000:1.0:1746147264.778677:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1959:x1830967466103808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.778686:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.778690:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 13 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.778698:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 13 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.778709:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3210 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeea expref: 13 pid: 14049 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.778724:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147264.778727:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147264.778734:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147264.778739:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147264.778795:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.778812:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967466103808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 135us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.778816:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8424 00010000:00010000:3.0:1746147264.778857:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.778864:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147264.778883:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.779022:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0ea00/0xb4b2209fbdad324f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.779047:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.779052:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.779063:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147264.779066:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e0fa00, rc 0) 00000100:00100000:3.0:1746147264.779084:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32341:x1830967466102528:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 12681us (12777us total) trans 8589945696 rc 0/0 00000100:00100000:3.0:1746147264.779090:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11644 00000100:00100000:2.0:1746147264.779143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.779191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.779233:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183360:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.779261:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1564672->1626111] (req 1564672->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.779274:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb9a00, rc 0) 00000100:00100000:2.0:1746147264.779291:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32342:x1830967466102272:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 12283us (13042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.779297:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16437 00000100:00100000:1.0:1746147264.780028:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466103936 00000100:00100000:1.0:1746147264.780033:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466103936 00010000:00010000:1.0:1746147264.780051:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.780083:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8425 00000100:00100000:1.0:1746147264.780090:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967466103936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.780099:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.780117:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.780127:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.780147:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094423e00/0xb4b2209fbdad3129 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede5e expref: 28 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.780157:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.780191:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466103936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.780197:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8425 00000100:00100000:3.0:1746147264.780243:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466103552 00000100:00100000:3.0:1746147264.780247:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466103552 00002000:00100000:3.0:1746147264.781314:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df79500 x1830967466103552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.781324:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967466103552 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.781330:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79500 00000100:00100000:3.0:1746147264.781360:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7861 00000100:00100000:3.0:1746147264.781370:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466103552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.783530:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1956:x1830967466103168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12227us (12413us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.783544:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2679 00002000:00100000:2.0:1746147264.783553:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff8800a5a0c000 x1830967466103168/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.783563:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967466103168 ext(1048576->2097151) 00010000:00010000:2.0:1746147264.783571:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:2.0:1746147264.783586:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 25 pid: 21080 timeout: 751 lvb_type: 1 00002000:00010000:2.0:1746147264.783594:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0c000 00000100:00100000:2.0:1746147264.796683:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466103296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24673us (24763us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.796692:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7860 00002000:00100000:2.0:1746147264.796702:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5a0ed80 x1830967466103296/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.796710:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967466103296 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.796715:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:3.0:1746147264.802043:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466102784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30702us (31017us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.802067:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7859 00002000:00100000:3.0:1746147264.802076:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff8800a5a0d880 x1830967466102784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.802085:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967466102784 ext(0->1048575) 00002000:00010000:3.0:1746147264.802090:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d880 00000100:00100000:3.0:1746147264.802997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.803099:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466104064 00000100:00100000:1.0:1746147264.803106:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466104064 00010000:00010000:1.0:1746147264.803131:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.803154:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8426 00000100:00100000:1.0:1746147264.803160:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967466104064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.803169:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.803189:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.803200:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.803216:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487a00/0xb4b2209fbdad315a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede88 expref: 23 pid: 21080 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.803243:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.803245:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.803251:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.803258:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.803290:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.803299:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467183488:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147264.803347:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147264.803685:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466103552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22317us (24539us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.803693:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7861 00002000:00100000:2.0:1746147264.803699:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012df79500 x1830967466103552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.803712:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df79500 with x1830967466103552 ext(1048576->2097151) 00002000:00010000:2.0:1746147264.803716:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df79500 00000100:00100000:0.0:1746147264.807770:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.807825:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467183488:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147264.807844:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.808081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.808271:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466104448 00000100:00100000:3.0:1746147264.808280:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466104448 00002000:00100000:3.0:1746147264.808326:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1564672->1568767) req@ffff8800a5a0d500 x1830967466104448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.808337:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d500 with x1830967466104448 ext(1564672->1568767) 00002000:00010000:3.0:1746147264.808342:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0d500 00000100:00100000:3.0:1746147264.808364:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7862 00000100:00100000:3.0:1746147264.808371:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967466104448:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147264.808543:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967466104448:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 171us (461us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147264.808549:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7862 00002000:00100000:3.0:1746147264.808561:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1564672->1568767) req@ffff8800a5a0d500 x1830967466104448/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.808568:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d500 with x1830967466104448 ext(1564672->1568767) 00002000:00010000:3.0:1746147264.808571:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0d500 00000100:00100000:1.0:1746147264.808610:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1958:x1830967466104064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5448us (5613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.808620:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8426 00000100:00100000:2.0:1746147264.808814:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466104192 00000100:00100000:2.0:1746147264.808820:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466104192 00000100:00100000:2.0:1746147264.808863:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16438 00000100:00100000:2.0:1746147264.808869:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32338:x1830967466104192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.808883:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.808898:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf14 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.808919:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.808926:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.808928:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.808931:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.808983:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.808994:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 26 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.809004:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183616:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.809074:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.810219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.810564:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.810583:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.810593:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bea00, rc 0) 00000100:00100000:2.0:1746147264.810660:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32338:x1830967466104192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1790us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.810666:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16438 00000100:00100000:3.0:1746147264.810761:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466104704 00000100:00100000:3.0:1746147264.810770:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466104704 00002000:00100000:3.0:1746147264.810804:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1622016->1626111) req@ffff8800a5a0e300 x1830967466104704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.810813:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e300 with x1830967466104704 ext(1622016->1626111) 00010000:00010000:3.0:1746147264.810820:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.810834:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.810841:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0e300 00000100:00100000:3.0:1746147264.810876:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2680 00000100:00100000:3.0:1746147264.810882:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466104704:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147264.811070:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466104704:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 187us (852us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147264.811076:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2680 00002000:00100000:3.0:1746147264.811080:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1622016->1626111) req@ffff8800a5a0e300 x1830967466104704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.811087:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e300 with x1830967466104704 ext(1622016->1626111) 00010000:00010000:3.0:1746147264.811092:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.811101:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.811106:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0e300 00000100:00100000:0.0:1746147264.811651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.811832:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466104960 00000100:00100000:3.0:1746147264.811836:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466104960 00000100:00100000:3.0:1746147264.811871:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11645 00000100:00100000:3.0:1746147264.811876:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:32345:x1830967466104960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.811891:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.811907:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9600/0xb4b2209fbdad3272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf1b expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.812021:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812032:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812041:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812052:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812073:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812078:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812176:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3287 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812183:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3287 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812189:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3287 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147264.812197:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:3.0:1746147264.812274:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812280:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812288:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812293:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb8200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.812296:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812302:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812315:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147264.812318:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.812321:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812326:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8200/0xb4b2209fbdad3279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812347:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812351:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812355:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812359:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134fb9c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147264.812361:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812365:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812374:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f37e700) 00010000:00010000:3.0:1746147264.812376:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147264.812378:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812382:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9c00/0xb4b2209fbdad3280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147264.812416:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9600/0xb4b2209fbdad3272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf1b expref: 308 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.812425:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3287 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf1b expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.812431:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.812433:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147264.812435:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8800, rc 0) 00000100:00100000:3.0:1746147264.812469:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:32345:x1830967466104960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 592us (819us total) trans 8589945697 rc 0/0 00000100:00100000:3.0:1746147264.812474:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11645 00000100:00100000:0.0:1746147264.813499:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.813543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.813549:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466105344 00000100:00100000:1.0:1746147264.813557:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466105344 00000100:00100000:1.0:1746147264.813604:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4915 00000100:00100000:1.0:1746147264.813610:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:32342:x1830967466105344:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147264.813686:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466105472 00000100:00100000:2.0:1746147264.813690:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466105472 00002000:00100000:2.0:1746147264.813712:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1564672->1626111) req@ffff88009b6a0700 x1830967466105472/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.813721:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0700 with x1830967466105472 ext(1564672->1626111) 00010000:00010000:2.0:1746147264.813732:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.813744:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.813749:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6a0700 00000100:00100000:2.0:1746147264.813761:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2681 00000100:00100000:2.0:1746147264.813766:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967466105472:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147264.813782:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32342:x1830967466105344:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 172us (288us total) trans 8589945698 rc 0/0 00000100:00100000:1.0:1746147264.813788:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4915 00000100:00100000:2.0:1746147264.815545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.815659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.815746:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466105728 00000100:00100000:0.0:1746147264.815752:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466105728 00000100:00100000:2.0:1746147264.816158:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466105472:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2390us (2612us total) trans 21474841533 rc 0/0 00000100:00100000:2.0:1746147264.816170:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2681 00002000:00100000:2.0:1746147264.816181:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1564672->1626111) req@ffff88009b6a0700 x1830967466105472/t21474841533(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.816190:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0700 with x1830967466105472 ext(1564672->1626111) 00010000:00010000:2.0:1746147264.816198:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.816210:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:2.0:1746147264.816216:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6a0700 00000100:00100000:0.0:1746147264.816441:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466105600 00000100:00100000:0.0:1746147264.816445:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466105600 00000100:00100000:0.0:1746147264.816519:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16439 00000100:00100000:3.0:1746147264.816527:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16440 00000100:00100000:0.0:1746147264.816529:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466105728:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147264.816533:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466105600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.816541:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.816541:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.816554:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad329c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf22 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.816554:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad3295 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf29 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147264.816577:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad3295 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf29 expref: 52 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.816584:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad3295 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf29 expref: 52 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147264.816591:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183744:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147264.816595:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802c00, rc 0) 00000100:00100000:3.0:1746147264.816651:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.816747:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466105728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 217us (1207us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147264.816753:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16439 00002000:00010000:3.0:1746147264.818840:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147263 -> 1746147264 00002000:00010000:3.0:1746147264.818845:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147263 -> 1746147264 00002000:00010000:3.0:1746147264.818846:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime: 1746147263 -> 1746147264 00000100:00100000:3.0:1746147264.818863:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467183744:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147264.818884:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad329c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf22 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.818896:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad329c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf22 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147264.819443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.819466:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466105856 00000100:00100000:1.0:1746147264.819471:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466105856 00010000:00010000:1.0:1746147264.819496:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.819518:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8427 00000100:00100000:1.0:1746147264.819524:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967466105856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.819534:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.819543:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.819558:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.819574:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9a00/0xb4b2209fbdad325d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1626111) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf06 expref: 30 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.819593:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.819595:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.819600:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.819607:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.819634:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 22 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.819644:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467183872:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147264.819743:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147264.819833:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8e00, rc 0) 00000100:00100000:3.0:1746147264.819857:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466105600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3324us (4203us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147264.819863:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16440 00000100:00100000:1.0:1746147264.822291:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467183872:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147264.822307:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.822347:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967466105856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2822us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.822355:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8427 00000100:00100000:0.0:1746147264.823736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.823777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.823801:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466106240 00000100:00100000:2.0:1746147264.823806:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466106240 00002000:00100000:2.0:1746147264.823837:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b6a2d80 x1830967466106240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.823846:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a2d80 with x1830967466106240 ext(0->1048575) 00002000:00010000:2.0:1746147264.823850:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a2d80 00000100:00100000:3.0:1746147264.823851:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466106496 00000100:00100000:3.0:1746147264.823855:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466106496 00000100:00100000:2.0:1746147264.823866:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7863 00000100:00100000:2.0:1746147264.823872:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466106240:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147264.823876:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b6a1c00 x1830967466106496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.823884:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1c00 with x1830967466106496 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.823887:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a1c00 00000100:00100000:3.0:1746147264.823902:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7864 00000100:00100000:3.0:1746147264.823906:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466106496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.834896:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466106496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10981us (11110us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.834910:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7864 00002000:00100000:3.0:1746147264.834921:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009b6a1c00 x1830967466106496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.834929:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1c00 with x1830967466106496 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.834935:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a1c00 00000100:00100000:3.0:1746147264.839734:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466106240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15855us (15994us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.839745:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7863 00002000:00100000:3.0:1746147264.839754:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009b6a2d80 x1830967466106240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.839763:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a2d80 with x1830967466106240 ext(0->1048575) 00002000:00010000:3.0:1746147264.839768:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6a2d80 00000100:00100000:0.0:1746147264.853638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.853671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.853700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.853723:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466106624 00000100:00100000:0.0:1746147264.853729:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466106624 00000100:00100000:0.0:1746147264.853760:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466106752 00000100:00100000:0.0:1746147264.853762:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466106752 00000100:00100000:0.0:1746147264.853772:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466106880 00000100:00100000:0.0:1746147264.853773:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466106880 00000100:00100000:0.0:1746147264.854432:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16441 00000100:00100000:0.0:1746147264.854440:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466106624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147264.854453:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147264.854467:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013690f400/0xb4b2209fbdad32a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf30 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.854564:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16442 00000100:00100000:3.0:1746147264.854571:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16443 00000100:00100000:1.0:1746147264.854572:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1957:x1830967466106752:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147264.854577:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:32345:x1830967466106880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.854578:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.854583:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.854587:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bba000/0xb4b2209fbdad32aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf37 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.854589:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf3e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.854603:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.854605:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.854610:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.854624:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467184000:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147264.854627:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.854636:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8600, rc 0) 00010000:00010000:0.0:1746147264.854757:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013690f400/0xb4b2209fbdad32a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf30 expref: 31 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.854768:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013690f400/0xb4b2209fbdad32a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf30 expref: 31 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147264.854780:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013690f400, rc 0) 00000100:00100000:3.0:1746147264.855029:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32345:x1830967466106880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 451us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.855035:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.855039:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16443 00000100:00100000:1.0:1746147264.855780:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466106624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1339us (2149us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147264.855786:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16441 00000100:00100000:3.0:1746147264.855827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.856065:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466107008 00000100:00100000:1.0:1746147264.856070:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466107008 00000100:00100000:1.0:1746147264.856103:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16444 00000100:00100000:1.0:1746147264.856109:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32341:x1830967466107008:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147264.856117:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.856124:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf45 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.856406:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.856413:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.856418:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.856419:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.856422:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1880064->2097151] (req 1880064->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.856442:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.856452:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.856460:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467184128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.856579:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467184000:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147264.856600:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bba000/0xb4b2209fbdad32aa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf37 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.856609:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bba000/0xb4b2209fbdad32aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf37 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147264.856620:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bba000, rc 0) 00010000:00010000:1.0:1746147264.857237:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.857245:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 25 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.857252:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467184256:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.857361:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466106752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2788us (3686us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147264.857367:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16442 00000100:00100000:1.0:1746147264.857989:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.862540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.862726:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467184256:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.862789:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466107136 00000100:00100000:2.0:1746147264.862796:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466107136 00000100:00100000:2.0:1746147264.863033:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16445 00000100:00100000:2.0:1746147264.863041:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+30:32338:x1830967466107136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.863065:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.863080:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf4c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.863105:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.863111:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.863113:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.863116:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.863140:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.863150:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 31 pid: 11147 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.863165:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467184384:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.863229:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.866484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.866573:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466107264 00000100:00100000:1.0:1746147264.866584:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466107264 00010000:00010000:1.0:1746147264.866621:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 25 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.866663:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8428 00000100:00100000:1.0:1746147264.866671:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1958:x1830967466107264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.866683:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147264.866699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.866701:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 25 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.866711:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 25 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.866735:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bea00/0xb4b2209fbdad326b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf14 expref: 25 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.866921:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467184128:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.866990:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1880064->2097151] (req 1880064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.867006:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbb800, rc 0) 00000100:00100000:2.0:1746147264.867065:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32341:x1830967466107008:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10945us (11227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.867072:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16444 00000100:00100000:0.0:1746147264.867220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147264.867629:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.867648:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466107648 00000100:00100000:3.0:1746147264.867654:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466107648 00000100:00100000:1.0:1746147264.867675:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1958:x1830967466107264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1003us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.867682:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8428 00002000:00100000:3.0:1746147264.867690:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e974000 x1830967466107648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.867699:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974000 with x1830967466107648 ext(1048576->2097151) 00010000:00010000:3.0:1746147264.867707:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.867717:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.867723:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e974000 00000100:00100000:3.0:1746147264.867745:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466107776 00000100:00100000:3.0:1746147264.867748:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466107776 00002000:00100000:3.0:1746147264.867759:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008e977800 x1830967466107776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.867766:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967466107776 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.867769:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:3.0:1746147264.867781:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2682 00000100:00100000:3.0:1746147264.867787:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967466107648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.868353:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7865 00000100:00100000:2.0:1746147264.868451:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967466107776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.869408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.869472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.869487:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466108032 00000100:00100000:1.0:1746147264.869494:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466108032 00002000:00100000:1.0:1746147264.869524:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009edca680 x1830967466108032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.869538:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca680 with x1830967466108032 ext(1048576->2097151) 00002000:00010000:1.0:1746147264.869542:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edca680 00000100:00100000:1.0:1746147264.869554:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466108160 00000100:00100000:1.0:1746147264.869556:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466108160 00002000:00100000:1.0:1746147264.869566:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2600960->3125247) req@ffff88009edc9880 x1830967466108160/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.869571:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830967466108160 ext(2600960->3125247) 00010000:00010000:1.0:1746147264.869578:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 32 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.869590:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 32 pid: 11147 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746147264.869595:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc9880 00000100:00100000:1.0:1746147264.869605:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2683 00000100:00100000:1.0:1746147264.869610:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967466108160:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147264.869858:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967467184384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147264.869885:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.869899:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bf400, rc 0) 00000100:00100000:2.0:1746147264.869964:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:32338:x1830967466107136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6922us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.869972:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16445 00000100:00100000:2.0:1746147264.870004:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7866 00000100:00100000:2.0:1746147264.870027:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466108032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.877429:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466108032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7393us (8014us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.877442:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7866 00002000:00100000:3.0:1746147264.877453:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009edca680 x1830967466108032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.877462:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca680 with x1830967466108032 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.877469:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edca680 00000100:00100000:1.0:1746147264.879468:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1959:x1830967466108160:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9848us (9985us total) trans 17179874199 rc 0/0 00000100:00100000:1.0:1746147264.879481:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2683 00002000:00100000:1.0:1746147264.879491:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2600960->3125247) req@ffff88009edc9880 x1830967466108160/t17179874199(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.879505:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830967466108160 ext(2600960->3125247) 00010000:00010000:1.0:1746147264.879515:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 33 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.879534:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 33 pid: 11147 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746147264.879541:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc9880 00000100:00100000:3.0:1746147264.882241:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967466107776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13871us (15010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.882254:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7865 00002000:00100000:3.0:1746147264.882266:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88008e977800 x1830967466107776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.882278:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967466107776 ext(1048576->2097151) 00002000:00010000:3.0:1746147264.882285:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:0.0:1746147264.882689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.882766:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466108288 00000100:00100000:1.0:1746147264.882774:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466108288 00010000:00010000:1.0:1746147264.882806:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 33 pid: 11147 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.882834:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8429 00000100:00100000:1.0:1746147264.882841:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967466108288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.882856:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.882875:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 33 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.882886:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 33 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.882908:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85c3c00/0xb4b2209fbdad31d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [2600960->3145727] (req 2600960->3125247) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec7 expref: 33 pid: 11147 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.882951:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.882954:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.882961:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.882974:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.883007:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147264.883021:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467184512:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147264.883108:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.884881:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466107648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17086us (18174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.884892:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2682 00002000:00100000:3.0:1746147264.884903:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88008e974000 x1830967466107648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.884913:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974000 with x1830967466107648 ext(1048576->2097151) 00010000:00010000:3.0:1746147264.884924:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.884960:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.884966:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e974000 00000100:00100000:1.0:1746147264.885122:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967467184512:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147264.885143:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.885202:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1958:x1830967466108288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2361us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.885210:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8429 00000100:00100000:0.0:1746147264.893785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.893932:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466108544 00000100:00100000:3.0:1746147264.893979:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466108544 00002000:00100000:3.0:1746147264.894342:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e975f80 x1830967466108544/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.894352:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975f80 with x1830967466108544 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.894357:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975f80 00000100:00100000:3.0:1746147264.894387:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7867 00000100:00100000:3.0:1746147264.894395:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466108544:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.897003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.897430:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466108672 00000100:00100000:2.0:1746147264.897439:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466108672 00010000:00010000:2.0:1746147264.897479:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.897725:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8430 00000100:00100000:2.0:1746147264.897814:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466108672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.897829:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.897879:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.897893:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.897960:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8600/0xb4b2209fbdad32b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf3e expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.898415:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.898417:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.898425:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.898433:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.898481:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.898497:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467184640:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.898618:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.900844:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967467184640:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147264.900864:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.900913:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967466108672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3101us (3919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.900922:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8430 00000100:00100000:0.0:1746147264.903810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.903918:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466108928 00000100:00100000:2.0:1746147264.903973:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466108928 00002000:00100000:2.0:1746147264.904045:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1880064->1884159) req@ffff88008e977100 x1830967466108928/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.904064:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977100 with x1830967466108928 ext(1880064->1884159) 00002000:00010000:2.0:1746147264.904082:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977100 00000100:00100000:2.0:1746147264.904422:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7868 00000100:00100000:2.0:1746147264.904431:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466108928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147264.904925:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466108544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10528us (11148us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.904933:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7867 00002000:00100000:3.0:1746147264.904958:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88008e975f80 x1830967466108544/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.904966:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975f80 with x1830967466108544 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.904971:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975f80 00000100:00100000:2.0:1746147264.905393:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1956:x1830967466108928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 961us (1591us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147264.905400:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7868 00002000:00100000:2.0:1746147264.905406:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1880064->1884159) req@ffff88008e977100 x1830967466108928/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.905413:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977100 with x1830967466108928 ext(1880064->1884159) 00002000:00010000:2.0:1746147264.905416:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977100 00000100:00100000:1.0:1746147264.905559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.905836:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466109056 00000100:00100000:3.0:1746147264.905850:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466109056 00000100:00100000:3.0:1746147264.905891:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16446 00000100:00100000:3.0:1746147264.905897:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+51:32345:x1830967466109056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147264.905918:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.906340:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf53 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.906368:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.906370:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.906377:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 52 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.906401:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 52 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.906421:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8600, rc 0) 00000100:00100000:3.0:1746147264.907184:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+52:32345:x1830967466109056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1285us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.907191:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16446 00000100:00100000:0.0:1746147264.909354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.909672:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466109184 00000100:00100000:3.0:1746147264.909682:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466109184 00000100:00100000:3.0:1746147264.909734:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16447 00000100:00100000:3.0:1746147264.909742:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32341:x1830967466109184:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147264.909762:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147264.909780:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf5a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.909811:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 27 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.909818:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.909824:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.909826:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.909830:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->1417215] (req 1048576->1417215) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.909861:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.909872:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 24 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.909884:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467184768:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.910005:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 27 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147264.910014:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 27 pid: 17530 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.910023:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467184896:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147264.910043:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.910985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.911159:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466109312 00000100:00100000:2.0:1746147264.911165:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466109312 00000100:00100000:2.0:1746147264.911217:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16448 00000100:00100000:2.0:1746147264.911224:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32338:x1830967466109312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147264.911244:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.911256:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf61 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.911285:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.911291:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.911292:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147264.911304:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.911322:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.911340:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 27 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.911348:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467185024:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147264.911437:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.917184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.918952:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466109568 00000100:00100000:2.0:1746147264.918966:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466109568 00002000:00100000:2.0:1746147264.919020:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f2a00 x1830967466109568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.919031:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2a00 with x1830967466109568 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.919037:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2a00 00000100:00100000:2.0:1746147264.919635:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7869 00000100:00100000:2.0:1746147264.919644:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1959:x1830967466109568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.919844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.919893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.919910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.919953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.919978:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466109952 00000100:00100000:1.0:1746147264.919982:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466109952 00010000:00010000:1.0:1746147264.920005:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 27 pid: 6881 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.920023:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466110208 00000100:00100000:1.0:1746147264.920025:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466110208 00010000:00010000:1.0:1746147264.920035:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 28 pid: 17530 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746147264.920049:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8431 00000100:00100000:1.0:1746147264.920065:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967466109952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147264.920076:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.920098:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 27 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.920108:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 27 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.920131:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147264.920173:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+27:1957:x1830967466109952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.920179:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8431 00000100:00100000:1.0:1746147264.920195:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8432 00000100:00100000:1.0:1746147264.920200:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967466110208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.920206:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb200/0xb4b2209fbdad3168 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede8f expref: 26 pid: 6881 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.920206:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147264.920212:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 28 pid: 17530 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.920220:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 28 pid: 17530 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746147264.920225:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467184768:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.920232:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.920234:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147264.920236:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bbac00/0xb4b2209fbdad3137 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede65 expref: 28 pid: 17530 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746147264.920240:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.920245:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467184896:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147264.920248:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.920275:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.920276:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.920284:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8a00, rc 0) 00000100:00100000:1.0:1746147264.920286:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467185152:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147264.920305:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32341:x1830967466109184:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10565us (10959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.920312:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16447 00000100:00100000:1.0:1746147264.920336:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147264.920337:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466109824 00000100:00100000:3.0:1746147264.920340:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466109824 00002000:00100000:3.0:1746147264.920355:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009edcbb80 x1830967466109824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 504/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.920363:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967466109824 ext(2097152->3145727) 00010000:00010000:3.0:1746147264.920368:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.920379:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 28 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.920385:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edcbb80 00000100:00100000:3.0:1746147264.920402:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466110080 00000100:00100000:3.0:1746147264.920405:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466110080 00002000:00100000:3.0:1746147264.920419:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2146304->2187263) req@ffff88009edc9f80 x1830967466110080/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.920425:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9f80 with x1830967466110080 ext(2146304->2187263) 00010000:00010000:3.0:1746147264.920428:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746147264.920431:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467185024:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147264.920436:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.920441:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edc9f80 00010000:00010000:1.0:1746147264.920444:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147264.920451:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2684 00010000:00010000:1.0:1746147264.920452:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a477d200, rc 0) 00000100:00100000:3.0:1746147264.920456:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466109824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.920471:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32338:x1830967466109312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9249us (9491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.920477:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16448 00000100:00100000:1.0:1746147264.920544:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2685 00000100:00100000:1.0:1746147264.920550:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967466110080:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147264.929622:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467185152:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147264.929657:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147264.929704:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967466110208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9502us (9749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147264.929715:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8432 00000100:00100000:1.0:1746147264.932247:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967466110080:12345-192.168.203.36@tcp:4:cat.0 Request processed in 11686us (12324us total) trans 21474841534 rc 0/0 00000100:00100000:1.0:1746147264.932259:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2685 00002000:00100000:1.0:1746147264.932271:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2146304->2187263) req@ffff88009edc9f80 x1830967466110080/t21474841534(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/448 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.932282:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9f80 with x1830967466110080 ext(2146304->2187263) 00010000:00010000:1.0:1746147264.932291:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 31 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746147264.932306:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 31 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746147264.932312:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edc9f80 00000100:00100000:0.0:1746147264.932843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.932890:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466110464 00000100:00100000:1.0:1746147264.932899:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466110464 00002000:00100000:1.0:1746147264.932930:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1413120->1417215) req@ffff88009e6f3b80 x1830967466110464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.932955:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3b80 with x1830967466110464 ext(1413120->1417215) 00002000:00010000:1.0:1746147264.932959:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3b80 00000100:00100000:1.0:1746147264.932975:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7870 00000100:00100000:1.0:1746147264.932981:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466110464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.934345:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466110464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1357us (1497us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147264.934355:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7870 00002000:00100000:1.0:1746147264.934363:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1413120->1417215) req@ffff88009e6f3b80 x1830967466110464/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.934371:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f3b80 with x1830967466110464 ext(1413120->1417215) 00002000:00010000:1.0:1746147264.934376:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f3b80 00000100:00100000:3.0:1746147264.936663:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466109824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16198us (16812us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746147264.936674:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2684 00002000:00100000:3.0:1746147264.936682:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009edcbb80 x1830967466109824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 504/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:H/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.936690:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967466109824 ext(2097152->3145727) 00010000:00010000:3.0:1746147264.936700:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746147264.936720:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00002000:00010000:3.0:1746147264.936726:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edcbb80 00000100:00100000:3.0:1746147264.938449:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1959:x1830967466109568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18803us (21274us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147264.938458:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7869 00002000:00100000:3.0:1746147264.939629:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009e6f2a00 x1830967466109568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.939638:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2a00 with x1830967466109568 ext(2097152->3145727) 00002000:00010000:3.0:1746147264.939644:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e6f2a00 00000100:00100000:0.0:1746147264.948662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.949075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147264.949124:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466110720 00000100:00100000:2.0:1746147264.949132:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466110720 00010000:00010000:2.0:1746147264.949168:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746147264.949195:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8433 00000100:00100000:2.0:1746147264.949203:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466110720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147264.949217:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147264.949242:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.949254:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.949278:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093803800/0xb4b2209fbdad31d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2146304->2187263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edec0 expref: 29 pid: 8478 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746147264.949314:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.949317:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147264.949324:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.949332:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.949369:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147264.949382:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467185280:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147264.949465:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147264.949621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147264.949895:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466110592 00000100:00100000:1.0:1746147264.949900:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466110592 00000100:00100000:1.0:1746147264.949927:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16449 00000100:00100000:1.0:1746147264.949932:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32345:x1830967466110592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147264.949969:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147264.949982:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf68 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.950003:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.950004:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147264.950009:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.950020:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147264.950028:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7bfa00, rc 0) 00000100:00100000:1.0:1746147264.950070:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:32345:x1830967466110592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 137us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147264.950075:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16449 00000100:00100000:2.0:1746147264.950581:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466110976 00000100:00100000:2.0:1746147264.950585:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466110976 00000100:00100000:2.0:1746147264.950625:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11646 00000100:00100000:2.0:1746147264.950631:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:32348:x1830967466110976:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147264.950646:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147264.950659:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad32e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf6f expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.950757:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950766:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950776:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950787:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950792:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950796:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950894:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad32f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950902:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad32f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.950908:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad32f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147264.950916:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147264.951021:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951028:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951033:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951038:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a551fe00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.951041:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951046:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951067:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147264.951070:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.951073:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951078:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad32e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951088:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951097:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951102:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951106:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a551ea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147264.951108:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951112:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951117:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6100) 00010000:00010000:2.0:1746147264.951128:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147264.951130:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951134:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad32f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147264.951175:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fa00/0xb4b2209fbdad32e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf6f expref: 311 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.951187:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad32f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf6f expref: 310 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147264.951192:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147264.951194:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147264.951196:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e200, rc 0) 00000100:00100000:2.0:1746147264.951240:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32348:x1830967466110976:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 608us (1619us total) trans 8589945699 rc 0/0 00000100:00100000:2.0:1746147264.951247:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11646 00000100:00100000:0.0:1746147264.962151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.962569:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466111104 00000100:00100000:3.0:1746147264.962580:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466111104 00000100:00100000:3.0:1746147264.962727:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 803 00000100:00100000:3.0:1746147264.962735:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1958:x1830967466111104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147264.962786:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147264.962850:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad32f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf6f expref: 310 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147264.962891:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147264.962896:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147264.963042:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1958:x1830967466111104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 295us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147264.963074:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 803 00000100:00100000:2.0:1746147264.963879:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967467185280:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147264.963907:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147264.964916:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466110720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 15711us (15839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147264.964933:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8433 00000100:00100000:0.0:1746147264.967903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.968258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147264.968282:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466111488 00000100:00100000:3.0:1746147264.968291:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466111488 00002000:00100000:3.0:1746147264.968339:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009e6f2300 x1830967466111488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147264.968349:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2300 with x1830967466111488 ext(3145728->4194303) 00002000:00010000:3.0:1746147264.968354:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f2300 00000100:00100000:3.0:1746147264.968384:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7871 00000100:00100000:3.0:1746147264.968391:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967466111488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.969497:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466111360 00000100:00100000:1.0:1746147264.969505:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466111360 00000100:00100000:0.0:1746147264.969523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:1.0:1746147264.969530:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009e6f1c00 x1830967466111360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.969540:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1c00 with x1830967466111360 ext(2097152->3145727) 00002000:00010000:1.0:1746147264.969544:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f1c00 00000100:00100000:0.0:1746147264.969549:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466111872 00000100:00100000:0.0:1746147264.969552:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466111872 00000100:00100000:1.0:1746147264.969562:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7872 00000100:00100000:1.0:1746147264.969568:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967466111360:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147264.969578:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009e6f0700 x1830967466111872/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.969586:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0700 with x1830967466111872 ext(2097152->3145727) 00002000:00010000:0.0:1746147264.969599:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f0700 00000100:00100000:0.0:1746147264.969610:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7873 00000100:00100000:0.0:1746147264.969615:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466111872:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147264.969787:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.970452:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466112128 00000100:00100000:0.0:1746147264.970456:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466112128 00002000:00100000:0.0:1746147264.970486:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009e6f0e00 x1830967466112128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.970505:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0e00 with x1830967466112128 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.970508:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f0e00 00000100:00100000:0.0:1746147264.970535:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7874 00000100:00100000:0.0:1746147264.970543:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1957:x1830967466112128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147264.974490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147264.974636:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466112384 00000100:00100000:0.0:1746147264.974646:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466112384 00002000:00100000:0.0:1746147264.974689:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009edcad80 x1830967466112384/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/0 e 0 to 0 dl 1746147275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147264.974707:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967466112384 ext(3145728->4194303) 00002000:00010000:0.0:1746147264.974712:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:0.0:1746147264.974738:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7875 00000100:00100000:0.0:1746147264.974746:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466112384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147264.987927:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1957:x1830967466112128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17370us (18132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.988262:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7874 00002000:00100000:2.0:1746147264.988277:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009e6f0e00 x1830967466112128/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.988287:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0e00 with x1830967466112128 ext(3145728->4194303) 00002000:00010000:2.0:1746147264.988293:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f0e00 00000100:00100000:1.0:1746147264.989011:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967466111360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19441us (20751us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.989019:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7872 00002000:00100000:1.0:1746147264.989025:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009e6f1c00 x1830967466111360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.989032:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f1c00 with x1830967466111360 ext(2097152->3145727) 00002000:00010000:1.0:1746147264.989035:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f1c00 00000100:00100000:1.0:1746147264.999728:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466112384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24967us (25239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147264.999744:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7875 00002000:00100000:1.0:1746147264.999759:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009edcad80 x1830967466112384/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147264.999770:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967466112384 ext(3145728->4194303) 00002000:00010000:1.0:1746147264.999777:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:2.0:1746147264.999872:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466111872:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30255us (30348us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147264.999880:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7873 00002000:00100000:2.0:1746147264.999887:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88009e6f0700 x1830967466111872/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147264.999898:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f0700 with x1830967466111872 ext(2097152->3145727) 00002000:00010000:2.0:1746147264.999902:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f0700 00000100:00100000:3.0:1746147265.003893:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967466111488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 35490us (35989us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.003906:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7871 00002000:00100000:3.0:1746147265.003917:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88009e6f2300 x1830967466111488/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:640/0 lens 488/440 e 0 to 0 dl 1746147275 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.003927:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e6f2300 with x1830967466111488 ext(3145728->4194303) 00002000:00010000:3.0:1746147265.003934:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e6f2300 00000100:00100000:0.0:1746147265.008527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.008599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.008712:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466112640 00000100:00100000:1.0:1746147265.008722:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466112640 00000100:00100000:1.0:1746147265.008789:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466112512 00000100:00100000:1.0:1746147265.008792:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466112512 00000100:00100000:1.0:1746147265.008815:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16450 00000100:00100000:1.0:1746147265.008825:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967466112640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.008846:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.008865:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bbbc00/0xb4b2209fbdad3305 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf7d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.008933:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467185408:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147265.009074:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.009442:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16451 00000100:00100000:2.0:1746147265.009452:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967466112512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147265.009461:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.009471:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad330c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf76 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.009501:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467185536:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147265.009528:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.012168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.012278:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466112896 00000100:00100000:3.0:1746147265.012287:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466112896 00002000:00100000:3.0:1746147265.012338:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012df7a680 x1830967466112896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.012348:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7a680 with x1830967466112896 ext(4194304->4976639) 00002000:00010000:3.0:1746147265.012354:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7a680 00000100:00100000:3.0:1746147265.012373:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7876 00000100:00100000:3.0:1746147265.012381:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967466112896:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:1.0:1746147265.013999:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147261 -> 1746147264 00002000:00010000:1.0:1746147265.014006:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147261 -> 1746147264 00002000:00010000:1.0:1746147265.014008:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147261 -> 1746147264 00000100:00100000:1.0:1746147265.014031:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467185408:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147265.014088:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bbbc00/0xb4b2209fbdad3305 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf7d expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.014103:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bbbc00/0xb4b2209fbdad3305 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf7d expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.014122:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bbbc00, rc 0) 00000100:00100000:1.0:1746147265.014166:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967466112640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5342us (5648us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147265.014175:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16450 00000100:00080000:2.0:1746147265.014822:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147265.017359:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467185536:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147265.017395:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad330c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf76 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.017408:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad330c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf76 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.017423:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e800, rc 0) 00000100:00100000:2.0:1746147265.017468:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466112512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8018us (8868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147265.017477:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16451 00000100:00100000:3.0:1746147265.024256:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967466112896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11860us (12080us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147265.024271:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7876 00002000:00100000:3.0:1746147265.024285:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012df7a680 x1830967466112896/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.024295:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012df7a680 with x1830967466112896 ext(4194304->4976639) 00002000:00010000:3.0:1746147265.024301:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012df7a680 00010000:00010000:3.0:1746147265.025661:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147265.028707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.028756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.028819:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466113152 00000100:00100000:0.0:1746147265.028828:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466113152 00000100:00100000:0.0:1746147265.028870:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466113024 00000100:00100000:0.0:1746147265.028873:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466113024 00000100:00100000:0.0:1746147265.028888:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16452 00000100:00100000:0.0:1746147265.028896:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967466113152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147265.028916:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.028952:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093803000/0xb4b2209fbdad3313 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf8b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.029017:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467185664:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147265.029215:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16453 00000100:00100000:0.0:1746147265.029222:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967466113024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147265.029229:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.029236:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093803c00/0xb4b2209fbdad331a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf84 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.029264:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467185792:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147265.030416:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.030737:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.032423:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467185664:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147265.032462:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093803000/0xb4b2209fbdad3313 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf8b expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.032480:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093803000/0xb4b2209fbdad3313 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf8b expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.032502:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803000, rc 0) 00000100:00100000:2.0:1746147265.032587:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967466113152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3687us (3890us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147265.032596:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16452 00000100:00100000:3.0:1746147265.032735:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e6f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467185792:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147265.032753:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093803c00/0xb4b2209fbdad331a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf84 expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.032762:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093803c00/0xb4b2209fbdad331a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf84 expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.032775:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803c00, rc 0) 00000100:00100000:3.0:1746147265.032801:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967466113024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3579us (4043us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147265.032807:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16453 00000100:00100000:1.0:1746147265.033850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.034379:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466113408 00000100:00100000:3.0:1746147265.034387:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466113408 00000100:00100000:3.0:1746147265.034427:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4916 00000100:00100000:3.0:1746147265.034436:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:32338:x1830967466113408:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147265.034821:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32338:x1830967466113408:12345-192.168.203.36@tcp:35:cat.0 Request processed in 385us (974us total) trans 8589945700 rc 0/0 00000100:00100000:3.0:1746147265.034827:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4916 00000100:00100000:0.0:1746147265.038072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.038122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.038183:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466113536 00000100:00100000:2.0:1746147265.038192:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466113536 00000100:00100000:2.0:1746147265.038347:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466113664 00000100:00100000:2.0:1746147265.038351:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466113664 00000100:00100000:3.0:1746147265.038382:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16454 00000100:00100000:3.0:1746147265.038391:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967466113536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.038415:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.038432:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3321 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf92 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.038488:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467185920:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147265.038589:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16455 00000100:00100000:2.0:1746147265.038595:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967466113664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147265.038602:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.038609:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad3328 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edf99 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.038631:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467186048:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147265.039363:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.042216:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.043330:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012df7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467186048:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147265.047222:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad3328 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf99 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.047243:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad3328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf99 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.047307:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551ea00, rc 0) 00000100:00100000:2.0:1746147265.047392:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967466113664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8792us (9265us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147265.047403:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16455 00000100:00100000:3.0:1746147265.048657:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967467185920:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147265.048689:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3321 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf92 expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.048701:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb9200/0xb4b2209fbdad3321 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf92 expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.048711:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb9200, rc 0) 00000100:00100000:3.0:1746147265.048761:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967466113536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10371us (10697us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147265.048768:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16454 00000100:00100000:0.0:1746147265.058584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.061161:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466113920 00000100:00100000:3.0:1746147265.061175:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466113920 00000100:00100000:3.0:1746147265.061801:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4917 00000100:00100000:3.0:1746147265.061810:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:32345:x1830967466113920:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147265.062078:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32345:x1830967466113920:12345-192.168.203.36@tcp:35:cat.0 Request processed in 268us (3505us total) trans 8589945701 rc 0/0 00000100:00100000:3.0:1746147265.062088:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4917 00000100:00100000:0.0:1746147265.077434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.081142:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466114176 00000100:00100000:2.0:1746147265.081155:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466114176 00000100:00100000:2.0:1746147265.081218:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11647 00000100:00100000:2.0:1746147265.081225:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32352:x1830967466114176:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147265.081251:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.081270:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad332f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfa0 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.081373:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081383:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081392:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081403:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081408:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081413:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081502:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad3344 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081508:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad3344 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081514:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad3344 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147265.081522:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147265.081593:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081599:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081604:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081610:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a551e800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147265.081613:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081618:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081627:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147265.081629:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147265.081632:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081636:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e800/0xb4b2209fbdad3336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081665:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081669:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081677:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081680:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a551ea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147265.081682:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081686:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081690:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6100) 00010000:00010000:2.0:1746147265.081691:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147265.081693:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081696:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad333d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.081726:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551fe00/0xb4b2209fbdad332f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa0 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.081735:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad3344 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa0 expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.081739:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147265.081741:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147265.081743:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e200, rc 0) 00000100:00100000:2.0:1746147265.081795:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32352:x1830967466114176:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 570us (4374us total) trans 8589945702 rc 0/0 00000100:00100000:2.0:1746147265.081801:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11647 00000100:00100000:0.0:1746147265.106414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.106503:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466114432 00000100:00100000:1.0:1746147265.106513:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466114432 00000100:00100000:1.0:1746147265.106563:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4918 00000100:00100000:1.0:1746147265.106569:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32352:x1830967466114432:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147265.106793:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32352:x1830967466114432:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 223us (387us total) trans 8589945703 rc 0/0 00000100:00100000:1.0:1746147265.106800:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4918 00000100:00100000:3.0:1746147265.131526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.131613:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466114560 00000100:00100000:0.0:1746147265.131623:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466114560 00000100:00100000:0.0:1746147265.131675:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16456 00000100:00100000:0.0:1746147265.131684:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32348:x1830967466114560:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147265.131703:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.131721:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfa7 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.131752:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.131761:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.131767:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.131769:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.131772:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2543616->3145727] (req 2543616->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.131801:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.131817:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 30 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.131829:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467186176:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.131909:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.131918:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 23 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.131926:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467186304:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.131959:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.133336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.133353:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466114688 00000100:00100000:0.0:1746147265.133359:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466114688 00000100:00080000:0.0:1746147265.133380:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147265.133404:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16457 00000100:00100000:0.0:1746147265.133409:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:32352:x1830967466114688:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147265.133420:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.133430:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfae expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.133447:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.133451:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2543616->3145727] (req 2543616->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.133462:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147265.133465:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2486272->2715647] (req 2486272->2715647) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.133486:0:17530:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2543616->3145727] (req 2543616->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.133495:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [2486272->2715647] (req 2486272->2715647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.133503:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802200, rc 0) 00000100:00100000:0.0:1746147265.133528:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:32352:x1830967466114688:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 119us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.133534:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16457 00000100:00100000:0.0:1746147265.140556:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467186176:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.140583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.140604:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466114816 00000100:00100000:0.0:1746147265.140609:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466114816 00010000:00010000:0.0:1746147265.140641:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.140667:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8434 00000100:00100000:0.0:1746147265.140673:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967466114816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.140685:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.140707:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.140717:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.140737:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7bfa00/0xb4b2209fbdad32db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf68 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.140756:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.140791:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967466114816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.140797:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8434 00000100:00100000:0.0:1746147265.140915:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467186304:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.140952:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2543616->3145727] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.140962:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802400, rc 0) 00000100:00100000:0.0:1746147265.140981:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:32348:x1830967466114560:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9299us (9467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.140986:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16456 00000100:00100000:1.0:1746147265.144381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.144413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.144438:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466114944 00000100:00100000:1.0:1746147265.144445:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466114944 00010000:00010000:1.0:1746147265.144478:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 25 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.144506:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8435 00000100:00100000:1.0:1746147265.144513:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+25:1959:x1830967466114944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.144526:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.144547:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 25 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.144560:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 25 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.144585:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a477d200/0xb4b2209fbdad32d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf61 expref: 25 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.144602:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.144604:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.144611:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.144620:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.144831:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.144843:0:11078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 28 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.144853:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467186560:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147265.144919:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.144955:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466115072 00000100:00100000:1.0:1746147265.144959:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466115072 00000100:00100000:1.0:1746147265.144985:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11648 00000100:00100000:1.0:1746147265.144991:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:32354:x1830967466115072:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147265.145012:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.145027:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094761e00/0xb4b2209fbdad3360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfb5 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.145094:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145103:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145112:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145124:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145134:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145139:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145238:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145248:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.145254:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.145274:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.145281:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 15 pid: 14049 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.145289:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467186688:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.145315:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.147562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.147769:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467186688:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.147789:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147265.147812:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466115200 00000100:00100000:1.0:1746147265.147817:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466115200 00010000:00010000:1.0:1746147265.147841:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 16 pid: 14049 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.147865:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8436 00000100:00100000:1.0:1746147265.147872:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967466115200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.147884:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.147889:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 16 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.147898:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 16 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.147918:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e0fa00/0xb4b2209fbdad3256 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf0d expref: 16 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.147948:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.147953:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.147962:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.147968:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.147985:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.148071:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012df7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967466115200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 198us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.148077:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8436 00000100:00100000:0.0:1746147265.148910:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967467186560:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147265.148923:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.148961:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466114944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4448us (4588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.148967:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8435 00000100:00100000:2.0:1746147265.148993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147265.150693:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150704:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147265.150747:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147265.150750:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147265.150768:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150778:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150787:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150793:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150798:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150802:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094760e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.150806:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150811:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150822:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147265.150824:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147265.150828:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150836:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094760e00/0xb4b2209fbdad3367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150850:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150854:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150858:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150862:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094760200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.150864:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150867:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150872:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f200) 00010000:00010000:0.0:1746147265.150873:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147265.150875:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150879:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094760200/0xb4b2209fbdad336e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.150916:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094761e00/0xb4b2209fbdad3360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.150926:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.150951:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.150953:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147265.150955:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4bf9200, rc 0) 00000100:00100000:0.0:1746147265.151336:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32354:x1830967466115072:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 6343us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.151345:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11648 00000100:00100000:3.0:1746147265.151387:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466115456 00000100:00100000:3.0:1746147265.151394:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466115456 00002000:00100000:3.0:1746147265.151487:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2543616->2547711) req@ffff88009b6a1180 x1830967466115456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.151496:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1180 with x1830967466115456 ext(2543616->2547711) 00010000:00010000:3.0:1746147265.151504:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.151517:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:3.0:1746147265.151523:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6a1180 00000100:00100000:3.0:1746147265.151679:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2686 00000100:00100000:3.0:1746147265.151688:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967466115456:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147265.151820:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967466115456:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 132us (2827us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147265.151826:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2686 00002000:00100000:3.0:1746147265.151831:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2543616->2547711) req@ffff88009b6a1180 x1830967466115456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.151838:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a1180 with x1830967466115456 ext(2543616->2547711) 00010000:00010000:3.0:1746147265.151842:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.151855:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:3.0:1746147265.151860:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6a1180 00000100:00100000:0.0:1746147265.155036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.155075:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466115712 00000100:00100000:0.0:1746147265.155084:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466115712 00000100:00100000:0.0:1746147265.155125:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11649 00000100:00100000:0.0:1746147265.155131:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+15:32357:x1830967466115712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147265.155151:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.155169:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093802600/0xb4b2209fbdad337c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfbc expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.155613:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155626:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155637:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155649:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155654:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155663:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155764:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155772:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155777:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147265.155785:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147265.155870:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155877:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155883:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155888:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093803e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.155892:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155898:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155908:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147265.155911:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147265.155915:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155923:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093803e00/0xb4b2209fbdad3383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155953:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155958:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155963:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155967:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093803400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.155969:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155974:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155980:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f5daa00) 00010000:00010000:0.0:1746147265.155981:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147265.155984:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.155988:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093803400/0xb4b2209fbdad338a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.156026:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093802600/0xb4b2209fbdad337c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.156037:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.156047:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.156049:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147265.156061:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802e00, rc 0) 00000100:00100000:0.0:1746147265.156110:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32357:x1830967466115712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 978us (1079us total) trans 8589945704 rc 0/0 00000100:00100000:0.0:1746147265.156116:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11649 00000100:00100000:0.0:1746147265.156167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.158318:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466115840 00000100:00100000:0.0:1746147265.158328:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466115840 00000100:00100000:0.0:1746147265.158369:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16458 00000100:00100000:0.0:1746147265.158376:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1956:x1830967466115840:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147265.158378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147265.158392:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147265.158394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.158407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147265.158408:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfc3 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.158418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147265.158429:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.158431:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147265.158438:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466115968 00010000:00010000:0.0:1746147265.158439:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147265.158442:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466115968 00010000:00010000:0.0:1746147265.158452:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147265.158461:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116096 00000100:00100000:2.0:1746147265.158462:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116096 00010000:00010000:0.0:1746147265.158464:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802c00, rc 0) 00000100:00100000:3.0:1746147265.158466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.158473:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116224 00000100:00100000:2.0:1746147265.158475:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116224 00000100:00100000:2.0:1746147265.158482:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116352 00000100:00100000:2.0:1746147265.158483:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116352 00000100:00100000:3.0:1746147265.158484:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116480 00000100:00100000:3.0:1746147265.158487:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116480 00000100:00100000:2.0:1746147265.158495:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16459 00000100:00100000:2.0:1746147265.158500:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466115968:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147265.158501:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466115840:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 126us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.158506:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16460 00010000:00010000:2.0:1746147265.158508:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147265.158511:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466116096:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147265.158511:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16458 00010000:00010000:3.0:1746147265.158516:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.158518:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad33a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfca expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.158523:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad33ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfd1 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.158528:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16461 00000100:00100000:0.0:1746147265.158531:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466116224:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147265.158536:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.158541:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfd8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.158549:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.158550:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.158554:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147265.158556:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467186944:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147265.158556:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467186816:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147265.158562:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.158568:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093803200, rc 0) 00000100:00100000:0.0:1746147265.158580:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466116224:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.158584:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16461 00000100:00100000:2.0:1746147265.158602:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16462 00000100:00100000:3.0:1746147265.158603:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.158606:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16463 00000100:00100000:2.0:1746147265.158608:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466116352:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147265.158610:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466116480:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147265.158614:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.158615:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.158620:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfdf expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.158622:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093802000/0xb4b2209fbdad33c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfe6 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.158630:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6ce40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147265.158630:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.158631:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.158636:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147265.158644:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467187072:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147265.158646:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.158654:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dce00, rc 0) 00000100:00100000:0.0:1746147265.158664:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.158670:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466116352:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.158674:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16462 00000100:00100000:3.0:1746147265.162596:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467186944:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147265.162627:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad33ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd1 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.162640:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8e00/0xb4b2209fbdad33ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd1 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.162650:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb8e00, rc 0) 00000100:00100000:3.0:1746147265.162690:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466116096:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4178us (4293us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147265.162699:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16460 00000100:00100000:3.0:1746147265.162744:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467186816:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147265.162759:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad33a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfca expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.162767:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd800/0xb4b2209fbdad33a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfca expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.162774:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd800, rc 0) 00000100:00100000:3.0:1746147265.162789:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466115968:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4289us (4411us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147265.162794:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16459 00000100:00100000:2.0:1746147265.163520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.164189:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467187072:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147265.164209:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093802000/0xb4b2209fbdad33c2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfe6 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.164219:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093802000/0xb4b2209fbdad33c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfe6 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.164227:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093802000, rc 0) 00000100:00100000:0.0:1746147265.164255:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1956:x1830967466116480:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 5644us (5788us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147265.164262:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16463 00000100:00100000:0.0:1746147265.164277:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116608 00000100:00100000:0.0:1746147265.164282:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116608 00000100:00100000:0.0:1746147265.164307:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16464 00000100:00100000:0.0:1746147265.164313:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967466116608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147265.164326:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.164338:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ac4400/0xb4b2209fbdad33c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edfed expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.164381:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467187200:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147265.164424:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.164464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.165025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.165044:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116992 00000100:00100000:0.0:1746147265.165047:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116992 00000100:00100000:0.0:1746147265.165077:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16465 00000100:00100000:0.0:1746147265.165081:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+52:32348:x1830967466116992:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147265.165089:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.165099:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edff4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165116:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165124:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.165131:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 53 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165137:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 53 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165143:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147265.165144:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147265.165148:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->3510271] (req 3145728->3510271) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165169:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 53 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165179:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 53 pid: 11147 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.165188:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187328:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.165226:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 53 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165234:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 53 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.165241:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187456:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.165265:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.165274:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 10 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.165281:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187584:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.165303:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.165312:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 31 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.165319:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187712:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.165336:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.167285:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466116864 00000100:00100000:3.0:1746147265.167295:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466116864 00002000:00100000:3.0:1746147265.167524:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2543616->3145727) req@ffff8800a5ba0000 x1830967466116864/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.167533:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0000 with x1830967466116864 ext(2543616->3145727) 00010000:00010000:3.0:1746147265.167542:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.167553:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 29 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:3.0:1746147265.167560:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba0000 00000100:00100000:3.0:1746147265.167707:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2687 00000100:00100000:3.0:1746147265.167841:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967466116864:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147265.168361:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467187200:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147265.168390:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ac4400/0xb4b2209fbdad33c9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfed expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.168400:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ac4400/0xb4b2209fbdad33c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfed expref: 25 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.168414:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ac4400, rc 0) 00000100:00100000:0.0:1746147265.168452:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1958:x1830967466116608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4138us (4934us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147265.168459:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16464 00000100:00100000:0.0:1746147265.172144:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.172223:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c85e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187328:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.172231:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187456:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.172238:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187584:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.172330:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466117248 00000100:00100000:1.0:1746147265.172340:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466117248 00000100:00100000:1.0:1746147265.172400:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11650 00000100:00100000:1.0:1746147265.172407:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32354:x1830967466117248:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147265.172427:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.172445:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdad33d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949edffb expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.173567:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.173582:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.173588:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.173593:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147265.173624:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.173634:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 16 pid: 14049 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.173645:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467187840:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.173730:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.173736:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 8 pid: 14049 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.173745:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467187968:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.173761:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.175973:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.176031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.176074:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466117376 00000100:00100000:0.0:1746147265.176082:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466117376 00010000:00010000:0.0:1746147265.176110:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 54 pid: 11147 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.176126:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466117504 00000100:00100000:2.0:1746147265.176133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.176133:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466117504 00000100:00100000:0.0:1746147265.176136:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8437 00000100:00100000:0.0:1746147265.176143:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+54:1957:x1830967466117376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.176155:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.176157:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 11 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.176172:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 54 pid: 11147 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.176178:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466117760 00000100:00100000:1.0:1746147265.176180:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466117760 00010000:00010000:0.0:1746147265.176183:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 54 pid: 11147 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.176191:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.176201:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093803600/0xb4b2209fbdad31df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edece expref: 54 pid: 11147 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.176213:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.176214:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8438 00000100:00100000:1.0:1746147265.176221:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466117504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147265.176224:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8439 00010000:00010000:1.0:1746147265.176231:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147265.176232:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967466117760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147265.176240:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.176246:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 11 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.176247:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967466117376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (571us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147265.176250:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.176254:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8437 00010000:00010000:1.0:1746147265.176255:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 11 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:2.0:1746147265.176264:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.176294:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467187712:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.176500:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dce00/0xb4b2209fbdad33bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfdf expref: 11 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:1.0:1746147265.176516:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.176543:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1957:x1830967466117504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 322us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.176550:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8438 00010000:00010000:2.0:1746147265.176724:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7bf400/0xb4b2209fbdad32bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf4c expref: 32 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.176735:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147265.176753:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1959:x1830967466117760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 523us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.176759:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8439 00010000:00010000:0.0:1746147265.176849:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [3145728->3510271] (req 3145728->3510271) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 52 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.176861:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8515600, rc 0) 00000100:00100000:0.0:1746147265.176885:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+52:32348:x1830967466116992:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11802us (11860us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.176890:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16465 00000100:00100000:0.0:1746147265.176955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.177004:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467187840:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.177016:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967467187968:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.177038:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147265.177045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.177101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.177117:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466117632 00000100:00100000:0.0:1746147265.177121:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466117632 00010000:00010000:0.0:1746147265.177133:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 52 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.177152:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466117888 00000100:00100000:0.0:1746147265.177154:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466117888 00010000:00010000:0.0:1746147265.177163:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 17 pid: 14049 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.177173:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466118016 00000100:00100000:0.0:1746147265.177175:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466118016 00010000:00010000:0.0:1746147265.177182:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 9 pid: 14049 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.177191:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8440 00000100:00100000:0.0:1746147265.177196:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1956:x1830967466117632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.177204:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.177214:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 52 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177221:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 52 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177232:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fb8600/0xb4b2209fbdad32c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf53 expref: 52 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177241:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.177242:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.177247:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 51 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.177259:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 51 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.177281:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 51 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.177291:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467188096:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147265.177335:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.177349:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8441 00000100:00100000:0.0:1746147265.177355:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+17:1957:x1830967466117888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.177361:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.177366:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 17 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177373:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 17 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177383:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093802e00/0xb4b2209fbdad3391 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfbc expref: 17 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177394:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.177398:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.177404:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.177409:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.177421:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466117888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.177426:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8441 00000100:00100000:0.0:1746147265.177436:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8442 00000100:00100000:0.0:1746147265.177440:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466118016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.177446:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.177449:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 9 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177456:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 9 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177465:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bf9200/0xb4b2209fbdad3375 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfb5 expref: 9 pid: 14049 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.177472:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.177474:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.177479:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.177484:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.177497:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.177509:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967466118016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.177515:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8442 00010000:00010000:0.0:1746147265.177570:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.177575:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147265.177589:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:0.0:1746147265.177688:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdad33d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edffb expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.177697:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edffb expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.177702:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.177705:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147265.177706:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1600, rc 0) 00000100:00100000:0.0:1746147265.177724:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32354:x1830967466117248:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 5319us (5590us total) trans 8589945705 rc 0/0 00000100:00100000:0.0:1746147265.177729:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11650 00000100:00100000:0.0:1746147265.179671:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467188096:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147265.179702:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.179736:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466117632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2538us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.179743:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8440 00000100:00100000:0.0:1746147265.179829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.179872:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466118272 00000100:00100000:0.0:1746147265.179877:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466118272 00000100:00100000:0.0:1746147265.179901:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11651 00000100:00100000:0.0:1746147265.179906:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32354:x1830967466118272:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147265.179923:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.179925:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147265.180003:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad33de lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edffb expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.180014:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.180017:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147265.180025:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdad33ec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee002 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.180101:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180184:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180191:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180201:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180206:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180210:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180216:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b3b6c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.180219:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180224:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180230:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.180232:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147265.180235:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180239:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad33f3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147265.180260:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdad33ec lrc: 1/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee002 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.180266:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdad33ec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee002 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.180272:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6400, rc 0) 00000100:00100000:0.0:1746147265.180292:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32354:x1830967466118272:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 386us (464us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147265.180298:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11651 00000100:00100000:0.0:1746147265.180331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.180447:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466118528 00000100:00100000:2.0:1746147265.180455:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466118528 00002000:00100000:2.0:1746147265.180489:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1880063) req@ffff88009f669500 x1830967466118528/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.180500:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669500 with x1830967466118528 ext(1048576->1880063) 00002000:00010000:2.0:1746147265.180504:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669500 00000100:00100000:2.0:1746147265.180527:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7877 00000100:00100000:2.0:1746147265.180533:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466118528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147265.182188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.183006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.183137:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466118784 00000100:00100000:2.0:1746147265.183146:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466118784 00002000:00100000:2.0:1746147265.183180:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (1417216->2097151) req@ffff88009f668a80 x1830967466118784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.183188:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668a80 with x1830967466118784 ext(1417216->2097151) 00002000:00010000:2.0:1746147265.183193:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f668a80 00000100:00100000:2.0:1746147265.183220:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466119040 00000100:00100000:2.0:1746147265.183223:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466119040 00002000:00100000:2.0:1746147265.183245:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3506176->3510271) req@ffff88009f66aa00 x1830967466119040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.183252:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66aa00 with x1830967466119040 ext(3506176->3510271) 00002000:00010000:2.0:1746147265.183255:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66aa00 00000100:00100000:2.0:1746147265.183276:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7878 00000100:00100000:2.0:1746147265.183283:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1959:x1830967466118784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.183336:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7879 00000100:00100000:1.0:1746147265.183343:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466119040:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147265.183463:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466119040:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 120us (458us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147265.183469:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7879 00002000:00100000:1.0:1746147265.183474:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x426:0x0] (3506176->3510271) req@ffff88009f66aa00 x1830967466119040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.183479:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66aa00 with x1830967466119040 ext(3506176->3510271) 00002000:00010000:1.0:1746147265.183482:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66aa00 00000100:00100000:1.0:1746147265.184174:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967466116864:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 16458us (19707us total) trans 21474841535 rc 0/0 00000100:00100000:1.0:1746147265.184181:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2687 00002000:00100000:1.0:1746147265.184186:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x422:0x0] (2543616->3145727) req@ffff8800a5ba0000 x1830967466116864/t21474841535(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.184193:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0000 with x1830967466116864 ext(2543616->3145727) 00010000:00010000:1.0:1746147265.184200:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.184214:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.184221:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba0000 00000100:00100000:0.0:1746147265.185476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.185532:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466119296 00000100:00100000:3.0:1746147265.185539:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466119296 00000100:00100000:3.0:1746147265.185574:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4919 00000100:00100000:3.0:1746147265.185580:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:32354:x1830967466119296:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147265.185753:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32354:x1830967466119296:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 173us (282us total) trans 8589945706 rc 0/0 00000100:00100000:3.0:1746147265.185759:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4919 00000100:00100000:2.0:1746147265.190379:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+26:1959:x1830967466118528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9836us (10037us total) trans 0 rc 831488/831488 00000100:00100000:2.0:1746147265.190393:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7877 00002000:00100000:2.0:1746147265.190406:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->1880063) req@ffff88009f669500 x1830967466118528/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.190416:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669500 with x1830967466118528 ext(1048576->1880063) 00002000:00010000:2.0:1746147265.190423:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669500 00000100:00100000:1.0:1746147265.191033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.191088:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466119424 00000100:00100000:2.0:1746147265.191096:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466119424 00000100:00100000:1.0:1746147265.191101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147265.191123:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:2.0:1746147265.191299:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8443 00000100:00100000:2.0:1746147265.191305:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967466119424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147265.191318:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147265.191338:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.191673:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1959:x1830967466118784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8389us (9486us total) trans 0 rc 679936/679936 00000100:00100000:3.0:1746147265.191681:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7878 00002000:00100000:3.0:1746147265.191687:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1417216->2097151) req@ffff88009f668a80 x1830967466118784/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 679936/679936 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.191695:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668a80 with x1830967466118784 ext(1417216->2097151) 00002000:00010000:3.0:1746147265.191699:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f668a80 00000100:00100000:3.0:1746147265.191721:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466119808 00000100:00100000:3.0:1746147265.191724:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466119808 00010000:00010000:2.0:1746147265.191784:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.191807:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093802400/0xb4b2209fbdad3352 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa7 expref: 31 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.191826:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.191828:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.191835:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.191843:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.191879:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.191891:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e976a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467188224:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147265.191974:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b6c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.192335:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4920 00000100:00100000:3.0:1746147265.192341:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:32348:x1830967466119808:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147265.192886:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32348:x1830967466119808:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 544us (1784us total) trans 8589945707 rc 0/0 00000100:00100000:3.0:1746147265.192893:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4920 00000100:00100000:3.0:1746147265.193993:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e976a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467188224:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147265.194013:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.194330:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967466119424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2764us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.194340:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8443 00000100:00100000:2.0:1746147265.194967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.194995:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466120064 00000100:00100000:2.0:1746147265.195001:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466120064 00002000:00100000:2.0:1746147265.195036:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2486272->2490367) req@ffff88008e975880 x1830967466120064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.195044:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975880 with x1830967466120064 ext(2486272->2490367) 00002000:00010000:2.0:1746147265.195049:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e975880 00000100:00100000:2.0:1746147265.195077:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7880 00000100:00100000:2.0:1746147265.195083:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466120064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.195218:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1957:x1830967466120064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 134us (255us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147265.195223:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7880 00002000:00100000:2.0:1746147265.195228:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2486272->2490367) req@ffff88008e975880 x1830967466120064/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.195235:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975880 with x1830967466120064 ext(2486272->2490367) 00002000:00010000:2.0:1746147265.195237:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e975880 00000100:00100000:1.0:1746147265.205465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.205500:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466120192 00000100:00100000:1.0:1746147265.205509:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466120192 00000100:00100000:1.0:1746147265.205553:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16466 00000100:00100000:1.0:1746147265.205561:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+31:32357:x1830967466120192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.205580:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.205598:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee009 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.205629:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 50 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.205635:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.205637:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.205641:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.205670:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 50 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.205687:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 50 pid: 17548 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.205700:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467188352:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.207766:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.208689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.208741:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466120448 00000100:00100000:3.0:1746147265.208750:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466120448 00002000:00100000:3.0:1746147265.208794:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2711552->2715647) req@ffff88008e976680 x1830967466120448/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.208804:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967466120448 ext(2711552->2715647) 00002000:00010000:3.0:1746147265.208809:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:3.0:1746147265.208827:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7881 00000100:00100000:3.0:1746147265.208835:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466120448:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.210011:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467188352:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.210039:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.210067:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d57800, rc 0) 00000100:00100000:1.0:1746147265.210108:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:32357:x1830967466120192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4547us (4654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.210115:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16466 00000100:00100000:3.0:1746147265.210243:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+24:1956:x1830967466120448:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1408us (1557us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147265.210250:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7881 00002000:00100000:3.0:1746147265.210255:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x422:0x0] (2711552->2715647) req@ffff88008e976680 x1830967466120448/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.210263:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967466120448 ext(2711552->2715647) 00002000:00010000:3.0:1746147265.210268:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:1.0:1746147265.210793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.210834:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466120576 00000100:00100000:3.0:1746147265.210841:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466120576 00002000:00100000:3.0:1746147265.210866:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3510271) req@ffff88012d499500 x1830967466120576/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.210874:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499500 with x1830967466120576 ext(3145728->3510271) 00010000:00010000:3.0:1746147265.210880:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 51 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.210896:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 51 pid: 17548 timeout: 752 lvb_type: 0 00002000:00010000:3.0:1746147265.210902:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d499500 00000100:00100000:3.0:1746147265.211305:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2688 00000100:00100000:3.0:1746147265.211313:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967466120576:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147265.220333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.221854:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967466120576:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 10537us (11057us total) trans 17179874200 rc 0/0 00000100:00100000:3.0:1746147265.221867:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2688 00002000:00100000:3.0:1746147265.221879:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3145728->3510271) req@ffff88012d499500 x1830967466120576/t17179874200(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.221889:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499500 with x1830967466120576 ext(3145728->3510271) 00010000:00010000:3.0:1746147265.221899:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.221913:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 752 lvb_type: 0 00002000:00010000:3.0:1746147265.221921:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d499500 00000100:00100000:3.0:1746147265.221975:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466120832 00000100:00100000:3.0:1746147265.221983:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466120832 00000100:00100000:3.0:1746147265.222014:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4921 00000100:00100000:3.0:1746147265.222020:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+16:32352:x1830967466120832:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147265.223289:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32352:x1830967466120832:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1266us (2960us total) trans 8589945708 rc 0/0 00000100:00100000:3.0:1746147265.223296:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4921 00000001:00080000:3.0:1746147265.224187:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841525 is committed 00000001:00080000:3.0:1746147265.224241:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841516 is committed 00000001:00080000:3.0:1746147265.224248:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841515 is committed 00000001:00080000:3.0:1746147265.224330:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841534 is committed 00000001:00080000:3.0:1746147265.224428:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841471 is committed 00000001:00080000:3.0:1746147265.224457:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841531 is committed 00000001:00080000:3.0:1746147265.224525:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841473 is committed 00000001:00080000:3.0:1746147265.224562:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841532 is committed 00000100:00100000:0.0:1746147265.227458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.227586:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466120960 00000100:00100000:3.0:1746147265.227596:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466120960 00010000:00010000:3.0:1746147265.227628:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.227687:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8444 00000100:00100000:3.0:1746147265.227694:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1958:x1830967466120960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.227708:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.227728:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.227739:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.227765:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8515600/0xb4b2209fbdad33d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edff4 expref: 53 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.227776:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.227777:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.227784:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.227790:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.227821:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.227833:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467188480:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147265.228328:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.229932:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467188480:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147265.229977:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.230015:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1958:x1830967466120960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2321us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.230024:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8444 00000100:00100000:0.0:1746147265.230850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.230930:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466121216 00000100:00100000:2.0:1746147265.230961:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466121216 00000100:00100000:2.0:1746147265.230998:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11652 00000100:00100000:2.0:1746147265.231004:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136952850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+311:32363:x1830967466121216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147265.231028:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.231045:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63a800/0xb4b2209fbdad3401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee010 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.231166:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231210:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231222:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231236:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231242:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231247:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231354:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231361:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231367:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147265.231379:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:2.0:1746147265.231458:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231465:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231470:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231476:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4b97e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147265.231480:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231485:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231495:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147265.231497:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147265.231500:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231505:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b97e00/0xb4b2209fbdad3408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231514:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231519:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231523:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231530:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094840400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147265.231532:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231536:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231540:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f3f6100) 00010000:00010000:2.0:1746147265.231541:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147265.231543:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231547:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094840400/0xb4b2209fbdad340f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.231579:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d63a800/0xb4b2209fbdad3401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 314 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.231589:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 313 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.231594:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147265.231596:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147265.231598:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094841400, rc 0) 00000100:00100000:2.0:1746147265.231644:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136952850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32363:x1830967466121216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 640us (797us total) trans 8589945709 rc 0/0 00000100:00100000:2.0:1746147265.231650:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11652 00000100:00100000:0.0:1746147265.235641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.235678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.235706:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466121472 00000100:00100000:1.0:1746147265.235715:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466121472 00000100:00100000:1.0:1746147265.235759:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16467 00000100:00100000:1.0:1746147265.235766:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967466121472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.235784:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.235804:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad3424 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee017 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.235857:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467188608:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147265.235932:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.236171:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.236187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.236202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.236837:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466121728 00000100:00100000:1.0:1746147265.236842:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466121728 00000100:00100000:1.0:1746147265.236859:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466121984 00000100:00100000:1.0:1746147265.236861:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466121984 00000100:00100000:1.0:1746147265.236877:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16468 00000100:00100000:1.0:1746147265.236882:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967466121728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.236890:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.236899:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad342b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee01e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.236925:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467188736:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147265.236976:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.236990:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16469 00000100:00100000:1.0:1746147265.236995:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1956:x1830967466121984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.237002:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.237011:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee025 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.237023:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.237025:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.237033:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 53 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.237046:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 53 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.237070:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b204c00, rc 0) 00000100:00100000:1.0:1746147265.237091:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1956:x1830967466121984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 96us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.237097:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16469 00000100:00100000:2.0:1746147265.238833:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466121600 00000100:00100000:0.0:1746147265.238840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.238841:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466121600 00000100:00100000:0.0:1746147265.238871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147265.238877:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009f668e00 x1830967466121600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147265.238885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147265.238887:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668e00 with x1830967466121600 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.238891:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f668e00 00000100:00100000:2.0:1746147265.238910:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466122112 00000100:00100000:2.0:1746147265.238913:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466122112 00002000:00100000:2.0:1746147265.238925:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009f66b100 x1830967466122112/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.238931:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b100 with x1830967466122112 ext(3145728->4194303) 00002000:00010000:2.0:1746147265.238934:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66b100 00000100:00100000:2.0:1746147265.238957:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466122496 00000100:00100000:2.0:1746147265.238959:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466122496 00002000:00100000:2.0:1746147265.238971:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3375103) req@ffff88009f66bb80 x1830967466122496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 504/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.238977:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66bb80 with x1830967466122496 ext(2097152->3375103) 00002000:00010000:2.0:1746147265.238980:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66bb80 00000100:00100000:2.0:1746147265.238988:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466122752 00000100:00100000:2.0:1746147265.238990:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466122752 00002000:00100000:2.0:1746147265.238998:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3375104->4194303) req@ffff88009f66ad80 x1830967466122752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746147265.238999:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime: 1746147264 -> 1746147265 00002000:00010000:0.0:1746147265.239002:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime: 1746147264 -> 1746147265 00002000:00100000:2.0:1746147265.239004:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66ad80 with x1830967466122752 ext(3375104->4194303) 00002000:00010000:0.0:1746147265.239005:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime: 1746147264 -> 1746147265 00002000:00010000:2.0:1746147265.239007:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66ad80 00000100:00100000:2.0:1746147265.239016:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7882 00002000:00010000:0.0:1746147265.239021:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2077 -> 2081 00000100:00100000:2.0:1746147265.239022:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967466121600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147265.239027:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467188736:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147265.239064:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad342b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee01e expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.239074:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b205e00/0xb4b2209fbdad342b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee01e expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.239083:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205e00, rc 0) 00000100:00100000:0.0:1746147265.239113:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967466121728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2230us (2941us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147265.239118:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16468 00000100:00100000:0.0:1746147265.239134:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466122240 00000100:00100000:0.0:1746147265.239136:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466122240 00000100:00100000:0.0:1746147265.239151:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16470 00000100:00100000:0.0:1746147265.239155:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967466122240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147265.239164:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.239175:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ed2200/0xb4b2209fbdad3439 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee02c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.239203:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467188864:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147265.239242:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.239328:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7883 00000100:00100000:3.0:1746147265.239334:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1958:x1830967466122112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.240267:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7884 00000100:00100000:2.0:1746147265.240275:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967466122496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.241746:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7885 00000100:00100000:2.0:1746147265.241755:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967466122752:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:1.0:1746147265.244313:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime: 1746147264 -> 1746147265 00002000:00010000:1.0:1746147265.244320:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime: 1746147264 -> 1746147265 00002000:00010000:1.0:1746147265.244322:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime: 1746147264 -> 1746147265 00000100:00100000:1.0:1746147265.244344:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467188608:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147265.244377:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad3424 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee017 expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.244391:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d57c00/0xb4b2209fbdad3424 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee017 expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.244419:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d57c00, rc 0) 00000100:00100000:1.0:1746147265.246344:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967466121472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10568us (10702us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147265.246355:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16467 00002000:00010000:0.0:1746147265.249891:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime: 1746147264 -> 1746147265 00002000:00010000:0.0:1746147265.249898:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime: 1746147264 -> 1746147265 00002000:00010000:0.0:1746147265.249900:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime: 1746147264 -> 1746147265 00000100:00100000:0.0:1746147265.249921:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467188864:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147265.249975:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ed2200/0xb4b2209fbdad3439 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee02c expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.249988:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ed2200/0xb4b2209fbdad3439 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee02c expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.249999:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ed2200, rc 0) 00000100:00100000:0.0:1746147265.250048:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967466122240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10891us (11209us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147265.250065:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16470 00000100:00100000:2.0:1746147265.255208:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+34:1958:x1830967466121600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16174us (19515us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.255220:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7882 00002000:00100000:2.0:1746147265.255232:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88009f668e00 x1830967466121600/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.255241:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668e00 with x1830967466121600 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.255248:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f668e00 00000100:00100000:3.0:1746147265.259146:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1958:x1830967466122112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19801us (22932us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.259158:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7883 00002000:00100000:3.0:1746147265.259181:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88009f66b100 x1830967466122112/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.259190:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b100 with x1830967466122112 ext(3145728->4194303) 00002000:00010000:3.0:1746147265.259196:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f66b100 00000100:00100000:3.0:1746147265.261111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.261255:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466122880 00000100:00100000:1.0:1746147265.261265:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466122880 00000100:00100000:1.0:1746147265.261308:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16471 00000100:00100000:1.0:1746147265.261315:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:32363:x1830967466122880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.261334:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.261351:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee033 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.261381:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.261389:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.261391:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.261394:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.261425:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.261437:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 11 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.261449:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467188992:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.261529:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.262044:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967466122496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21769us (23171us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.262063:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7884 00002000:00100000:2.0:1746147265.262072:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3375103) req@ffff88009f66bb80 x1830967466122496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 504/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.262081:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66bb80 with x1830967466122496 ext(2097152->3375103) 00002000:00010000:2.0:1746147265.262086:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66bb80 00000100:00100000:1.0:1746147265.262730:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967466122752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20969us (23836us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746147265.262740:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7885 00002000:00100000:1.0:1746147265.262751:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (3375104->4194303) req@ffff88009f66ad80 x1830967466122752/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.262759:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66ad80 with x1830967466122752 ext(3375104->4194303) 00002000:00010000:1.0:1746147265.262764:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66ad80 00000100:00100000:1.0:1746147265.263977:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467188992:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.264001:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.264014:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205a00, rc 0) 00000100:00100000:1.0:1746147265.264064:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32363:x1830967466122880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2748us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.264070:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16471 00000100:00100000:3.0:1746147265.266356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.266464:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466123008 00000100:00100000:1.0:1746147265.266473:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466123008 00002000:00100000:1.0:1746147265.266514:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1880064->2097151) req@ffff88012b0c1c00 x1830967466123008/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.266523:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1c00 with x1830967466123008 ext(1880064->2097151) 00010000:00010000:1.0:1746147265.266531:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 8 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.266544:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 8 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.266551:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b0c1c00 00000100:00100000:1.0:1746147265.266689:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2689 00000100:00100000:1.0:1746147265.266698:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967466123008:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147265.271526:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1956:x1830967466123008:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4823us (5172us total) trans 21474841536 rc 0/0 00000100:00100000:1.0:1746147265.271536:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2689 00002000:00100000:1.0:1746147265.271546:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x420:0x0] (1880064->2097151) req@ffff88012b0c1c00 x1830967466123008/t21474841536(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.271554:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1c00 with x1830967466123008 ext(1880064->2097151) 00010000:00010000:1.0:1746147265.271562:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 10 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.271574:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 10 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.271580:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b0c1c00 00000100:00100000:3.0:1746147265.271724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.271814:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466123136 00000100:00100000:1.0:1746147265.271822:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466123136 00000100:00100000:1.0:1746147265.271869:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16472 00000100:00100000:1.0:1746147265.271876:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967466123136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.271892:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.271909:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b205200/0xb4b2209fbdad3447 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee03a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.271999:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467189120:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147265.272087:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.274797:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467189120:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147265.274826:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b205200/0xb4b2209fbdad3447 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee03a expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.274835:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b205200/0xb4b2209fbdad3447 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee03a expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.274858:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b205200, rc 0) 00000100:00100000:1.0:1746147265.274890:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967466123136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3015us (3171us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147265.274896:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16472 00000100:00100000:0.0:1746147265.275923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.275985:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466123264 00000100:00100000:3.0:1746147265.275990:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466123264 00010000:00010000:3.0:1746147265.276012:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 10 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.276031:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8445 00000100:00100000:3.0:1746147265.276035:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967466123264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.276044:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.276063:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 10 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.276072:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 10 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.276093:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bbb800/0xb4b2209fbdad32b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf45 expref: 10 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.276123:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.276125:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.276133:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.276141:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.276212:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.276223:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467189248:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147265.276291:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.277284:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467189248:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147265.277299:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.277316:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967466123264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1280us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.277320:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8445 00000100:00100000:0.0:1746147265.278015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.278130:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466123520 00000100:00100000:1.0:1746147265.278136:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466123520 00002000:00100000:1.0:1746147265.278169:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85d500 x1830967466123520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.278179:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85d500 with x1830967466123520 ext(4194304->4976639) 00002000:00010000:1.0:1746147265.278184:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85d500 00000100:00100000:1.0:1746147265.278213:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7886 00000100:00100000:1.0:1746147265.278220:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967466123520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147265.279292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.279347:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466123776 00000100:00100000:2.0:1746147265.279352:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466123776 00002000:00100000:2.0:1746147265.279378:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012c85dc00 x1830967466123776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.279385:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85dc00 with x1830967466123776 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.279389:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85dc00 00000100:00100000:2.0:1746147265.279420:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7887 00000100:00100000:2.0:1746147265.279427:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967466123776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.285901:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1956:x1830967466123520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7672us (7876us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746147265.285911:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7886 00002000:00100000:1.0:1746147265.285922:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012c85d500 x1830967466123520/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.285929:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85d500 with x1830967466123520 ext(4194304->4976639) 00002000:00010000:1.0:1746147265.285934:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c85d500 00000100:00100000:2.0:1746147265.287385:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967466123776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7953us (8091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.287393:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7887 00002000:00100000:2.0:1746147265.287400:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88012c85dc00 x1830967466123776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.287408:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c85dc00 with x1830967466123776 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.287412:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c85dc00 00000100:00100000:0.0:1746147265.291932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.292091:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466123904 00000100:00100000:1.0:1746147265.292101:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466123904 00000100:00100000:1.0:1746147265.292163:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16473 00000100:00100000:1.0:1746147265.292171:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1957:x1830967466123904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.292191:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.292208:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee041 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.292232:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.292234:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.292242:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.292257:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.292269:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537f000, rc 0) 00000100:00100000:1.0:1746147265.292316:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1957:x1830967466123904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 146us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.292322:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16473 00000100:00100000:0.0:1746147265.298206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.298752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.298930:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124288 00000100:00100000:1.0:1746147265.298967:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124288 00000100:00100000:3.0:1746147265.299014:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124160 00000100:00100000:3.0:1746147265.299018:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124160 00000100:00100000:1.0:1746147265.299024:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16474 00000100:00100000:1.0:1746147265.299032:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32363:x1830967466124288:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147265.299045:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4922 00000100:00100000:3.0:1746147265.299062:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+17:32357:x1830967466124160:12345-192.168.203.36@tcp:35:cat.0 00010000:00010000:1.0:1746147265.299065:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.299082:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee048 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.299108:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.299121:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.299122:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.299126:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.299157:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.299169:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 9 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.299182:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467189376:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.299251:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32357:x1830967466124160:12345-192.168.203.36@tcp:35:cat.0 Request processed in 200us (1053us total) trans 8589945710 rc 0/0 00000100:00100000:3.0:1746147265.299260:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4922 00000100:00100000:1.0:1746147265.299263:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.300095:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.300159:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124416 00000100:00100000:0.0:1746147265.300164:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124416 00000100:00100000:0.0:1746147265.300203:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11653 00000100:00100000:0.0:1746147265.300209:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:32365:x1830967466124416:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147265.300221:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.300233:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e000/0xb4b2209fbdad345c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee04f expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.300278:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300288:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300298:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300310:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300316:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300321:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300425:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300433:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300439:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147265.300467:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000004:00200000:0.0:1746147265.300471:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147265.300485:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300493:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300499:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300504:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300509:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300515:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f72f600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.300518:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300525:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300534:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:0.0:1746147265.300537:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147265.300541:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300545:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72f600/0xb4b2209fbdad3463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300575:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300582:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300586:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300590:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f72ea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147265.300592:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300601:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300607:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db13b00) 00010000:00010000:0.0:1746147265.300609:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147265.300611:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300616:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdad346a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.300640:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e000/0xb4b2209fbdad345c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.300649:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.300656:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:0.0:1746147265.300658:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147265.300660:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72e600, rc 0) 00000100:00100000:0.0:1746147265.300700:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32365:x1830967466124416:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 491us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.300707:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11653 00000100:00100000:1.0:1746147265.301279:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467189376:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.301302:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.301315:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537f600, rc 0) 00000100:00100000:1.0:1746147265.301338:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:32363:x1830967466124288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2307us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.301344:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16474 00000100:00100000:2.0:1746147265.303006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.303164:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124544 00000100:00100000:0.0:1746147265.303171:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124544 00000100:00100000:2.0:1746147265.303204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:0.0:1746147265.303208:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1417215) req@ffff88008e976a00 x1830967466124544/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.303217:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967466124544 ext(1048576->1417215) 00010000:00010000:0.0:1746147265.303229:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 10 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.303240:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 10 pid: 17530 timeout: 752 lvb_type: 0 00002000:00010000:0.0:1746147265.303247:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e976a00 00000100:00100000:2.0:1746147265.303455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.303483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.303589:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2690 00000100:00100000:0.0:1746147265.303596:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967466124544:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147265.303692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.303857:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124672 00000100:00100000:3.0:1746147265.303862:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124672 00000100:00100000:3.0:1746147265.303887:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124800 00000100:00100000:3.0:1746147265.303889:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124800 00000100:00100000:3.0:1746147265.303904:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16475 00000100:00100000:3.0:1746147265.303908:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967466124672:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147265.303917:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.303929:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee056 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.303964:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466124928 00000100:00100000:2.0:1746147265.303967:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466124928 00000100:00100000:2.0:1746147265.303984:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466125056 00000100:00100000:2.0:1746147265.303985:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466125056 00000100:00100000:2.0:1746147265.303996:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16476 00000100:00100000:2.0:1746147265.304000:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466124800:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147265.304006:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.304013:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b86800/0xb4b2209fbdad347f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee05d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.304067:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467189504:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147265.304121:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.304188:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16477 00000100:00100000:1.0:1746147265.304195:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466124928:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147265.304207:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147265.304210:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16478 00000100:00100000:2.0:1746147265.304215:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466125056:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147265.304217:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee064 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.304221:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.304226:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d63a800/0xb4b2209fbdad348d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee06b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.304230:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.304232:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.304239:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147265.304247:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467189632:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147265.304250:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.304258:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f865000, rc 0) 00000100:00100000:2.0:1746147265.304269:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.304275:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466124928:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 82us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.304281:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16477 00010000:00010000:3.0:1746147265.304338:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.304340:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.304345:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.304355:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.304361:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f5400, rc 0) 00000100:00100000:3.0:1746147265.304404:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466124672:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 494us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.304409:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16475 00000100:00100000:0.0:1746147265.307435:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467189504:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147265.307438:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467189632:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147265.307471:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b86800/0xb4b2209fbdad347f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee05d expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.307472:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d63a800/0xb4b2209fbdad348d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee06b expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.307487:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b86800/0xb4b2209fbdad347f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee05d expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.307501:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b86800, rc 0) 00010000:00010000:3.0:1746147265.307507:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d63a800/0xb4b2209fbdad348d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee06b expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147265.307546:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1959:x1830967466124800:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3543us (4089us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147265.307557:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16476 00010000:00010000:3.0:1746147265.307594:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d63a800, rc 0) 00000100:00100000:3.0:1746147265.307664:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1959:x1830967466125056:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3447us (3971us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147265.308039:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16478 00000100:00100000:2.0:1746147265.310159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.310210:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466125312 00000100:00100000:1.0:1746147265.310217:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466125312 00000100:00100000:1.0:1746147265.310252:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11654 00000100:00100000:1.0:1746147265.310257:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:32365:x1830967466125312:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147265.310272:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.310286:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad3494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee072 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.310513:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.310527:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 312 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.310537:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.310543:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.310579:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.310590:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 10 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.310601:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467189760:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.310693:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 312 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.310702:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 312 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.310708:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467189888:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.310728:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.311806:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1958:x1830967466124544:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8208us (8800us total) trans 21474841537 rc 0/0 00000100:00100000:0.0:1746147265.311820:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2690 00002000:00100000:0.0:1746147265.311829:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->1417215) req@ffff88008e976a00 x1830967466124544/t21474841537(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.311838:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967466124544 ext(1048576->1417215) 00010000:00010000:0.0:1746147265.311846:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.311857:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00002000:00010000:0.0:1746147265.311863:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e976a00 00000100:00100000:1.0:1746147265.312690:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467189760:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.312696:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467189888:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.312713:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147265.313064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.313283:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466125568 00000100:00100000:3.0:1746147265.313291:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466125568 00010000:00010000:3.0:1746147265.313317:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 313 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.313356:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8446 00000100:00100000:3.0:1746147265.313363:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1956:x1830967466125568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.313375:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.313380:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 313 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.313390:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 313 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.313408:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094841400/0xb4b2209fbdad3416 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee010 expref: 313 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.313422:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147265.313426:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147265.313433:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147265.313438:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.313477:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1956:x1830967466125568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.313482:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8446 00000100:00100000:0.0:1746147265.313542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.313634:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466125440 00000100:00100000:1.0:1746147265.313638:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466125440 00010000:00010000:1.0:1746147265.313652:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 11 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.313668:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8447 00000100:00100000:1.0:1746147265.313671:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466125440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.313677:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.313679:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 11 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.313686:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 11 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.313696:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72e600/0xb4b2209fbdad3471 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee04f expref: 11 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.313710:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.313713:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.313719:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.313724:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.313740:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.313756:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466125440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.313763:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8447 00010000:00010000:1.0:1746147265.313778:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.313783:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147265.313799:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147265.313924:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864200/0xb4b2209fbdad3494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee072 expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.313934:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee072 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.313965:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.313967:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147265.313970:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f865e00, rc 0) 00000100:00100000:1.0:1746147265.313993:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32365:x1830967466125312:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3735us (3841us total) trans 8589945711 rc 0/0 00000100:00100000:1.0:1746147265.313999:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11654 00000100:00100000:0.0:1746147265.315513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.315587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.315659:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466125952 00000100:00100000:1.0:1746147265.315664:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466125952 00000100:00100000:1.0:1746147265.315691:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11655 00000100:00100000:1.0:1746147265.315697:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32365:x1830967466125952:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147265.315716:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.315719:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147265.315734:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865e00/0xb4b2209fbdad349b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee072 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.315750:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.315753:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147265.315763:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864600/0xb4b2209fbdad34a9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee079 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.315835:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.315845:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.315852:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147265.315861:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00010000:00010000:1.0:1746147265.315958:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f864600/0xb4b2209fbdad34a9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.315969:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.315975:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.315977:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147265.315979:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f865200, rc 0) 00000100:00100000:1.0:1746147265.316009:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32365:x1830967466125952:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 313us (423us total) trans 8589945712 rc 0/0 00000100:00100000:1.0:1746147265.316014:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11655 00000100:00100000:3.0:1746147265.316130:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466125696 00000100:00100000:3.0:1746147265.316134:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466125696 00010000:00010000:3.0:1746147265.316152:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.316170:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8448 00000100:00100000:3.0:1746147265.316176:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967466125696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.316184:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.316201:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.316211:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.316225:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fb8a00/0xb4b2209fbdad32cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf5a expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.316236:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.316238:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.316245:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.316254:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.316292:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.316304:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467190016:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147265.316350:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.316886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.317752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.317778:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466126208 00000100:00100000:0.0:1746147265.317802:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466126208 00000100:00100000:2.0:1746147265.317805:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466126336 00000100:00100000:2.0:1746147265.317808:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466126336 00000100:00100000:2.0:1746147265.317836:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11656 00000100:00100000:2.0:1746147265.317841:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32365:x1830967466126336:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147265.317847:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11657 00010000:00010000:2.0:1746147265.317854:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147265.317861:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+312:32368:x1830967466126208:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147265.317865:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad34be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee087 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.317870:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.317876:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7bc00/0xb4b2209fbdad34c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee080 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.317899:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467190016:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147265.317903:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad34be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee087 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.317912:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad34be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee087 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.317919:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147265.317926:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147265.317928:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147265.317931:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1600, rc 0) 00000100:00100000:3.0:1746147265.317965:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967466125696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1788us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.317972:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8448 00000100:00100000:2.0:1746147265.317972:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32365:x1830967466126336:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 130us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.317977:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11656 00010000:00010000:0.0:1746147265.318028:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318049:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318068:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318085:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318089:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318092:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318165:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318170:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.318174:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147265.318189:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.318197:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 11 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.318207:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467190144:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.318262:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.319964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.320015:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466126592 00000100:00100000:2.0:1746147265.320023:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466126592 00002000:00100000:2.0:1746147265.320070:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5ba1180 x1830967466126592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.320079:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1180 with x1830967466126592 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.320084:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba1180 00000100:00100000:2.0:1746147265.320099:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7888 00000100:00100000:2.0:1746147265.320105:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967466126592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147265.320110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.320178:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466126720 00000100:00100000:3.0:1746147265.320182:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466126720 00010000:00010000:3.0:1746147265.320199:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 12 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.320200:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467190144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.320217:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8449 00010000:00010000:1.0:1746147265.320218:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147265.320221:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466126720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.320229:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.320233:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 12 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.320243:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 12 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.320562:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f865200/0xb4b2209fbdad34b0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee079 expref: 12 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.320578:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147265.320582:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147265.320592:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147265.320606:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147265.320629:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147265.320632:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320638:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147265.320650:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 9167008 00000100:00100000:3.0:1746147265.320671:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1959:x1830967466126720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 448us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.320676:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8449 00010000:00010000:1.0:1746147265.320743:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320754:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320759:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320765:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094060000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147265.320769:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320775:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320783:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.320786:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147265.320791:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 2/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320796:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094060000/0xb4b2209fbdad34da lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320816:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320821:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320825:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320829:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094061e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147265.320831:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320835:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320842:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147265.320844:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147265.320847:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320851:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdad34cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320859:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320863:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320868:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320872:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094060800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147265.320875:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320880:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320885:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98fa00) 00010000:00010000:1.0:1746147265.320887:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147265.320889:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320892:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094060800/0xb4b2209fbdad34d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.320930:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7bc00/0xb4b2209fbdad34c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee080 expref: 314 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.320950:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7bc00/0xb4b2209fbdad34c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee080 expref: 314 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.320958:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7bc00, rc 0) 00000100:00100000:1.0:1746147265.320980:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32368:x1830967466126208:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3128us (4094us total) trans 8589945713 rc 301/301 00000100:00100000:1.0:1746147265.320986:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11657 00000100:00100000:0.0:1746147265.321706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.321965:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466126848 00000100:00100000:3.0:1746147265.321971:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466126848 00000100:00100000:3.0:1746147265.322049:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16479 00000100:00100000:3.0:1746147265.322082:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466126848:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147265.322142:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.322171:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.322179:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.322191:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 31 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.322204:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.322206:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.322209:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.322261:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 31 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.322283:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 31 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.322297:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467190272:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.322602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.322640:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127104 00000100:00100000:0.0:1746147265.322680:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127104 00000100:00100000:0.0:1746147265.322814:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16480 00000100:00100000:0.0:1746147265.322838:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967466127104:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147265.322872:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.322910:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.322931:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.322932:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.322934:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.323000:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.323015:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 17 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.323063:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467190400:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.323169:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.323271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.323371:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127360 00000100:00100000:2.0:1746147265.323376:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127360 00000100:00100000:2.0:1746147265.323402:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16481 00000100:00100000:2.0:1746147265.323407:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1957:x1830967466127360:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147265.323428:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.323440:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.323448:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.323455:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 52 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.323461:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.323463:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.323465:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.323469:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.323481:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 52 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.323489:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 52 pid: 4444 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.323493:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 12 pid: 4445 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.323499:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467190656:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.323501:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467190528:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147265.323528:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.323536:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 12 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.323544:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467190784:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147265.323563:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.323567:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.323574:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 752 lvb_type: 0 00000100:00100000:2.0:1746147265.323586:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467191040:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.323602:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147265.323612:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.323621:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467190912:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.324638:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.331755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.332121:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466126976 00000100:00100000:3.0:1746147265.332132:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466126976 00000100:00100000:3.0:1746147265.332172:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16482 00000100:00100000:3.0:1746147265.332180:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967466126976:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147265.332181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.332202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147265.332224:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.332242:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.332250:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.332256:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.332262:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.332264:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.332266:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.332302:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.332313:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 10 pid: 4445 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.332325:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467191168:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.332329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.332348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147265.332399:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 8 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.332406:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 8 pid: 17548 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.332414:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467191296:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147265.332445:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.332452:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 17 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.332459:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467191424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.332475:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4082600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.332492:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127744 00000100:00100000:3.0:1746147265.332494:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127744 00010000:00010000:3.0:1746147265.332513:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 53 pid: 4444 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.332529:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127616 00000100:00100000:3.0:1746147265.332531:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127616 00010000:00010000:3.0:1746147265.332540:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 32 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.332554:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8450 00000100:00100000:3.0:1746147265.332559:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1959:x1830967466127744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147265.332566:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127232 00010000:00010000:3.0:1746147265.332567:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147265.332568:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127488 00000100:00100000:2.0:1746147265.332569:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127232 00000100:00100000:0.0:1746147265.332572:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127488 00000100:00100000:2.0:1746147265.332588:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16483 00010000:00010000:3.0:1746147265.332589:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 53 pid: 4444 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.332593:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1957:x1830967466127232:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147265.332595:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16484 00010000:00010000:3.0:1746147265.332598:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 53 pid: 4444 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.332601:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466127488:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147265.332609:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.332616:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147265.332616:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.332618:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 53 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.332624:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.332627:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.332631:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.332634:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147265.332635:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746147265.332636:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1959:x1830967466127744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (308us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147265.332636:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.332637:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.332637:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.332640:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.332643:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8450 00010000:00010000:0.0:1746147265.332651:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.332655:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147265.332659:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8451 00000100:00100000:3.0:1746147265.332663:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967466127616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.332663:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 10 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.332667:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.332669:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147265.332671:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467191552:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.332674:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467191680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147265.332678:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 32 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.332689:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 32 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.332691:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00010000:00010000:3.0:1746147265.332699:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147265.332702:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147265.332709:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1959:x1830967466127616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (361us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147265.332710:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 13 pid: 4445 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.332714:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8451 00000100:00100000:2.0:1746147265.332718:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467191808:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147265.332740:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 52 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.332747:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 52 pid: 17530 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.332754:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467191936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.332770:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147265.332797:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b204c00/0xb4b2209fbdad3432 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee025 expref: 52 pid: 4444 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.332812:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467190656:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.332823:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467190784:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.332830:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967467191040:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147265.332851:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.333247:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967466126592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13141us (13309us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147265.333255:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7888 00002000:00100000:0.0:1746147265.333264:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff8800a5ba1180 x1830967466126592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.333274:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1180 with x1830967466126592 ext(1048576->2097151) 00010000:00010000:0.0:1746147265.333280:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.333288:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:0.0:1746147265.333307:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba1180 00000100:00100000:0.0:1746147265.333336:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467190400:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.333347:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333367:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ac00/0xb4b2209fbdad3161 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede81 expref: 31 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.333379:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467190272:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.333387:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467190528:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.333394:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967467190912:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.333412:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.333440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.333466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.333486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.333501:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128000 00000100:00100000:0.0:1746147265.333504:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128000 00010000:00010000:0.0:1746147265.333516:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 14 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.333530:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466127872 00000100:00100000:0.0:1746147265.333532:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466127872 00010000:00010000:0.0:1746147265.333539:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 15 pid: 4445 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.333549:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128128 00000100:00100000:0.0:1746147265.333550:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128128 00010000:00010000:0.0:1746147265.333558:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.333566:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8452 00000100:00100000:0.0:1746147265.333572:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+15:1956:x1830967466128000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.333579:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.333588:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 15 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333596:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 15 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333609:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f865000/0xb4b2209fbdad3486 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee064 expref: 15 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333619:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.333636:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+14:1956:x1830967466128000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.333642:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8452 00000100:00100000:0.0:1746147265.333658:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8453 00000100:00100000:0.0:1746147265.333662:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+13:1956:x1830967466127872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.333668:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.333676:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 13 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333683:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 13 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333700:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093802c00/0xb4b2209fbdad339f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfc3 expref: 13 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333714:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.333728:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1956:x1830967466127872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.333733:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8453 00000100:00100000:0.0:1746147265.333759:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8454 00000100:00100000:0.0:1746147265.333763:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1956:x1830967466128128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.333768:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.333775:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333781:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333790:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a477c000/0xb4b2209fbdad3130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede57 expref: 52 pid: 8480 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.333798:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.333799:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.333803:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333808:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333819:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.333831:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466128128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.333836:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8454 00010000:00010000:0.0:1746147265.333882:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333889:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333908:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333915:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333922:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333929:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3f4a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147265.333932:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333963:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333974:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.333979:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4a00/0xb4b2209fbdad34e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.334019:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1957:x1830967466126848:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 11953us (12315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.334026:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16479 00000100:00100000:1.0:1746147265.339318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.339379:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467191168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.339391:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467191296:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.339858:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128384 00000100:00100000:1.0:1746147265.339864:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128384 00010000:00010000:1.0:1746147265.339994:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 10 pid: 17548 timeout: 752 lvb_type: 1 00000100:00100000:1.0:1746147265.340125:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8455 00000100:00100000:1.0:1746147265.340133:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1959:x1830967466128384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.340146:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.340170:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 10 pid: 17548 timeout: 752 lvb_type: 1 00010000:00010000:1.0:1746147265.340181:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 10 pid: 17548 timeout: 752 lvb_type: 1 00010000:00010000:1.0:1746147265.340203:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5400/0xb4b2209fbdad3478 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee056 expref: 10 pid: 17548 timeout: 752 lvb_type: 1 00010000:00010000:1.0:1746147265.340216:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.340255:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1959:x1830967466128384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.340262:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8455 00000100:00100000:1.0:1746147265.340335:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.340375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.340778:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467191680:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.340779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.340812:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467191808:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.340821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.340822:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467191936:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.340835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147265.340847:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.340849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.340873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.340888:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128256 00000100:00100000:1.0:1746147265.340891:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128256 00010000:00010000:1.0:1746147265.340904:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00000100:00100000:1.0:1746147265.340919:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128640 00000100:00100000:1.0:1746147265.340921:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128640 00000100:00100000:0.0:1746147265.340922:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128896 00000100:00100000:0.0:1746147265.340925:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128896 00010000:00010000:1.0:1746147265.340930:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 31 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.340952:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.340964:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128768 00000100:00100000:0.0:1746147265.340966:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128768 00010000:00010000:0.0:1746147265.340975:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.340983:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466129024 00000100:00100000:0.0:1746147265.340985:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466129024 00010000:00010000:0.0:1746147265.340991:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.340997:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466129152 00000100:00100000:0.0:1746147265.340999:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466129152 00010000:00010000:0.0:1746147265.341006:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 51 pid: 17530 timeout: 752 lvb_type: 1 00000100:00100000:0.0:1746147265.341014:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8456 00000100:00100000:0.0:1746147265.341018:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1959:x1830967466128256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.341025:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.341044:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341061:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341073:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f000/0xb4b2209fbdad344e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee041 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341083:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.341104:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967466128256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.341109:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8456 00000100:00100000:0.0:1746147265.341118:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8457 00000100:00100000:0.0:1746147265.341122:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967466128896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.341128:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.341135:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.341142:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.341153:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.341155:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.341161:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b205a00/0xb4b2209fbdad3440 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee033 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.341165:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.341173:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.341175:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967467191424:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.341188:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147265.341195:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.341200:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967466128896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.341205:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8457 00010000:00010000:3.0:1746147265.341207:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.341213:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.341219:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8458 00000100:00100000:0.0:1746147265.341223:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1956:x1830967466128768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.341229:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.341232:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.341240:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.341244:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.341246:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.341251:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.341256:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3f5800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147265.341257:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093803200/0xb4b2209fbdad33b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfd8 expref: 11 pid: 4445 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.341260:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.341265:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147265.341267:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.341276:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.341276:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:1956:x1830967466128768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (441us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147265.341281:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5800/0xb4b2209fbdad34fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.341281:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8458 00000100:00100000:0.0:1746147265.341288:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8459 00000100:00100000:0.0:1746147265.341292:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1958:x1830967466129024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.341297:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.341302:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341309:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341318:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bbae00/0xb4b2209fbdad3153 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede96 expref: 32 pid: 6881 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.341320:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967466126976:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 9142us (9577us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147265.341325:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.341327:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16482 00000100:00100000:0.0:1746147265.341333:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1958:x1830967466129024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 41us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.341337:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8459 00000100:00100000:0.0:1746147265.341345:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8460 00000100:00100000:0.0:1746147265.341349:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967466129152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.341354:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.341360:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 51 pid: 17530 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341366:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 51 pid: 17530 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341376:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bbaa00/0xb4b2209fbdad313e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ede6c expref: 51 pid: 17530 timeout: 752 lvb_type: 1 00010000:00010000:0.0:1746147265.341383:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.341394:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.341397:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.341403:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.341421:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147265.341427:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341435:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.341435:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967466129152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.341440:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8460 00010000:00010000:2.0:1746147265.341450:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341457:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341463:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341472:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ec3e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147265.341475:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341482:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341490:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341495:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec3e00/0xb4b2209fbdad3504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.341528:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:155c2978-1f7e-40cb-a1a1-b417fd287b21+9:1957:x1830967466127232:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 8935us (9347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.341535:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16483 00000100:00100000:1.0:1746147265.341574:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8461 00000100:00100000:1.0:1746147265.341579:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+30:1957:x1830967466128640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.341585:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.341594:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 30 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.341601:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 30 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.341612:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d57800/0xb4b2209fbdad33fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee009 expref: 30 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.341621:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.341622:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.341624:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.341630:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.341650:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147265.341657:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341664:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.341666:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+29:1957:x1830967466128640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.341671:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8461 00010000:00010000:2.0:1746147265.341676:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341681:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341688:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341693:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f72e800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147265.341695:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.341705:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.341711:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466128512 00010000:00010000:2.0:1746147265.341714:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.341714:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466128512 00010000:00010000:2.0:1746147265.341720:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdad34f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147265.341739:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2486272->2715647) req@ffff88012d49bb80 x1830967466128512/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147265.341746:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:155c2978-1f7e-40cb-a1a1-b417fd287b21+8:1957:x1830967466127360:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 18339us (18475us total) trans 0 rc 0/0 00002000:00100000:1.0:1746147265.341748:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49bb80 with x1830967466128512 ext(2486272->2715647) 00000100:00100000:2.0:1746147265.341752:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16481 00010000:00010000:1.0:1746147265.341753:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 10 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.341762:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 10 pid: 17530 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.341767:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d49bb80 00000100:00100000:1.0:1746147265.341779:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2691 00000100:00100000:1.0:1746147265.341784:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967466128512:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147265.343743:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467191552:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.343756:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.346962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.347007:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466129408 00000100:00100000:0.0:1746147265.347015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.347016:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466129408 00000100:00100000:3.0:1746147265.347064:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466129280 00000100:00100000:3.0:1746147265.347066:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466129280 00000100:00100000:3.0:1746147265.347096:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16485 00000100:00100000:3.0:1746147265.347103:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+50:32363:x1830967466129408:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147265.347118:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16486 00010000:00010000:3.0:1746147265.347121:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147265.347125:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+15:32368:x1830967466129280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147265.347134:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.347137:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee095 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347143:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee08e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147265.347159:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417bf, atime: 0x681417bf, ctime: 0x681417bf, blocks: 0x821 00010000:00010000:0.0:1746147265.347166:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.347169:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.347171:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.347171:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347177:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147265.347178:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 51 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347180:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.347192:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 51 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347199:0:4445:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.347201:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a773ac00, rc 0) 00010000:00010000:0.0:1746147265.347210:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347217:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f4600, rc 0) 00000100:00100000:3.0:1746147265.347238:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+51:32363:x1830967466129408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.347244:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16485 00000100:00100000:0.0:1746147265.347246:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:32368:x1830967466129280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 122us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.347252:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16486 00000100:00100000:0.0:1746147265.347455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.347687:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466129536 00000100:00100000:1.0:1746147265.347692:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466129536 00010000:00010000:1.0:1746147265.347712:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.347741:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8462 00000100:00100000:1.0:1746147265.347746:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967466129536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.347755:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.347768:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.347778:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.347794:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a537f600/0xb4b2209fbdad3455 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee048 expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.347804:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.347805:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.347808:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.347814:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.347829:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.347850:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967466129536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.347856:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8462 00010000:00010000:0.0:1746147265.347966:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347974:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347991:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.347998:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.348005:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.348015:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147265.348017:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.348024:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.348032:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.348033:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.348037:0:8478:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.348043:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.348080:0:8478:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.348092:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467192064:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147265.348149:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147265.348502:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1959:x1830967466128512:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6715us (8124us total) trans 21474841538 rc 0/0 00000100:00100000:3.0:1746147265.348511:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2691 00002000:00100000:3.0:1746147265.348520:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2486272->2715647) req@ffff88012d49bb80 x1830967466128512/t21474841538(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.348529:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49bb80 with x1830967466128512 ext(2486272->2715647) 00010000:00010000:3.0:1746147265.348536:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:3.0:1746147265.348548:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00002000:00010000:3.0:1746147265.348554:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d49bb80 00000100:00100000:0.0:1746147265.350270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.350294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.350411:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466129792 00000100:00100000:1.0:1746147265.350416:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466129792 00000100:00100000:0.0:1746147265.350872:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467192064:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147265.350892:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.350905:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdad34ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.350971:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+7:1957:x1830967466127104:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 28151us (28369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.350978:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16480 00000100:00100000:0.0:1746147265.351566:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466130048 00000100:00100000:0.0:1746147265.351570:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466130048 00002000:00100000:0.0:1746147265.351602:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (2027520->2031615) req@ffff88012e2b8e00 x1830967466130048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.351610:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8e00 with x1830967466130048 ext(2027520->2031615) 00002000:00010000:0.0:1746147265.351615:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8e00 00000100:00100000:0.0:1746147265.351639:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7889 00000100:00100000:0.0:1746147265.351646:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967466130048:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:2.0:1746147265.352182:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012e2b8a80 x1830967466129792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.352192:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8a80 with x1830967466129792 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.352195:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8a80 00000100:00100000:2.0:1746147265.352216:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7890 00000100:00100000:2.0:1746147265.352223:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466129792:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147265.355463:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967466130048:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 595us (1945us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147265.355480:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7889 00002000:00100000:0.0:1746147265.355496:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x421:0x0] (2027520->2031615) req@ffff88012e2b8e00 x1830967466130048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.355505:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8e00 with x1830967466130048 ext(2027520->2031615) 00002000:00010000:0.0:1746147265.355511:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8e00 00000100:00100000:0.0:1746147265.355654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.355681:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466130176 00000100:00100000:0.0:1746147265.355689:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466130176 00010000:00010000:0.0:1746147265.355716:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.355739:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8463 00000100:00100000:0.0:1746147265.355746:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+12:1957:x1830967466130176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147265.355757:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147265.355780:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.355792:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.355815:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093802200/0xb4b2209fbdad3359 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2715647) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfae expref: 12 pid: 17530 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.355829:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.355831:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.355835:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355844:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355865:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147265.355903:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+11:1957:x1830967466130176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 157us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.355909:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8463 00010000:00010000:0.0:1746147265.355932:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355953:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355974:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355982:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355988:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.355993:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d59cc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147265.355997:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.356004:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.356015:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.356020:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdad350b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.356079:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1957:x1830967466127488:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 23478us (23875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.356087:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16484 00000100:00100000:2.0:1746147265.364764:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967466129792:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12530us (14487us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.364777:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7890 00002000:00100000:2.0:1746147265.364789:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012e2b8a80 x1830967466129792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.364798:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8a80 with x1830967466129792 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.364804:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8a80 00000100:00100000:1.0:1746147265.367408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.367707:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466130432 00000100:00100000:1.0:1746147265.367717:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466130432 00000100:00100000:1.0:1746147265.367820:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11658 00000100:00100000:1.0:1746147265.368004:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32365:x1830967466130432:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147265.368062:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.368091:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdad34be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee087 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.368105:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.368109:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.368164:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32365:x1830967466130432:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 336us (762us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746147265.368171:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11658 00000100:00100000:1.0:1746147265.373143:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.373168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.373181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.373194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.374137:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466130816 00000100:00100000:0.0:1746147265.374147:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466130816 00000100:00100000:3.0:1746147265.374184:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466130688 00000100:00100000:3.0:1746147265.374188:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466130688 00000100:00100000:1.0:1746147265.374211:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466130944 00000100:00100000:1.0:1746147265.374215:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466130944 00000100:00100000:3.0:1746147265.374220:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4923 00000100:00100000:3.0:1746147265.374226:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+10:32365:x1830967466130688:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147265.374234:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466131072 00000100:00100000:1.0:1746147265.374236:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466131072 00000100:00100000:1.0:1746147265.374249:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16487 00000100:00100000:1.0:1746147265.374254:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1958:x1830967466130944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.374263:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.374278:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0a3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147265.374300:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x821 00010000:00010000:1.0:1746147265.374314:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.374316:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.374325:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 53 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.374344:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 53 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.374354:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86ee00, rc 0) 00000100:00100000:3.0:1746147265.374393:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32365:x1830967466130688:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 167us (1259us total) trans 8589945714 rc 0/0 00000100:00100000:1.0:1746147265.374393:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1958:x1830967466130944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 138us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.374397:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4923 00000100:00100000:1.0:1746147265.374398:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16487 00000100:00100000:1.0:1746147265.374409:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16488 00000100:00100000:1.0:1746147265.374414:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1959:x1830967466131072:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147265.375317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.375369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.375439:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466131200 00000100:00100000:1.0:1746147265.375442:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466131200 00000100:00100000:1.0:1746147265.375468:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466131328 00000100:00100000:1.0:1746147265.375470:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466131328 00000100:00100000:1.0:1746147265.375483:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16489 00000100:00100000:1.0:1746147265.375488:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1958:x1830967466131200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.375496:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.375504:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0b1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147265.375518:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417c0, atime: 0x681417bf, ctime: 0x681417c0, blocks: 0x163f 00010000:00010000:1.0:1746147265.375526:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.375528:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.375532:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 54 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.375543:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 54 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.375551:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e400, rc 0) 00000100:00100000:1.0:1746147265.375570:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+54:1958:x1830967466131200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.375574:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16489 00000100:00100000:1.0:1746147265.375584:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16490 00000100:00100000:1.0:1746147265.375588:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967466131328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.375598:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.375608:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0b8 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147265.375623:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417c1, atime: 0x681417c1, ctime: 0x681417c1, blocks: 0x102b 00010000:00010000:1.0:1746147265.375630:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.375631:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.375635:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 17 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.375644:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 17 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.375650:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86f400, rc 0) 00000100:00100000:1.0:1746147265.375663:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967466131328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.375671:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16490 00010000:00010000:1.0:1746147265.375724:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.375731:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0aa expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147265.375743:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417c1, atime: 0x681417c0, ctime: 0x681417c0, blocks: 0x821 00010000:00010000:1.0:1746147265.375749:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.375750:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.375754:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.375762:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.375769:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e600, rc 0) 00000100:00100000:1.0:1746147265.375783:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967466131072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1369us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.375788:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16488 00000100:00100000:1.0:1746147265.376664:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16491 00000100:00100000:1.0:1746147265.376670:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+53:32368:x1830967466130816:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147265.376677:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.376685:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee09c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.376931:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.376958:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.376959:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.376963:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 54 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.377026:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.377037:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.377048:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467192192:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.377149:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.379115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.380047:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467192192:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147265.380089:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 54 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.380105:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e200, rc 0) 00000100:00100000:0.0:1746147265.380155:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+54:32368:x1830967466130816:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3484us (6985us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.380163:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16491 00000100:00100000:0.0:1746147265.380255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.380583:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466131584 00000100:00100000:2.0:1746147265.380590:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466131584 00000100:00100000:2.0:1746147265.380621:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4924 00000100:00100000:2.0:1746147265.380627:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:32365:x1830967466131584:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147265.380788:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:32365:x1830967466131584:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 161us (1679us total) trans 8589945715 rc 0/0 00000100:00100000:2.0:1746147265.380794:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4924 00000100:00100000:1.0:1746147265.380927:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466131712 00000100:00100000:1.0:1746147265.380962:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466131712 00010000:00010000:1.0:1746147265.380991:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.381013:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8464 00000100:00100000:1.0:1746147265.381019:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+54:1957:x1830967466131712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147265.381030:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147265.381046:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.381070:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.381088:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee095 expref: 54 pid: 4444 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.381099:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.381101:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.381106:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 53 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.381112:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 53 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.381138:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 53 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147265.381148:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467192320:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147265.381218:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.383630:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967467192320:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147265.383646:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147265.383793:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967466131712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2773us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.383802:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8464 00000100:00100000:0.0:1746147265.387223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.387254:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466131968 00000100:00100000:2.0:1746147265.387264:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466131968 00002000:00100000:2.0:1746147265.387321:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1277952->1282047) req@ffff88012e2bb480 x1830967466131968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.387331:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967466131968 ext(1277952->1282047) 00002000:00010000:2.0:1746147265.387336:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb480 00000100:00100000:2.0:1746147265.387359:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7891 00000100:00100000:2.0:1746147265.387366:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1956:x1830967466131968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.387526:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1956:x1830967466131968:12345-192.168.203.36@tcp:3:cat.0 Request processed in 160us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147265.387534:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7891 00002000:00100000:2.0:1746147265.387539:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x425:0x0] (1277952->1282047) req@ffff88012e2bb480 x1830967466131968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.387545:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967466131968 ext(1277952->1282047) 00002000:00010000:2.0:1746147265.387548:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb480 00000100:00100000:0.0:1746147265.388579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.388607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.388619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.388638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.389245:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466132480 00000100:00100000:2.0:1746147265.389256:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466132480 00002000:00100000:2.0:1746147265.389290:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012e2ba300 x1830967466132480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.389298:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967466132480 ext(3145728->4194303) 00002000:00010000:2.0:1746147265.389303:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba300 00000100:00100000:2.0:1746147265.389316:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466132352 00000100:00100000:2.0:1746147265.389318:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466132352 00002000:00100000:2.0:1746147265.389327:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012e2baa00 x1830967466132352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.389333:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967466132352 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.389335:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2baa00 00000100:00100000:2.0:1746147265.389343:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466132736 00000100:00100000:2.0:1746147265.389344:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466132736 00002000:00100000:2.0:1746147265.389354:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012e2bb100 x1830967466132736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.389360:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb100 with x1830967466132736 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.389362:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb100 00000100:00100000:2.0:1746147265.389374:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466132864 00000100:00100000:2.0:1746147265.389380:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466132864 00002000:00100000:2.0:1746147265.389389:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012e2bb800 x1830967466132864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.389395:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967466132864 ext(3145728->4194303) 00002000:00010000:2.0:1746147265.389400:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:2.0:1746147265.389410:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7892 00000100:00100000:2.0:1746147265.389415:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967466132480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.389817:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7893 00000100:00100000:3.0:1746147265.389825:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967466132352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.389900:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7894 00000100:00100000:2.0:1746147265.389906:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+54:1959:x1830967466132736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.390460:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7895 00000100:00100000:3.0:1746147265.390466:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+54:1959:x1830967466132864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.397338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.399933:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466133248 00000100:00100000:2.0:1746147265.399967:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466133248 00000100:00100000:2.0:1746147265.400015:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4925 00000100:00100000:2.0:1746147265.400024:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+313:32368:x1830967466133248:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147265.400391:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+314:32368:x1830967466133248:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 367us (3060us total) trans 8589945716 rc 0/0 00000100:00100000:2.0:1746147265.400398:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4925 00000100:00100000:0.0:1746147265.404041:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+55:1959:x1830967466132864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13567us (15393us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147265.404062:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7895 00002000:00100000:0.0:1746147265.404071:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff88012e2bb800 x1830967466132864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.404085:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967466132864 ext(3145728->4194303) 00002000:00010000:0.0:1746147265.404090:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:3.0:1746147265.418316:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967466132352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28482us (29697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.418326:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7893 00002000:00100000:3.0:1746147265.418338:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012e2baa00 x1830967466132352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.418346:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967466132352 ext(2097152->3145727) 00002000:00010000:3.0:1746147265.418352:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2baa00 00000100:00100000:2.0:1746147265.420675:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1959:x1830967466132736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30762us (32048us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.420686:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7894 00002000:00100000:2.0:1746147265.420696:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff88012e2bb100 x1830967466132736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.420704:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb100 with x1830967466132736 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.420709:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb100 00000100:00100000:0.0:1746147265.421060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.421381:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466133504 00000100:00100000:1.0:1746147265.421388:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466133504 00000100:00100000:1.0:1746147265.421430:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11659 00000100:00100000:1.0:1746147265.421436:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+18:32373:x1830967466133504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.421465:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.421479:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdad3543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0bf expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.421553:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421564:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421572:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421582:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421587:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421592:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421668:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421676:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421680:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147265.421689:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:1.0:1746147265.421756:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421761:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421767:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421771:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e18000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147265.421775:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421780:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421789:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:1.0:1746147265.421791:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147265.421794:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421798:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdad354a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421809:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421813:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421817:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421824:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e18a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147265.421825:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421830:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421835:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f98f000) 00010000:00010000:1.0:1746147265.421837:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147265.421839:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421843:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18a00/0xb4b2209fbdad3551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.421870:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdad3543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.421879:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 20 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.421884:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.421886:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147265.421888:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a773ac00, rc 0) 00000100:00100000:1.0:1746147265.421931:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32373:x1830967466133504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 494us (886us total) trans 8589945717 rc 0/0 00000100:00100000:1.0:1746147265.421958:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11659 00000100:00100000:2.0:1746147265.424031:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967466132480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34611us (35450us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.424045:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7892 00002000:00100000:2.0:1746147265.424082:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012e2ba300 x1830967466132480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.424090:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967466132480 ext(3145728->4194303) 00002000:00010000:2.0:1746147265.424094:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba300 00000100:00100000:3.0:1746147265.428528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.428550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.428558:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466133632 00000100:00100000:3.0:1746147265.428564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.428568:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466133632 00000100:00100000:3.0:1746147265.428575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.428589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.428607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.428607:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466133888 00000100:00100000:0.0:1746147265.428610:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466133888 00000100:00100000:0.0:1746147265.428620:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466134144 00000100:00100000:3.0:1746147265.428622:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466133760 00000100:00100000:0.0:1746147265.428622:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466134144 00000100:00100000:3.0:1746147265.428625:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466133760 00000100:00100000:0.0:1746147265.428632:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466134016 00000100:00100000:0.0:1746147265.428634:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466134016 00000100:00100000:3.0:1746147265.428640:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466134272 00000100:00100000:3.0:1746147265.428641:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466134272 00000100:00100000:0.0:1746147265.428651:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16492 00000100:00100000:3.0:1746147265.428664:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16493 00000100:00100000:3.0:1746147265.428670:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466133888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.428687:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147265.428689:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16494 00000100:00100000:2.0:1746147265.428697:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967466134144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.428703:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad3566 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0d4 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.428706:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.428717:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0e2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.428730:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.428732:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.428742:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.428756:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147265.428757:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467192448:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147265.428767:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed800, rc 0) 00000100:00100000:0.0:1746147265.428799:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466133632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147265.428806:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.428814:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4400/0xb4b2209fbdad3574 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0c6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.428824:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.428826:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147265.428830:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4400/0xb4b2209fbdad3574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0c6 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147265.428835:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b53c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147265.428839:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4400/0xb4b2209fbdad3574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0c6 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147265.428846:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f4400, rc 0) 00000100:00100000:3.0:1746147265.428855:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16495 00000100:00100000:3.0:1746147265.428860:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466133760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.428867:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.428874:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f56e600/0xb4b2209fbdad357b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0cd expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.428883:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.428884:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.428889:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f56e600/0xb4b2209fbdad357b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0cd expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.428904:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56e600/0xb4b2209fbdad357b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0cd expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.428912:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56e600, rc 0) 00000100:00100000:2.0:1746147265.429075:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967466134144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 378us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.429082:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16494 00000100:00100000:2.0:1746147265.429104:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16496 00000100:00100000:2.0:1746147265.429109:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+32:1957:x1830967466134016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147265.429115:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.429122:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdad3582 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0db expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.429145:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467192576:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147265.429172:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.429187:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16497 00000100:00100000:2.0:1746147265.429192:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967466134272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147265.429198:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.429204:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad3589 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0e9 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.429214:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147265.429355:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1957:x1830967466133760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 494us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.429360:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16495 00000100:00100000:0.0:1746147265.429400:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+33:1957:x1830967466133632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 741us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.429407:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16492 00010000:00010000:2.0:1746147265.429881:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.429887:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad3589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e9 expref: 15 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.429898:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad3589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e9 expref: 15 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.429906:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ec200, rc 0) 00000100:00100000:2.0:1746147265.429927:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1957:x1830967466134272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 735us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.429933:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16497 00000100:00100000:0.0:1746147265.430442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.431502:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466134528 00000100:00100000:2.0:1746147265.431510:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466134528 00002000:00100000:2.0:1746147265.431545:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012e2b8700 x1830967466134528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.431555:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8700 with x1830967466134528 ext(4194304->4976639) 00002000:00010000:2.0:1746147265.431560:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8700 00000100:00100000:2.0:1746147265.431576:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7896 00000100:00100000:2.0:1746147265.431582:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1956:x1830967466134528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.432179:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467192448:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147265.432211:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad3566 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0d4 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.432222:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56ec00/0xb4b2209fbdad3566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0d4 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.432234:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f56ec00, rc 0) 00000100:00100000:3.0:1746147265.432287:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466133888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3618us (3736us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147265.432294:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16493 00002000:00010000:2.0:1746147265.434685:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime: 1746147263 -> 1746147265 00002000:00010000:2.0:1746147265.434692:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime: 1746147263 -> 1746147265 00002000:00010000:2.0:1746147265.434694:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime: 1746147263 -> 1746147265 00000100:00100000:2.0:1746147265.434717:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467192576:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147265.434750:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdad3582 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0db expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.434763:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdad3582 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0db expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.434773:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed400, rc 0) 00000100:00100000:2.0:1746147265.434801:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+31:1957:x1830967466134016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5691us (6210us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147265.434810:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16496 00000100:00100000:0.0:1746147265.440849:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1956:x1830967466134528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9257us (10398us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746147265.440862:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7896 00002000:00100000:0.0:1746147265.440876:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88012e2b8700 x1830967466134528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.440886:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8700 with x1830967466134528 ext(4194304->4976639) 00002000:00010000:0.0:1746147265.440892:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8700 00000001:00080000:3.0:1746147265.442844:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874192 is committed 00000001:00080000:3.0:1746147265.442860:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874195 is committed 00000001:00080000:3.0:1746147265.442899:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874123 is committed 00000001:00080000:3.0:1746147265.442912:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874113 is committed 00000001:00080000:3.0:1746147265.442921:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874199 is committed 00000001:00080000:3.0:1746147265.442926:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874197 is committed 00000001:00080000:3.0:1746147265.442984:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874180 is committed 00000001:00080000:3.0:1746147265.443029:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874124 is committed 00000001:00080000:3.0:1746147265.443064:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874198 is committed 00000001:00080000:3.0:1746147265.443109:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874125 is committed 00000001:00080000:3.0:1746147265.443118:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874200 is committed 00000100:00100000:0.0:1746147265.447773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.447823:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466134784 00000100:00100000:2.0:1746147265.447832:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466134784 00000100:00100000:2.0:1746147265.447880:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4926 00000100:00100000:2.0:1746147265.447887:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:32363:x1830967466134784:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147265.448080:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+315:32363:x1830967466134784:12345-192.168.203.36@tcp:35:cat.0 Request processed in 192us (312us total) trans 8589945718 rc 0/0 00000100:00100000:2.0:1746147265.448089:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4926 00000100:00100000:0.0:1746147265.449151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.449170:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466135040 00000100:00100000:0.0:1746147265.449174:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466135040 00002000:00100000:0.0:1746147265.449197:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008e974380 x1830967466135040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.449206:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974380 with x1830967466135040 ext(0->1048575) 00002000:00010000:0.0:1746147265.449211:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974380 00000100:00100000:0.0:1746147265.449223:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7897 00000100:00100000:0.0:1746147265.449228:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1956:x1830967466135040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.451019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.451042:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466135424 00000100:00100000:1.0:1746147265.451061:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466135424 00000100:00100000:1.0:1746147265.451091:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11660 00000100:00100000:1.0:1746147265.451097:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+20:32375:x1830967466135424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147265.451115:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.451134:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad3590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0f0 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.451204:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.451217:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.451224:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.451249:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.451259:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 21 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.451269:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467192704:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147265.451661:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e0f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.452044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.452104:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466135552 00000100:00100000:1.0:1746147265.452109:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466135552 00002000:00100000:1.0:1746147265.452128:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f86d80 x1830967466135552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.452141:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86d80 with x1830967466135552 ext(1048576->2097151) 00002000:00010000:1.0:1746147265.452145:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f86d80 00000100:00100000:1.0:1746147265.452168:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7898 00000100:00100000:1.0:1746147265.452174:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466135552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147265.465017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.465200:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466135680 00000100:00100000:1.0:1746147265.465208:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967467192704:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.465209:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466135680 00010000:00010000:1.0:1746147265.465226:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.465234:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 22 pid: 14048 timeout: 752 lvb_type: 0 00000100:00100000:2.0:1746147265.465257:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8465 00000100:00100000:2.0:1746147265.465262:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+22:1957:x1830967466135680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147265.465272:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147265.465276:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 22 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.465285:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 22 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.465299:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a773ac00/0xb4b2209fbdad3558 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0bf expref: 22 pid: 14048 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.465309:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147265.465313:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.465320:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.465324:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147265.465337:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147265.465383:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1957:x1830967466135680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 120us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.465388:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8465 00000100:00100000:1.0:1746147265.465993:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+13:1957:x1830967466135552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13818us (13948us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147265.466000:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7898 00002000:00100000:1.0:1746147265.466008:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff880134f86d80 x1830967466135552/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.466016:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134f86d80 with x1830967466135552 ext(1048576->2097151) 00002000:00010000:1.0:1746147265.466020:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134f86d80 00010000:00010000:1.0:1746147265.466041:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147265.466046:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147265.466214:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:1.0:1746147265.466312:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdad3590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f0 expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.466336:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f0 expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.466343:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147265.466345:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147265.466347:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0e00, rc 0) 00000100:00100000:1.0:1746147265.466368:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32375:x1830967466135424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15272us (15354us total) trans 8589945719 rc 0/0 00000100:00100000:1.0:1746147265.466374:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11660 00000100:00100000:1.0:1746147265.467982:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1956:x1830967466135040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18748us (18827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147265.467991:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7897 00002000:00100000:1.0:1746147265.467998:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88008e974380 x1830967466135040/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.468006:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974380 with x1830967466135040 ext(0->1048575) 00002000:00010000:1.0:1746147265.468010:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974380 00000100:00100000:0.0:1746147265.493241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.493344:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466135808 00000100:00100000:2.0:1746147265.493353:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466135808 00000100:00100000:3.0:1746147265.493483:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16498 00000100:00100000:3.0:1746147265.493501:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+13:32373:x1830967466135808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.493524:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.493547:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0f7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.493585:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.493594:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147265.493595:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147265.493599:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f7 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.493634:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.493647:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 16 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.493660:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467192832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.493776:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.497086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.497129:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967467192832:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147265.497162:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f7 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.497178:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009812b200, rc 0) 00000100:00100000:1.0:1746147265.497269:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466135936 00000100:00100000:1.0:1746147265.497277:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466135936 00002000:00100000:1.0:1746147265.497327:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x421:0x0] (2027520->2097151) req@ffff88009b6a3800 x1830967466135936/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.497337:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3800 with x1830967466135936 ext(2027520->2097151) 00010000:00010000:1.0:1746147265.497347:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 17 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.497359:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 17 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.497375:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6a3800 00000100:00100000:1.0:1746147265.497410:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2692 00000100:00100000:1.0:1746147265.497418:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967466135936:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147265.497621:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:32373:x1830967466135808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4125us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.497629:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16498 00000100:00100000:1.0:1746147265.502953:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466135936:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5508us (5849us total) trans 21474841539 rc 0/0 00000100:00100000:1.0:1746147265.502967:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2692 00002000:00100000:1.0:1746147265.503160:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (2027520->2097151) req@ffff88009b6a3800 x1830967466135936/t21474841539(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.503174:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a3800 with x1830967466135936 ext(2027520->2097151) 00010000:00010000:1.0:1746147265.503186:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 19 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.503201:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 19 pid: 4445 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.503209:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6a3800 00000100:00100000:0.0:1746147265.509208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.509286:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136064 00000100:00100000:2.0:1746147265.509297:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136064 00010000:00010000:2.0:1746147265.509334:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 19 pid: 4445 timeout: 752 lvb_type: 0 00000100:00100000:2.0:1746147265.509360:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8466 00000100:00100000:2.0:1746147265.509366:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466136064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147265.509380:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147265.509402:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 19 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.509414:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 19 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.509446:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdad3519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee08e expref: 19 pid: 4445 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.509469:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.509472:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.511397:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.511415:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.511468:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.511481:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467192960:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147265.511664:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.517195:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967467192960:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147265.517220:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147265.517295:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967466136064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7926us (8485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.517306:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8466 00000100:00100000:0.0:1746147265.519997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.520277:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136320 00000100:00100000:1.0:1746147265.520286:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136320 00002000:00100000:1.0:1746147265.520330:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b6a0e00 x1830967466136320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.520339:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0e00 with x1830967466136320 ext(1048576->2097151) 00002000:00010000:1.0:1746147265.520345:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a0e00 00000100:00100000:1.0:1746147265.520380:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7899 00000100:00100000:1.0:1746147265.520386:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466136320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.538741:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1957:x1830967466136320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18341us (18740us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147265.538755:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7899 00002000:00100000:1.0:1746147265.538768:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009b6a0e00 x1830967466136320/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.538777:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0e00 with x1830967466136320 ext(1048576->2097151) 00002000:00010000:1.0:1746147265.538783:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6a0e00 00000100:00100000:2.0:1746147265.545199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.545313:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136448 00000100:00100000:3.0:1746147265.545323:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136448 00000100:00100000:3.0:1746147265.545929:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16499 00000100:00100000:3.0:1746147265.545962:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+7:32373:x1830967466136448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.545983:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.546002:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee0fe expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.546035:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.546043:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147265.546045:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147265.546061:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0fe expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.546095:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.546107:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 20 pid: 17548 timeout: 752 lvb_type: 0 00000100:00100000:3.0:1746147265.546121:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467193088:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147265.547417:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.550440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.550527:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136576 00000100:00100000:2.0:1746147265.550536:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136576 00000100:00100000:2.0:1746147265.550578:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16500 00000100:00100000:2.0:1746147265.550585:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32375:x1830967466136576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147265.550601:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147265.550619:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee105 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.550650:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.550658:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.550670:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.550671:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.550675:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2252800->2936831] (req 2252800->2936831) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.550704:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.550715:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 10 pid: 21080 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.550728:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467193216:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147265.551205:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147265.551214:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 20 pid: 8481 timeout: 752 lvb_type: 1 00000100:00100000:2.0:1746147265.551223:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467193344:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.551246:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.551860:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967467193088:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147265.551882:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 3/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0fe expref: 10 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.551900:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08600, rc 0) 00000100:00100000:2.0:1746147265.551934:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+10:32373:x1830967466136448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5997us (6745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.551955:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16499 00000100:00100000:0.0:1746147265.552785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.552858:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136704 00000100:00100000:1.0:1746147265.552865:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136704 00002000:00100000:1.0:1746147265.552900:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1282047) req@ffff88009b6a0a80 x1830967466136704/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.552908:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0a80 with x1830967466136704 ext(1048576->1282047) 00010000:00010000:1.0:1746147265.552916:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 21 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:1.0:1746147265.552927:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 21 pid: 17548 timeout: 752 lvb_type: 0 00002000:00010000:1.0:1746147265.552933:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a0a80 00000100:00100000:1.0:1746147265.552981:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2693 00000100:00100000:1.0:1746147265.552987:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466136704:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147265.556164:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.556209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.556234:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467193216:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147265.556249:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967467193344:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147265.556278:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [2252800->2936831] (req 2252800->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 9 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.556295:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485a200, rc 0) 00000100:00100000:2.0:1746147265.556352:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:32375:x1830967466136576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5767us (5918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.556361:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16500 00000100:00100000:3.0:1746147265.556459:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136960 00000100:00100000:3.0:1746147265.556466:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136960 00010000:00010000:3.0:1746147265.556496:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 23 pid: 8481 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.556517:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466136832 00000100:00100000:3.0:1746147265.556520:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466136832 00010000:00010000:3.0:1746147265.556532:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 9 pid: 21080 timeout: 752 lvb_type: 1 00000100:00100000:3.0:1746147265.556547:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8467 00000100:00100000:3.0:1746147265.556553:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466136960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.556566:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.556590:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 23 pid: 8481 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.556599:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 23 pid: 8481 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.556624:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e400/0xb4b2209fbdad3527 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b1 expref: 23 pid: 8481 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.556640:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.556660:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967466136960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.556665:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8467 00000100:00100000:3.0:1746147265.556705:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8468 00000100:00100000:3.0:1746147265.556710:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1956:x1830967466136832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147265.556716:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147265.556724:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 9 pid: 21080 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.556731:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 9 pid: 21080 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.556742:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdad356d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e2 expref: 9 pid: 21080 timeout: 752 lvb_type: 1 00010000:00010000:3.0:1746147265.556751:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.556753:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.556760:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.556767:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.556793:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147265.556804:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467193472:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147265.556858:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147265.559009:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466136704:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6015us (6217us total) trans 17179874201 rc 0/0 00000100:00100000:0.0:1746147265.559019:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2693 00002000:00100000:0.0:1746147265.559028:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x425:0x0] (1048576->1282047) req@ffff88009b6a0a80 x1830967466136704/t17179874201(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.559037:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6a0a80 with x1830967466136704 ext(1048576->1282047) 00010000:00010000:0.0:1746147265.559046:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 22 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:0.0:1746147265.559069:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 22 pid: 17548 timeout: 752 lvb_type: 0 00002000:00010000:0.0:1746147265.559076:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6a0a80 00000100:00100000:0.0:1746147265.572624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.572655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.573257:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137088 00000100:00100000:1.0:1746147265.573267:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137088 00000100:00100000:3.0:1746147265.573391:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967467193472:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147265.573413:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.573460:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967466136832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 16749us (17250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.573470:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8468 00000100:00100000:1.0:1746147265.577787:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:1.0:1746147265.577808:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1958:x1830967466137088:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147265.577883:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1958:x1830967466137088:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 85us (5270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.577890:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:2.0:1746147265.578031:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137344 00000100:00100000:2.0:1746147265.578039:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137344 00000100:00100000:2.0:1746147265.578099:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:2.0:1746147265.578105:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967466137344:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1746147265.578132:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967466137344:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 28us (5477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.578137:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:0.0:1746147265.578380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.578401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.578417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.578431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.578463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.578486:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137216 00000100:00100000:0.0:1746147265.578489:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137216 00000100:00100000:0.0:1746147265.578512:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137472 00000100:00100000:0.0:1746147265.578514:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137472 00000100:00100000:0.0:1746147265.578526:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137600 00000100:00100000:0.0:1746147265.578527:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137600 00000100:00100000:0.0:1746147265.578548:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:0.0:1746147265.578554:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1958:x1830967466137216:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147265.578583:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1958:x1830967466137216:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.578589:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:0.0:1746147265.578606:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:0.0:1746147265.578611:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967466137472:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147265.578634:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1959:x1830967466137472:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 23us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.578639:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:0.0:1746147265.578648:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:0.0:1746147265.578653:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466137600:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147265.578676:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1959:x1830967466137600:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 23us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.578680:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:0.0:1746147265.578712:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137728 00000100:00100000:0.0:1746147265.578714:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137728 00000100:00100000:0.0:1746147265.578727:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466137856 00000100:00100000:0.0:1746147265.578728:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466137856 00000100:00100000:0.0:1746147265.578739:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 246 00000100:00100000:0.0:1746147265.578743:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967466137728:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147265.578764:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1959:x1830967466137728:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 20us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.578769:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 246 00000100:00100000:0.0:1746147265.578779:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:0.0:1746147265.578783:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1959:x1830967466137856:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147265.578803:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1959:x1830967466137856:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 19us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147265.578808:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:0.0:1746147265.582693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.582754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.582841:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466138112 00000100:00100000:3.0:1746147265.582852:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466138112 00010000:00010000:3.0:1746147265.582890:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 22 pid: 17548 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.582990:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466138240 00000100:00100000:1.0:1746147265.582993:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466138240 00002000:00100000:1.0:1746147265.583026:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2932736->2936831) req@ffff88012b0c0e00 x1830967466138240/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.583035:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0e00 with x1830967466138240 ext(2932736->2936831) 00002000:00010000:1.0:1746147265.583040:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0e00 00000100:00100000:2.0:1746147265.583542:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8469 00000100:00100000:2.0:1746147265.583552:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967466138112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147265.583569:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147265.583593:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 22 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.583606:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 22 pid: 17548 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.583629:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e200/0xb4b2209fbdad353c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee09c expref: 22 pid: 17548 timeout: 752 lvb_type: 0 00000100:00100000:1.0:1746147265.583765:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7900 00000100:00100000:1.0:1746147265.583772:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967466138240:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:2.0:1746147265.584285:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.584288:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.584295:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0fe expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.584303:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0fe expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.584337:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0fe expref: 8 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.584349:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467193600:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147265.584483:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1957:x1830967466138240:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 710us (1726us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147265.584490:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7900 00002000:00100000:1.0:1746147265.584496:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (2932736->2936831) req@ffff88012b0c0e00 x1830967466138240/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.584504:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0e00 with x1830967466138240 ext(2932736->2936831) 00002000:00010000:1.0:1746147265.584507:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0e00 00000100:00100000:2.0:1746147265.584611:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.587900:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467193600:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147265.587920:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147265.587981:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967466138112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4430us (5299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.587992:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8469 00000100:00100000:0.0:1746147265.593425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.593547:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466138496 00000100:00100000:2.0:1746147265.593561:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466138496 00002000:00100000:2.0:1746147265.593619:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012b0c2a00 x1830967466138496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.593629:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c2a00 with x1830967466138496 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.593635:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c2a00 00000100:00100000:2.0:1746147265.593668:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7901 00000100:00100000:2.0:1746147265.593675:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967466138496:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147265.596931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.597478:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466138752 00000100:00100000:3.0:1746147265.597486:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466138752 00000100:00100000:3.0:1746147265.597530:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11661 00000100:00100000:3.0:1746147265.597537:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:32380:x1830967466138752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.597556:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147265.597573:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad35ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee10c expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.597672:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597684:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597696:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597708:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597714:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597719:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597826:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08c00/0xb4b2209fbdad35cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597835:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08c00/0xb4b2209fbdad35cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597842:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08c00/0xb4b2209fbdad35cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147265.597851:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147265.597958:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597965:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597970:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.597976:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147265.598105:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.598112:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.598122:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147265.598126:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147265.598129:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.598133:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.599746:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.599757:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.599762:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.599766:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147265.599785:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.599793:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.599807:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134d0a400) 00010000:00010000:3.0:1746147265.599809:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147265.600209:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.600215:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad35c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147265.600282:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad35ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee10c expref: 318 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.600302:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08c00/0xb4b2209fbdad35cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee10c expref: 317 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.600307:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147265.600310:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147265.600313:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08c00, rc 0) 00000100:00100000:3.0:1746147265.605321:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32380:x1830967466138752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7769us (8384us total) trans 8589945720 rc 0/0 00000100:00100000:3.0:1746147265.605334:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11661 00000100:00100000:3.0:1746147265.607220:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967466138496:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13537us (13801us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.607232:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7901 00002000:00100000:3.0:1746147265.607244:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88012b0c2a00 x1830967466138496/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.607254:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c2a00 with x1830967466138496 ext(1048576->2097151) 00002000:00010000:3.0:1746147265.607261:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c2a00 00000100:00100000:0.0:1746147265.609374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.610175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.610213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.610241:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466139136 00000100:00100000:0.0:1746147265.610247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.610252:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466139136 00000100:00100000:1.0:1746147265.610254:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466139008 00000100:00100000:1.0:1746147265.610259:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466139008 00000100:00100000:0.0:1746147265.610264:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466139264 00000100:00100000:0.0:1746147265.610268:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466139264 00000100:00100000:1.0:1746147265.610296:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16501 00000100:00100000:1.0:1746147265.610302:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967466139008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147265.610320:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147265.610338:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee113 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.610361:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.610363:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147265.610373:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.610388:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.610399:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037800, rc 0) 00000100:00100000:3.0:1746147265.610416:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16502 00000100:00100000:0.0:1746147265.610422:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16503 00000100:00100000:3.0:1746147265.610423:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466139136:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147265.610429:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466139264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147265.610431:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147265.610436:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147265.610437:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466139008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 135us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.610443:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16501 00010000:00010000:3.0:1746147265.610445:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee11a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147265.610445:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e767c00/0xb4b2209fbdad35eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee121 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.610458:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.610460:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147265.610465:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.610475:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147265.610481:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08e00, rc 0) 00000100:00100000:0.0:1746147265.610486:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467193728:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147265.610499:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466139136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.610504:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16502 00000100:00100000:0.0:1746147265.610544:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.611216:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466138880 00000100:00100000:2.0:1746147265.611221:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466138880 00002000:00010000:1.0:1746147265.612551:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime: 1746147264 -> 1746147265 00002000:00010000:1.0:1746147265.612556:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime: 1746147263 -> 1746147265 00002000:00010000:1.0:1746147265.612558:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime: 1746147264 -> 1746147265 00000100:00100000:1.0:1746147265.612581:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467193728:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147265.612609:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e767c00/0xb4b2209fbdad35eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee121 expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.612622:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e767c00/0xb4b2209fbdad35eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee121 expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147265.612635:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e767c00, rc 0) 00000100:00100000:3.0:1746147265.612647:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 804 00000100:00100000:3.0:1746147265.612663:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1959:x1830967466138880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147265.612670:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466139264:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2242us (2422us total) trans 0 rc 301/301 00010000:00010000:3.0:1746147265.612677:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147265.612677:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16503 00010000:00010000:3.0:1746147265.612697:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08c00/0xb4b2209fbdad35cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee10c expref: 317 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147265.612712:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147265.612717:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147265.612734:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1959:x1830967466138880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147265.612739:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 804 00000100:00100000:0.0:1746147265.618789:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.618811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.618818:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466139648 00000100:00100000:0.0:1746147265.618825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.618828:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466139648 00002000:00100000:3.0:1746147265.618875:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3829759) req@ffff88012b0c0a80 x1830967466139648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 504/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.618886:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0a80 with x1830967466139648 ext(2097152->3829759) 00002000:00010000:3.0:1746147265.618892:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0a80 00000100:00100000:0.0:1746147265.619233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.619401:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466139776 00000100:00100000:2.0:1746147265.619406:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466140160 00000100:00100000:1.0:1746147265.619409:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466139776 00000100:00100000:2.0:1746147265.619411:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466140160 00002000:00100000:1.0:1746147265.619429:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3829760->4194303) req@ffff88012b0c1500 x1830967466139776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.619430:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012b0c0380 x1830967466140160/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.619436:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1500 with x1830967466139776 ext(3829760->4194303) 00002000:00100000:2.0:1746147265.619438:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0380 with x1830967466140160 ext(3145728->4194303) 00002000:00010000:1.0:1746147265.619439:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c1500 00002000:00010000:2.0:1746147265.619441:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0380 00000100:00100000:0.0:1746147265.619456:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466140032 00000100:00100000:0.0:1746147265.619459:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466140032 00002000:00100000:0.0:1746147265.619474:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012b0c3b80 x1830967466140032/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.619482:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3b80 with x1830967466140032 ext(2097152->3145727) 00002000:00010000:0.0:1746147265.619484:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c3b80 00000100:00100000:3.0:1746147265.619492:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7902 00000100:00100000:1.0:1746147265.619690:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7903 00000100:00100000:3.0:1746147265.619703:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967466139648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.619903:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7904 00000100:00100000:2.0:1746147265.619909:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967466140160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.620255:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7905 00000100:00100000:2.0:1746147265.620260:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+15:1958:x1830967466140032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.620279:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1958:x1830967466139776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147265.631701:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1958:x1830967466139776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11786us (12872us total) trans 0 rc 364544/364544 00000100:00100000:1.0:1746147265.631715:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7903 00002000:00100000:1.0:1746147265.631728:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x426:0x0] (3829760->4194303) req@ffff88012b0c1500 x1830967466139776/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 364544/364544 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147265.631739:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c1500 with x1830967466139776 ext(3829760->4194303) 00002000:00010000:1.0:1746147265.631745:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c1500 00000100:00100000:3.0:1746147265.632257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.632290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.632309:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466140672 00000100:00100000:3.0:1746147265.632313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.632318:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466140672 00000100:00100000:0.0:1746147265.632333:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466140800 00000100:00100000:3.0:1746147265.632335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.632335:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466140800 00000100:00100000:2.0:1746147265.632348:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466141056 00000100:00100000:2.0:1746147265.632352:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466141056 00002000:00100000:2.0:1746147265.632365:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f669f80 x1830967466141056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.632365:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f66b800 x1830967466140800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.632373:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669f80 with x1830967466141056 ext(1048576->2097151) 00002000:00100000:0.0:1746147265.632373:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b800 with x1830967466140800 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.632376:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669f80 00002000:00010000:0.0:1746147265.632376:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66b800 00000100:00100000:2.0:1746147265.632392:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466141312 00000100:00100000:2.0:1746147265.632394:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466141312 00000100:00100000:0.0:1746147265.632397:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7906 00002000:00100000:2.0:1746147265.632403:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009f668000 x1830967466141312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147265.632403:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967466141056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.632406:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7907 00002000:00100000:2.0:1746147265.632408:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668000 with x1830967466141312 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.632411:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f668000 00000100:00100000:3.0:1746147265.632415:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967466140800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.632422:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7908 00000100:00100000:2.0:1746147265.632425:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466141312:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147265.632663:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009f669180 x1830967466140672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.632669:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669180 with x1830967466140672 ext(0->1048575) 00002000:00010000:0.0:1746147265.632672:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f669180 00000100:00100000:0.0:1746147265.632685:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7909 00000100:00100000:0.0:1746147265.632690:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466140672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.634443:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+16:1958:x1830967466140032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14176us (15203us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.634451:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7905 00002000:00100000:2.0:1746147265.634459:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x422:0x0] (2097152->3145727) req@ffff88012b0c3b80 x1830967466140032/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.634466:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c3b80 with x1830967466140032 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.634470:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c3b80 00000100:00100000:3.0:1746147265.645514:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1958:x1830967466140160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25591us (26673us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.645527:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7904 00002000:00100000:3.0:1746147265.645539:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x422:0x0] (3145728->4194303) req@ffff88012b0c0380 x1830967466140160/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.645550:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0380 with x1830967466140160 ext(3145728->4194303) 00002000:00010000:3.0:1746147265.645556:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b0c0380 00000100:00100000:3.0:1746147265.648221:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1958:x1830967466139648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28713us (29428us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.648233:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7902 00002000:00100000:3.0:1746147265.648245:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3829759) req@ffff88012b0c0a80 x1830967466139648/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 504/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.648254:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b0c0a80 with x1830967466139648 ext(2097152->3829759) 00002000:00010000:3.0:1746147265.648261:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b0c0a80 00000100:00100000:2.0:1746147265.653005:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967466140800:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20580us (20702us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.653019:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7907 00002000:00100000:2.0:1746147265.653032:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x420:0x0] (1048576->2097151) req@ffff88009f66b800 x1830967466140800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.653043:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f66b800 with x1830967466140800 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.653062:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f66b800 00000100:00100000:2.0:1746147265.656732:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466141056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24317us (24406us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.656744:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7906 00002000:00100000:2.0:1746147265.656754:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x421:0x0] (1048576->2097151) req@ffff88009f669f80 x1830967466141056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.656764:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669f80 with x1830967466141056 ext(1048576->2097151) 00002000:00010000:2.0:1746147265.656770:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f669f80 00000100:00100000:0.0:1746147265.657263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.657836:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466140672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25144us (25581us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147265.657843:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7909 00002000:00100000:0.0:1746147265.657848:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x423:0x0] (0->1048575) req@ffff88009f669180 x1830967466140672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.657856:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f669180 with x1830967466140672 ext(0->1048575) 00002000:00010000:0.0:1746147265.657860:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f669180 00000100:00100000:0.0:1746147265.657876:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466141568 00000100:00100000:0.0:1746147265.657883:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466141568 00002000:00100000:0.0:1746147265.657906:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a5ba1500 x1830967466141568/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147265.657913:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1500 with x1830967466141568 ext(4194304->4976639) 00002000:00010000:0.0:1746147265.657916:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1500 00000100:00100000:0.0:1746147265.657966:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7910 00000100:00100000:0.0:1746147265.657972:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967466141568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.663244:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967466141312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30805us (30896us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.663255:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7908 00002000:00100000:3.0:1746147265.663266:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x425:0x0] (1048576->2097151) req@ffff88009f668000 x1830967466141312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.663276:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f668000 with x1830967466141312 ext(1048576->2097151) 00002000:00010000:3.0:1746147265.663282:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f668000 00000100:00100000:2.0:1746147265.667345:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1956:x1830967466141568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9363us (10073us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746147265.667357:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7910 00002000:00100000:2.0:1746147265.667369:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff8800a5ba1500 x1830967466141568/t0(0) o3->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.667379:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1500 with x1830967466141568 ext(4194304->4976639) 00002000:00010000:2.0:1746147265.667385:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1500 00000100:00100000:0.0:1746147265.671345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147265.671415:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466141696 00000100:00100000:1.0:1746147265.671425:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466141696 00000100:00100000:1.0:1746147265.671481:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16504 00000100:00100000:1.0:1746147265.671489:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:32380:x1830967466141696:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147265.671489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147265.671507:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147265.671511:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466141952 00010000:00010000:1.0:1746147265.671524:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee128 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.671560:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 7 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.671568:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.671570:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147265.671573:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147265.671581:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466141952 00010000:00010000:1.0:1746147265.671603:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 7 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.671615:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 7 pid: 21080 timeout: 752 lvb_type: 0 00000100:00100000:0.0:1746147265.671624:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4927 00000100:00100000:1.0:1746147265.671627:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467193856:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147265.671631:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:32373:x1830967466141952:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147265.671843:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32373:x1830967466141952:12345-192.168.203.36@tcp:35:cat.0 Request processed in 211us (352us total) trans 8589945721 rc 0/0 00000100:00100000:0.0:1746147265.671854:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4927 00000100:00100000:1.0:1746147265.672483:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e0f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147265.675996:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467193856:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147265.676021:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147265.676036:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20800, rc 0) 00000100:00100000:1.0:1746147265.676099:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32380:x1830967466141696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4610us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147265.676107:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16504 00000100:00100000:0.0:1746147265.677145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.677227:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466142080 00000100:00100000:2.0:1746147265.677236:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466142080 00002000:00100000:2.0:1746147265.677279:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2252800->2936831) req@ffff8800a5ba3b80 x1830967466142080/t0(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.677289:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3b80 with x1830967466142080 ext(2252800->2936831) 00010000:00010000:2.0:1746147265.677297:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 8 pid: 21080 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.677311:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 8 pid: 21080 timeout: 752 lvb_type: 0 00002000:00010000:2.0:1746147265.677325:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ba3b80 00000100:00100000:2.0:1746147265.677357:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2694 00000100:00100000:2.0:1746147265.677365:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1959:x1830967466142080:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147265.684888:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967466142080:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7511us (7736us total) trans 17179874202 rc 0/0 00000100:00100000:2.0:1746147265.684900:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2694 00002000:00100000:2.0:1746147265.684913:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2252800->2936831) req@ffff8800a5ba3b80 x1830967466142080/t17179874202(0) o4->41cd127e-b323-44aa-a051-9b1183d9dd39@192.168.203.36@tcp:641/0 lens 488/448 e 0 to 0 dl 1746147276 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.684923:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3b80 with x1830967466142080 ext(2252800->2936831) 00010000:00010000:2.0:1746147265.684933:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.684968:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 752 lvb_type: 0 00002000:00010000:2.0:1746147265.684975:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ba3b80 00000100:00100000:0.0:1746147265.690665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.690717:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466142208 00000100:00100000:2.0:1746147265.690727:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466142208 00010000:00010000:2.0:1746147265.690768:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 752 lvb_type: 0 00000100:00100000:2.0:1746147265.690810:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8470 00000100:00100000:2.0:1746147265.690817:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+10:1959:x1830967466142208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147265.690836:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147265.690859:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.690871:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.690894:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a200/0xb4b2209fbdad35b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2936831) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee105 expref: 10 pid: 21080 timeout: 752 lvb_type: 0 00010000:00010000:2.0:1746147265.690924:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.690926:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147265.690933:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.690960:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147265.690995:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147265.691008:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467193984:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147265.691106:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147265.693242:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467193984:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147265.693263:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147265.693314:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1959:x1830967466142208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2496us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147265.693325:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8470 00000100:00100000:0.0:1746147265.695748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147265.695791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.695852:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466142464 00000100:00100000:2.0:1746147265.695860:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466142464 00002000:00100000:2.0:1746147265.695901:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5ba0700 x1830967466142464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.695910:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0700 with x1830967466142464 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.695915:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba0700 00000100:00100000:2.0:1746147265.695929:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466142592 00000100:00100000:2.0:1746147265.695930:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466142592 00002000:00100000:2.0:1746147265.695955:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a5ba3480 x1830967466142592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.695961:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3480 with x1830967466142592 ext(3145728->4194303) 00002000:00010000:2.0:1746147265.695963:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba3480 00000100:00100000:2.0:1746147265.695973:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7911 00000100:00100000:2.0:1746147265.695978:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466142464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.696969:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7912 00000100:00100000:3.0:1746147265.696981:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466142592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147265.705933:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466142464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9942us (10180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147265.705959:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7911 00002000:00100000:2.0:1746147265.705971:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x426:0x0] (2097152->3145727) req@ffff8800a5ba0700 x1830967466142464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147265.705981:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0700 with x1830967466142464 ext(2097152->3145727) 00002000:00010000:2.0:1746147265.705987:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba0700 00000100:00100000:3.0:1746147265.709646:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466142592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12658us (13843us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147265.709659:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7912 00002000:00100000:3.0:1746147265.709672:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (3145728->4194303) req@ffff8800a5ba3480 x1830967466142592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.709681:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3480 with x1830967466142592 ext(3145728->4194303) 00002000:00010000:3.0:1746147265.709687:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba3480 00000100:00100000:0.0:1746147265.714539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147265.714606:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466142976 00000100:00100000:3.0:1746147265.714616:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466142976 00002000:00100000:3.0:1746147265.714666:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6bad80 x1830967466142976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/0 e 0 to 0 dl 1746147276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.714676:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bad80 with x1830967466142976 ext(4194304->4976639) 00002000:00010000:3.0:1746147265.714681:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bad80 00000100:00100000:3.0:1746147265.715432:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7913 00000100:00100000:3.0:1746147265.715441:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466142976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147265.723110:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466142976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7658us (8569us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746147265.723122:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7913 00002000:00100000:3.0:1746147265.723133:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x426:0x0] (4194304->4976639) req@ffff88009b6bad80 x1830967466142976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:641/0 lens 488/440 e 0 to 0 dl 1746147276 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147265.723143:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bad80 with x1830967466142976 ext(4194304->4976639) 00002000:00010000:3.0:1746147265.723149:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bad80 00000100:00100000:0.0:1746147265.730066:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147265.730179:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466143232 00000100:00100000:2.0:1746147265.730189:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466143232 00000100:00100000:2.0:1746147265.730283:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4928 00000100:00100000:2.0:1746147265.730292:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:32380:x1830967466143232:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147265.731493:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32380:x1830967466143232:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1198us (1444us total) trans 8589945722 rc 0/0 00000100:00100000:2.0:1746147265.731502:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4928 00010000:00010000:2.0:1746147266.027210:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147266.287572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.287803:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466143488 00000100:00100000:2.0:1746147266.287815:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466143488 00000100:00080000:0.0:1746147266.287980:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147266.288158:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4929 00000100:00100000:2.0:1746147266.288168:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+22:32402:x1830967466143488:12345-192.168.203.36@tcp:35:umount.0 00000100:00100000:2.0:1746147266.288716:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:32402:x1830967466143488:12345-192.168.203.36@tcp:35:umount.0 Request processed in 549us (1152us total) trans 8589945723 rc 0/0 00000100:00100000:2.0:1746147266.288724:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4929 00000100:00100000:0.0:1746147266.290771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.290809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.290857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.290974:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466143616 00000100:00100000:3.0:1746147266.290983:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466143616 00000100:00100000:3.0:1746147266.291032:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466143872 00000100:00100000:3.0:1746147266.291034:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466143872 00000100:00100000:3.0:1746147266.291070:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466143744 00000100:00100000:3.0:1746147266.291072:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466143744 00000100:00100000:3.0:1746147266.291088:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 805 00000100:00100000:3.0:1746147266.291095:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+17:1957:x1830967466143616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147266.291108:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147266.291127:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a4cbf200/0xb4b2209fbdac88b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7cd5 expref: 17 pid: 14045 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.291150:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147266.291192:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+16:1957:x1830967466143616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.291198:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 805 00000100:00100000:3.0:1746147266.291212:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 806 00000100:00100000:3.0:1746147266.291216:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1956:x1830967466143872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147266.291222:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147266.291230:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a4cbfe00/0xb4b2209fbdac88c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7d06 expref: 15 pid: 14045 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.291237:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147266.291251:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+14:1956:x1830967466143872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 34us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.291256:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 806 00000100:00100000:3.0:1746147266.291265:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 807 00000100:00100000:3.0:1746147266.291269:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+13:1957:x1830967466143744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147266.291275:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147266.291281:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009e99f200/0xb4b2209fbdac88c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7cff expref: 13 pid: 14046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.291287:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147266.291300:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+12:1957:x1830967466143744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.291304:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 807 00000100:00100000:2.0:1746147266.291729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.291788:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466144256 00000100:00100000:1.0:1746147266.291793:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466144256 00000100:00100000:1.0:1746147266.291817:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16505 00000100:00100000:1.0:1746147266.291822:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+9:1955:x1830967466144256:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:1.0:1746147266.291846:0:8480:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdac88dc 00000020:00010000:1.0:1746147266.291854:0:8480:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880135312000: total 0 00000100:00080000:1.0:1746147266.291858:0:8480:0:(import.c:66:import_set_state_nolock()) ffff880135315000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746147266.291903:0:8480:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874202 00000100:00100000:1.0:1746147266.292140:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41cd127e-b323-44aa-a051-9b1183d9dd39+7:1955:x1830967466144256:12345-192.168.203.36@tcp:9:umount.0 Request processed in 316us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.292145:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16505 00000020:00010000:0.0:1746147266.292243:0:7123:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880135312000: total 0 00010000:00010000:0.0:1746147266.292271:0:7123:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880135312000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746147266.292316:0:7123:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4400/0xb4b2209fbdad3574 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0c6 expref: 6 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147266.292342:0:7123:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f08600/0xb4b2209fbdad35ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0fe expref: 5 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.292351:0:7123:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880135312000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746147266.292360:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147266.292362:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147266.292364:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147266.311057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.312270:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466144768 00000100:00100000:2.0:1746147266.312280:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466144768 00000100:00100000:2.0:1746147266.312342:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16506 00000100:00100000:2.0:1746147266.312350:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+14:1955:x1830967466144768:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:2.0:1746147266.312382:0:8478:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdac88d5 00000020:00010000:2.0:1746147266.312391:0:8478:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880130e21000: total 0 00000100:00080000:2.0:1746147266.312395:0:8478:0:(import.c:66:import_set_state_nolock()) ffff880130e22000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147266.312445:0:8478:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841539 00000020:00010000:3.0:1746147266.312457:0:9895:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880130e21000: total 0 00010000:00010000:3.0:1746147266.312462:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147266.312495:0:9895:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880130e21000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746147266.312546:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009812b200/0xb4b2209fbdad35a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f7 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.312585:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f56e600/0xb4b2209fbdad357b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0cd expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.312602:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ec200/0xb4b2209fbdad3589 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0e9 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.312614:0:9895:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880130e21000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746147266.312622:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147266.312623:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147266.312625:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147266.312647:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41cd127e-b323-44aa-a051-9b1183d9dd39+8:1955:x1830967466144768:12345-192.168.203.36@tcp:9:umount.0 Request processed in 298us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.312654:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16506 00000100:00100000:0.0:1746147266.317174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.317264:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466145152 00000100:00100000:3.0:1746147266.317274:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466145152 00000100:00100000:3.0:1746147266.317325:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11662 00000100:00100000:3.0:1746147266.317331:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+23:1955:x1830967466145152:12345-192.168.203.36@tcp:39:umount.0 00000020:00000080:3.0:1746147266.317366:0:14125:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdac88ce 00000020:00010000:3.0:1746147266.317375:0:14125:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880135314800: total 0 00000100:00080000:3.0:1746147266.317379:0:14125:0:(import.c:66:import_set_state_nolock()) ffff880135317000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147266.317832:0:14125:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945723 00000020:00010000:2.0:1746147266.318355:0:7122:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880135314800: total 0 00010000:00010000:2.0:1746147266.318399:0:7122:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880135314800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1746147266.318432:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147266.318435:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147266.318442:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093803a00/0xb4b2209fbdad31ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb9 expref: 22 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.318932:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41cd127e-b323-44aa-a051-9b1183d9dd39+21:1955:x1830967466145152:12345-192.168.203.36@tcp:39:umount.0 Request processed in 1597us (1764us total) trans 8589945724 rc 0/0 00000100:00100000:3.0:1746147266.318961:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11662 00010000:00010000:2.0:1746147266.319389:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147266.319393:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746147266.319398:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a000/0xb4b2209fbdac8976 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7da0 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.319415:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147266.319417:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147266.319420:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdad3597 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0f0 expref: 19 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.319430:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147266.319432:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147266.319434:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a551e200/0xb4b2209fbdad3344 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edfa0 expref: 18 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.319442:0:7122:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880135314800, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1746147266.319463:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147266.319464:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147266.319467:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147266.688830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.688871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.688895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.689000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.689035:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466145408 00000100:00100000:0.0:1746147266.689070:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466145408 00000100:00100000:0.0:1746147266.689113:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466145664 00000100:00100000:0.0:1746147266.689114:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466145664 00000100:00100000:0.0:1746147266.689123:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466145280 00000100:00100000:0.0:1746147266.689125:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466145280 00000100:00100000:0.0:1746147266.689136:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 808 00000100:00100000:0.0:1746147266.689142:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+14:1957:x1830967466145408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147266.689154:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.689173:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009e99fc00/0xb4b2209fbdac88ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7d5a expref: 14 pid: 14046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.689190:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.689227:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+13:1957:x1830967466145408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.689233:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 808 00000100:00100000:0.0:1746147266.689250:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 809 00000100:00100000:0.0:1746147266.689254:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+12:1958:x1830967466145664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147266.689261:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.689267:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009e99f800/0xb4b2209fbdac88f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7d61 expref: 12 pid: 14046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.689274:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.689285:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+11:1958:x1830967466145664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.689293:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 809 00000100:00100000:0.0:1746147266.689302:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 810 00000100:00100000:0.0:1746147266.689306:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+10:1956:x1830967466145280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147266.689312:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.689318:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880095371c00/0xb4b2209fbdac88e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7d30 expref: 10 pid: 14045 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.689325:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.689337:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+9:1956:x1830967466145280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.689342:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 810 00000100:00100000:3.0:1746147266.689579:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466145536 00000100:00100000:3.0:1746147266.689583:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466145536 00000100:00100000:3.0:1746147266.689626:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16507 00000100:00100000:3.0:1746147266.689632:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+5:1955:x1830967466145536:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:3.0:1746147266.689655:0:8478:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdac8906 00000100:00080000:3.0:1746147266.689663:0:8478:0:(import.c:66:import_set_state_nolock()) ffff8800a46e9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147266.689695:0:8478:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874202 00000100:00100000:3.0:1746147266.689842:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:155c2978-1f7e-40cb-a1a1-b417fd287b21+2:1955:x1830967466145536:12345-192.168.203.36@tcp:9:umount.0 Request processed in 209us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.689847:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16507 00010000:00010000:3.0:1746147266.689868:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746147266.690373:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147266.692902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.693602:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466145920 00000100:00100000:3.0:1746147266.693613:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466145920 00000100:00100000:3.0:1746147266.693851:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16508 00000100:00100000:3.0:1746147266.693861:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+6:1955:x1830967466145920:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:3.0:1746147266.693893:0:8480:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdac88ff 00000020:00010000:3.0:1746147266.693899:0:8480:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880135313800: total 0 00000100:00080000:3.0:1746147266.693904:0:8480:0:(import.c:66:import_set_state_nolock()) ffff880135311800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147266.693960:0:8480:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841539 00000100:00080000:0.0:1746147266.694184:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1746147266.694202:0:9895:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880135313800: total 0 00010000:00010000:0.0:1746147266.694232:0:9895:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880135313800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746147266.694290:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac9291 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e81f2 expref: 4 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.694388:0:9895:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880135313800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746147266.694398:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147266.694400:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147266.694402:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147266.694713:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:155c2978-1f7e-40cb-a1a1-b417fd287b21+2:1955:x1830967466145920:12345-192.168.203.36@tcp:9:umount.0 Request processed in 852us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.694721:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16508 00000100:00100000:0.0:1746147266.698706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.698825:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466146176 00000100:00100000:3.0:1746147266.698835:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466146176 00000100:00100000:3.0:1746147266.698900:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11663 00000100:00100000:3.0:1746147266.698909:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+12:1955:x1830967466146176:12345-192.168.203.36@tcp:39:umount.0 00000020:00000080:3.0:1746147266.698970:0:14125:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdac88f8 00000020:00010000:3.0:1746147266.698976:0:14125:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a46ef000: total 0 00000100:00080000:3.0:1746147266.698980:0:14125:0:(import.c:66:import_set_state_nolock()) ffff8800a46ef800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1746147266.699221:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:3.0:1746147266.699666:0:14125:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945724 00000100:00100000:3.0:1746147266.699849:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:155c2978-1f7e-40cb-a1a1-b417fd287b21+11:1955:x1830967466146176:12345-192.168.203.36@tcp:39:umount.0 Request processed in 940us (1153us total) trans 8589945725 rc 0/0 00000100:00100000:3.0:1746147266.699856:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11663 00000020:00010000:2.0:1746147266.699906:0:7122:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a46ef000: total 0 00010000:00010000:2.0:1746147266.699910:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147266.699964:0:7122:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a46ef000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1746147266.700095:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:2.0:1746147266.700099:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746147266.700107:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb4b2209fbdac8914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7d8b expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.700133:0:7122:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a46ef000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1746147266.700141:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147266.700142:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147266.700144:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147266.722186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.722305:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466146304 00000100:00100000:3.0:1746147266.722316:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466146304 00000100:00100000:3.0:1746147266.722967:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11664 00000100:00100000:3.0:1746147266.722977:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:32424:x1830967466146304:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.723004:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.723023:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee12f expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.723094:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723105:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723115:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723128:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723134:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723138:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723387:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723395:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723400:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147266.723437:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147266.723441:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:0.0:1746147266.723449:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1746147266.723455:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723464:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723470:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723475:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723480:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723485:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147266.723488:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723494:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723503:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f5dac00) 00010000:00010000:3.0:1746147266.723506:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147266.723509:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723513:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723594:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723599:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723604:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723608:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147266.723611:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723616:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723622:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134d0a800) 00010000:00010000:3.0:1746147266.723623:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147266.723626:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723630:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdad3607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.723653:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad35f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.723664:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 318 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.723669:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.723671:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147266.723673:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e68400, rc 0) 00000100:00100000:3.0:1746147266.723733:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+318:32424:x1830967466146304:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 757us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.723738:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11664 00000100:00100000:2.0:1746147266.727103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.727160:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466146560 00000100:00100000:3.0:1746147266.727169:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466146560 00000100:00100000:3.0:1746147266.727214:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11665 00000100:00100000:3.0:1746147266.727222:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+318:32424:x1830967466146560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.727242:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.727264:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee136 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.727361:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.727374:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.727381:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.727412:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.727423:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 319 pid: 14125 timeout: 753 lvb_type: 0 00000100:00100000:3.0:1746147266.727434:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467194112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.727533:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147266.728681:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967467194112:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.728701:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147266.729083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.729161:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466146688 00000100:00100000:1.0:1746147266.729167:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466146688 00010000:00010000:1.0:1746147266.729194:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 320 pid: 14125 timeout: 753 lvb_type: 0 00000100:00100000:1.0:1746147266.729279:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8471 00000100:00100000:1.0:1746147266.729287:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1957:x1830967466146688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.729300:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.729306:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 320 pid: 14125 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.729316:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 320 pid: 14125 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.729334:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68400/0xb4b2209fbdad360e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee12f expref: 320 pid: 14125 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.729362:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147266.729367:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147266.729375:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147266.729419:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147266.729441:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147266.729507:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.729514:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147266.729528:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147266.729648:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08200/0xb4b2209fbdad3615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee136 expref: 321 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.729660:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee136 expref: 320 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.729666:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.729669:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147266.729671:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08800, rc 0) 00000100:00100000:1.0:1746147266.729707:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1957:x1830967466146688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 420us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.729714:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8471 00000100:00100000:3.0:1746147266.730052:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32424:x1830967466146560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2830us (2955us total) trans 8589945726 rc 0/0 00000100:00100000:3.0:1746147266.730059:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11665 00000100:00100000:0.0:1746147266.734188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.734438:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466146944 00000100:00100000:3.0:1746147266.734448:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466146944 00000100:00100000:3.0:1746147266.734506:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11666 00000100:00100000:3.0:1746147266.734513:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32424:x1830967466146944:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.734537:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.734541:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147266.734568:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08800/0xb4b2209fbdad361c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x39b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee136 expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.734585:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.734589:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147266.734600:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad362a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee13d expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.734845:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdad3631 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.734857:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdad3631 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.734865:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdad3631 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147266.734876:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00010000:00010000:3.0:1746147266.735010:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdad362a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee13d expref: 321 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.735023:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdad3631 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee13d expref: 320 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.735029:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.735032:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147266.735034:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b7a00, rc 0) 00000100:00100000:3.0:1746147266.735618:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:32424:x1830967466146944:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1104us (1438us total) trans 8589945727 rc 0/0 00000100:00100000:3.0:1746147266.735625:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11666 00000100:00100000:0.0:1746147266.739216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.739302:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147072 00000100:00100000:0.0:1746147266.739308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.739312:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147072 00000100:00100000:0.0:1746147266.739340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.739360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.739372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.739389:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147200 00000100:00100000:2.0:1746147266.739393:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147200 00000100:00100000:0.0:1746147266.739397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.739517:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147328 00000100:00100000:3.0:1746147266.739520:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147328 00000100:00100000:3.0:1746147266.739550:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147456 00000100:00100000:3.0:1746147266.739552:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147456 00000100:00100000:3.0:1746147266.739563:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147584 00000100:00100000:3.0:1746147266.739564:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147584 00000100:00100000:3.0:1746147266.739574:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147712 00000100:00100000:3.0:1746147266.739576:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147712 00000100:00100000:3.0:1746147266.739589:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16509 00000100:00100000:3.0:1746147266.739596:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466147328:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147266.739643:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.739660:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.739668:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.739670:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.739672:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.739674:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16510 00000100:00100000:0.0:1746147266.739682:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466147456:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147266.739702:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147266.739703:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.739713:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 21 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.739714:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147266.739720:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.739721:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.739723:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.739726:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467194240:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147266.739737:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147266.739746:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 25 pid: 21080 timeout: 753 lvb_type: 1 00000100:00100000:0.0:1746147266.739755:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467194368:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.739790:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.740022:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.740039:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16511 00000100:00100000:0.0:1746147266.740057:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466147584:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147266.740075:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.740250:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16512 00000100:00100000:2.0:1746147266.740256:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466147712:12345-192.168.203.36@tcp:1:lfs.0 00000100:00080000:1.0:1746147266.740257:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147266.740260:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147266.740272:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.740278:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16513 00010000:00010000:2.0:1746147266.740281:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147266.740284:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466147200:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147266.740286:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.740287:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.740288:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.740302:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.740308:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 21 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.740308:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.740316:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147266.740320:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467194496:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147266.740320:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.740321:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.740323:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.740334:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147266.740339:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8c84540 going to sleep for 11 seconds 00010000:00010000:1.0:1746147266.740343:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 21 pid: 8478 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.740361:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467194624:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147266.740379:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e0f9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147266.740460:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.740467:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.740469:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.740470:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.740592:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16514 00010000:00010000:0.0:1746147266.740594:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.740598:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466147072:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147266.740603:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 25 pid: 8480 timeout: 753 lvb_type: 0 00000100:00100000:0.0:1746147266.740611:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467194752:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.740614:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.740624:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.740629:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.740630:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.740632:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.740635:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147266.740648:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.740656:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 25 pid: 8478 timeout: 753 lvb_type: 1 00000100:00100000:3.0:1746147266.740663:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b0c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467194880:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.740701:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147266.748215:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967467194368:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147266.748241:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.748504:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467194240:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.748522:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.749150:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967467194752:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147266.749163:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.749208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.749368:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967467194496:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147266.749381:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.749440:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967467194624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147266.749453:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.749510:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b0c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967467194880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.749522:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.749842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.749872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.749893:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148096 00000100:00100000:0.0:1746147266.749898:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148096 00010000:00010000:0.0:1746147266.749930:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 22 pid: 8481 timeout: 753 lvb_type: 1 00000100:00100000:0.0:1746147266.749970:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147840 00000100:00100000:0.0:1746147266.749972:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147840 00010000:00010000:0.0:1746147266.749983:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 26 pid: 21080 timeout: 753 lvb_type: 1 00000100:00100000:0.0:1746147266.749994:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466147968 00000100:00100000:0.0:1746147266.749995:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466147968 00010000:00010000:0.0:1746147266.750002:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 23 pid: 8478 timeout: 753 lvb_type: 1 00000100:00100000:0.0:1746147266.750013:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8472 00000100:00100000:0.0:1746147266.750019:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466148096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147266.750032:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.750065:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 23 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750075:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 23 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750101:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e037800/0xb4b2209fbdad35dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee113 expref: 23 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750129:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750131:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750136:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750144:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750162:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.750203:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967466148096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 184us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.750209:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8472 00000100:00100000:0.0:1746147266.750230:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8473 00000100:00100000:0.0:1746147266.750235:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967466147840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147266.750242:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.750256:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 26 pid: 21080 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750264:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 26 pid: 21080 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750276:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad35e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee11a expref: 26 pid: 21080 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750289:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750291:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750293:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750298:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750310:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.750323:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967466147840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 89us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.750328:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8473 00000100:00100000:0.0:1746147266.750337:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8474 00000100:00100000:0.0:1746147266.750341:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466147968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147266.750347:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.750355:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 21 pid: 8478 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750363:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 21 pid: 8478 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750372:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdad3535 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0aa expref: 21 pid: 8478 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750378:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750380:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750382:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750387:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750398:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.750411:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967466147968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.750416:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8474 00010000:00010000:3.0:1746147266.750462:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750471:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.750471:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.750486:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148224 00000100:00100000:0.0:1746147266.750488:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148224 00010000:00010000:3.0:1746147266.750492:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750498:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 20 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:3.0:1746147266.750499:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750506:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750512:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b3b6a00 already unused, calling callback (ffffffffa07dcd70) 00000100:00100000:0.0:1746147266.750512:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8475 00010000:00010000:3.0:1746147266.750515:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.750516:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967466148224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147266.750523:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750523:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.750525:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750532:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.750533:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750534:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 20 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:3.0:1746147266.750537:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdad363f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750542:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 20 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.750549:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750552:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b86f400/0xb4b2209fbdad352e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0b8 expref: 20 pid: 8481 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.750554:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.750560:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.750564:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4e3a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147266.750564:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750565:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.750567:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750567:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.750573:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750573:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.750580:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.750583:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466147328:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10987us (11241us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147266.750585:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3a00/0xb4b2209fbdad365b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750585:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147266.750592:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16509 00000100:00100000:0.0:1746147266.750600:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967466148224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.750605:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8475 00010000:00010000:3.0:1746147266.750629:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750636:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750649:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750655:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750660:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750665:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee9d000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147266.750667:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750672:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.750678:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147266.750681:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750686:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d000/0xb4b2209fbdad3646 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.750692:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148352 00000100:00100000:0.0:1746147266.750695:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148352 00010000:00010000:0.0:1746147266.750706:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 25 pid: 8478 timeout: 753 lvb_type: 1 00000100:00100000:0.0:1746147266.750718:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8476 00000100:00100000:3.0:1746147266.750719:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466147456:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 11039us (11357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.750723:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466148352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147266.750724:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16510 00010000:00010000:0.0:1746147266.750728:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147266.750737:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 24 pid: 8478 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750744:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 24 pid: 8478 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750758:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86ee00/0xb4b2209fbdad3520 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee0a3 expref: 24 pid: 8478 timeout: 753 lvb_type: 1 00010000:00010000:0.0:1746147266.750766:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750767:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.750769:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750775:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.750786:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147266.750800:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466148352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147266.750804:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8476 00000100:00100000:1.0:1746147266.750840:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967466147200:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10554us (11531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.750846:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16513 00010000:00010000:3.0:1746147266.750859:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750866:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750879:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750884:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750889:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750894:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147266.750896:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750902:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750910:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.750916:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdad3662 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.750921:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.750928:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.750958:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.750962:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466147072:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10363us (11757us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147266.750965:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.750968:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16514 00010000:00010000:2.0:1746147266.750970:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.750981:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f865e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147266.750983:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.750989:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.751006:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.751012:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdad3654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.751066:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967466147712:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10809us (11667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.751072:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16512 00000100:00100000:0.0:1746147266.752834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.753034:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148480 00000100:00100000:1.0:1746147266.753054:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148480 00010000:00010000:1.0:1746147266.753083:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 753 lvb_type: 0 00000100:00100000:1.0:1746147266.753106:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8477 00000100:00100000:1.0:1746147266.753112:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967466148480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.753123:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.753143:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.753154:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.753173:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdad35f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee128 expref: 22 pid: 8480 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.753187:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.753189:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.753193:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.753201:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.753235:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.753268:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967466148480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 156us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.753274:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8477 00010000:00010000:2.0:1746147266.753480:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753490:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753508:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753515:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753522:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753527:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee9d400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147266.753531:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753538:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753548:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.753554:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d400/0xb4b2209fbdad364d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.753601:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967466147584:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 13544us (14226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.753608:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16511 00000100:00100000:1.0:1746147266.764592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.764671:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148736 00000100:00100000:3.0:1746147266.764681:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148736 00000100:00100000:3.0:1746147266.764725:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11667 00000100:00100000:3.0:1746147266.764732:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:32424:x1830967466148736:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147266.764781:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746147266.764808:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb8800/0xb4b2209fbdad3287 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edf1b expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.764825:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb9000/0xb4b2209fbdad3199 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edea4 expref: 319 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.764837:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093802800/0xb4b2209fbdad31c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949edeb2 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.764844:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.764847:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147266.764875:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.764885:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.764896:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000040:00080000:3.0:1746147266.765570:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3523, 88 off295528 00000004:00080000:3.0:1746147266.765579:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653752641183ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.767528:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3507, 88 off294112 00000004:00080000:3.0:1746147266.767539:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653754601317ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.768197:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3508, 88 off294200 00000004:00080000:3.0:1746147266.768203:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653755265931ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.768220:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3524, 88 off295616 00000004:00080000:3.0:1746147266.768223:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653755285266ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.768730:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3525, 88 off295704 00000004:00080000:3.0:1746147266.768735:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653755797104ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.768744:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3509, 88 off294288 00000004:00080000:3.0:1746147266.768747:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653755809647ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.768765:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3510, 88 off294376 00000004:00080000:3.0:1746147266.768768:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653755830881ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.768775:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3511, 88 off294464 00000004:00080000:3.0:1746147266.768779:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653755841780ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.768786:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3526, 88 off295792 00000004:00080000:3.0:1746147266.768848:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653755851051ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.769297:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3512, 88 off294552 00000004:00080000:3.0:1746147266.769301:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653756363780ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.769311:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3527, 88 off295880 00000004:00080000:3.0:1746147266.769314:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653756376642ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.769322:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3513, 88 off294640 00000004:00080000:3.0:1746147266.769325:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653756387894ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.769332:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3528, 88 off295968 00000004:00080000:3.0:1746147266.769334:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653756396799ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.769341:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3529, 88 off296056 00000004:00080000:3.0:1746147266.769343:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653756405727ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.769349:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3530, 88 off296144 00000004:00080000:3.0:1746147266.769351:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653756413682ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.769356:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3531, 88 off296232 00000004:00080000:3.0:1746147266.769362:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653756424490ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.769368:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3514, 88 off294728 00000004:00080000:3.0:1746147266.769370:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653756433140ns, next at 607576201812ns, rc = 0 00000004:00010000:3.0:1746147266.796746:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880134f85880 reply state ffff880136616c00 transno 8589945728 ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147266.796759:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147266.796871:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:32424:x1830967466148736:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 32135us (32285us total) trans 8589945728 rc 0/0 00000100:00100000:3.0:1746147266.796881:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11667 00000001:00080000:1.0:1746147266.796955:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945721 is committed 00000001:00080000:1.0:1746147266.796965:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945705 is committed 00000001:00080000:1.0:1746147266.796990:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945713 is committed 00000001:00080000:1.0:1746147266.796998:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945712 is committed 00000001:00080000:1.0:1746147266.797011:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945723 is committed 00000001:00080000:1.0:1746147266.797014:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945722 is committed 00000001:00080000:1.0:1746147266.797020:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945715 is committed 00000001:00080000:1.0:1746147266.797049:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945728 is committed 00000004:00080000:1.0:1746147266.797054:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2640 committed 00000004:00080000:1.0:1746147266.797060:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2652 committed 00000004:00080000:1.0:1746147266.797065:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2651 committed 00000004:00080000:1.0:1746147266.797068:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2650 committed 00000004:00080000:1.0:1746147266.797070:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2649 committed 00000004:00080000:1.0:1746147266.797071:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2639 committed 00000004:00080000:1.0:1746147266.797073:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2648 committed 00000004:00080000:1.0:1746147266.797075:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2638 committed 00000004:00080000:1.0:1746147266.797076:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2647 committed 00000004:00080000:1.0:1746147266.797078:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2637 committed 00000004:00080000:1.0:1746147266.797079:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2636 committed 00000004:00080000:1.0:1746147266.797081:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2635 committed 00000004:00080000:1.0:1746147266.797083:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2646 committed 00000004:00080000:1.0:1746147266.797085:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2645 committed 00000004:00080000:1.0:1746147266.797086:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2634 committed 00000004:00080000:1.0:1746147266.797088:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2633 committed 00000004:00080000:1.0:1746147266.797090:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2644 committed 00000001:00100000:1.0:1746147266.797099:0:14137:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 155c2978-1f7e-40cb-a1a1-b417fd287b21 00000001:00080000:1.0:1746147266.797104:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945725 is committed 00000001:00100000:1.0:1746147266.797107:0:14137:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41cd127e-b323-44aa-a051-9b1183d9dd39 00000001:00080000:1.0:1746147266.797112:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945724 is committed 00000020:00000080:1.0:1746147266.797126:0:14137:0:(genops.c:904:class_export_put()) final put ffff8800a46ef000/155c2978-1f7e-40cb-a1a1-b417fd287b21 00000020:00000080:1.0:1746147266.797147:0:14137:0:(genops.c:904:class_export_put()) final put ffff880135314800/41cd127e-b323-44aa-a051-9b1183d9dd39 00000100:00100000:0.0:1746147266.797686:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.797736:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.797785:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.797801:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.797817:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147266.797821:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.797833:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.797842:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.797853:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746147266.798127:0:284:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a46ef000/155c2978-1f7e-40cb-a1a1-b417fd287b21 for lustre-MDT0000 00000020:00000080:2.0:1746147266.798180:0:284:0:(genops.c:863:class_export_destroy()) destroying export ffff880135314800/41cd127e-b323-44aa-a051-9b1183d9dd39 for lustre-MDT0000 00000020:00000080:2.0:1746147266.798215:0:284:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a46ef800 for lustre-MDT0000 00000020:00000080:2.0:1746147266.798219:0:284:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880135317000 for lustre-MDT0000 00000100:00100000:2.0:1746147266.798230:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.798255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.798280:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.798298:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.798311:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147266.798314:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.798328:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.798338:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196672:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.798350:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.798371:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195136 00000100:00100000:2.0:1746147266.798377:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195136 00000100:00100000:2.0:1746147266.798409:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195648 00000100:00100000:2.0:1746147266.798411:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195648 00000100:00100000:2.0:1746147266.798419:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195264 00000100:00100000:2.0:1746147266.798421:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195264 00000100:00100000:2.0:1746147266.798429:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195776 00000100:00100000:2.0:1746147266.798431:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195776 00000100:00100000:2.0:1746147266.798436:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196288 00000100:00100000:2.0:1746147266.798438:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196288 00000100:00100000:2.0:1746147266.798448:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16515 00000100:00100000:2.0:1746147266.798454:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467195136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.798629:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1830967467195136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (894us total) trans 21474841540 rc 0/0 00000100:00100000:2.0:1746147266.798635:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16515 00000100:00100000:2.0:1746147266.798644:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196800 00000100:00100000:2.0:1746147266.798646:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196800 00000100:00100000:2.0:1746147266.798652:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196160 00000100:00100000:2.0:1746147266.798653:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196160 00000100:00100000:2.0:1746147266.798659:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196672 00000100:00100000:2.0:1746147266.798660:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196672 00000100:00100000:2.0:1746147266.798667:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16516 00000100:00100000:2.0:1746147266.798671:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467195648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.798792:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1830967467195648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (989us total) trans 21474841541 rc 0/0 00000100:00100000:2.0:1746147266.798797:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16516 00000100:00100000:2.0:1746147266.798805:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16517 00000100:00100000:2.0:1746147266.798809:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467195264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.798877:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1830967467195264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1042us total) trans 21474841542 rc 0/0 00000100:00100000:2.0:1746147266.798882:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16517 00000100:00100000:2.0:1746147266.798889:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16518 00000100:00100000:2.0:1746147266.798892:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1830967467195776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.798978:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1830967467195776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1124us total) trans 21474841543 rc 0/0 00000100:00100000:2.0:1746147266.798983:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16518 00000100:00100000:2.0:1746147266.798990:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16519 00000100:00100000:2.0:1746147266.798994:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967467196288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.799109:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830967467196288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (853us total) trans 17179874203 rc 0/0 00000100:00100000:2.0:1746147266.799113:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16519 00000100:00100000:2.0:1746147266.799120:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16520 00000100:00100000:2.0:1746147266.799124:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967467196800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.799216:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830967467196800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (916us total) trans 17179874204 rc 0/0 00000100:00100000:2.0:1746147266.799220:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16520 00000100:00100000:2.0:1746147266.799330:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16521 00000100:00100000:2.0:1746147266.799335:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967467196160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.799406:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830967467196160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1076us total) trans 17179874205 rc 0/0 00000100:00100000:2.0:1746147266.799411:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16521 00000100:00100000:2.0:1746147266.799417:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16522 00000100:00100000:2.0:1746147266.799421:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967467196672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.799486:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830967467196672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1135us total) trans 17179874206 rc 0/0 00000100:00100000:2.0:1746147266.799491:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16522 00000100:00100000:2.0:1746147266.799534:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874198 gen 2 00000004:00080000:2.0:1746147266.799539:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448700, transno 17179874114 00000004:00080000:2.0:1746147266.799544:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a044b480, transno 17179874115 00000004:00080000:2.0:1746147266.799546:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448380, transno 17179874116 00000004:00080000:2.0:1746147266.799548:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448a80, transno 17179874117 00000004:00080000:2.0:1746147266.799550:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0449880, transno 17179874118 00000004:00080000:2.0:1746147266.799552:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a044ad80, transno 17179874119 00000004:00080000:2.0:1746147266.799554:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0449c00, transno 17179874120 00000004:00080000:2.0:1746147266.799556:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f152d80, transno 17179874121 00000004:00080000:2.0:1746147266.799558:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0449500, transno 17179874122 00000004:00080000:2.0:1746147266.799560:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5d880, transno 17179874126 00000004:00080000:2.0:1746147266.799563:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919880, transno 17179874127 00000004:00080000:2.0:1746147266.799564:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5c700, transno 17179874128 00000004:00080000:2.0:1746147266.799566:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5e680, transno 17179874129 00000004:00080000:2.0:1746147266.799569:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919500, transno 17179874130 00000004:00080000:2.0:1746147266.799571:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448000, transno 17179874131 00000004:00080000:2.0:1746147266.799573:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e919180, transno 17179874132 00000004:00080000:2.0:1746147266.799575:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e91ad80, transno 17179874133 00000004:00080000:2.0:1746147266.799578:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0c380, transno 17179874134 00000004:00080000:2.0:1746147266.799580:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dfb80, transno 17179874135 00000004:00080000:2.0:1746147266.799583:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd880, transno 17179874136 00000004:00080000:2.0:1746147266.799585:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e681880, transno 17179874137 00000004:00080000:2.0:1746147266.799587:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df480, transno 17179874138 00000004:00080000:2.0:1746147266.799589:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e681180, transno 17179874139 00000004:00080000:2.0:1746147266.799591:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcaa00, transno 17179874140 00000004:00080000:2.0:1746147266.799593:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c2300, transno 17179874141 00000004:00080000:2.0:1746147266.799596:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd180, transno 17179874142 00000004:00080000:2.0:1746147266.799598:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e680e00, transno 17179874143 00000004:00080000:2.0:1746147266.799600:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f1500, transno 17179874151 00000004:00080000:2.0:1746147266.799602:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f0a80, transno 17179874152 00000004:00080000:2.0:1746147266.799604:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f1880, transno 17179874153 00000004:00080000:2.0:1746147266.799606:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f0e00, transno 17179874154 00000004:00080000:2.0:1746147266.799608:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f1c00, transno 17179874155 00000004:00080000:2.0:1746147266.799610:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f2300, transno 17179874156 00000004:00080000:2.0:1746147266.799612:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f1180, transno 17179874157 00000004:00080000:2.0:1746147266.799614:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f1f80, transno 17179874158 00000004:00080000:2.0:1746147266.799616:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478c380, transno 17179874159 00000004:00080000:2.0:1746147266.799619:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478d500, transno 17179874160 00000004:00080000:2.0:1746147266.799621:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478e300, transno 17179874161 00000004:00080000:2.0:1746147266.799623:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478ca80, transno 17179874162 00000004:00080000:2.0:1746147266.799625:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478d880, transno 17179874163 00000004:00080000:2.0:1746147266.799627:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478dc00, transno 17179874164 00000004:00080000:2.0:1746147266.799629:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478ce00, transno 17179874165 00000004:00080000:2.0:1746147266.799630:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478f480, transno 17179874166 00000004:00080000:2.0:1746147266.799632:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478d180, transno 17179874167 00000004:00080000:2.0:1746147266.799634:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a478df80, transno 17179874168 00000004:00080000:2.0:1746147266.799636:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f1500, transno 17179874181 00000004:00080000:2.0:1746147266.799638:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5ca300, transno 17179874182 00000004:00080000:2.0:1746147266.799641:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cbb80, transno 17179874183 00000004:00080000:2.0:1746147266.799643:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3480, transno 17179874184 00000004:00080000:2.0:1746147266.799645:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c85ca80, transno 17179874185 00000004:00080000:2.0:1746147266.799647:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c85f800, transno 17179874186 00000004:00080000:2.0:1746147266.799649:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c85ed80, transno 17179874187 00000004:00080000:2.0:1746147266.799651:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8e00, transno 17179874188 00000004:00080000:2.0:1746147266.799653:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3100, transno 17179874189 00000004:00080000:2.0:1746147266.799655:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5caa00, transno 17179874190 00000004:00080000:2.0:1746147266.799656:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8a80, transno 17179874191 00000004:00080000:2.0:1746147266.799658:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cb100, transno 17179874192 00000004:00080000:2.0:1746147266.799660:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cad80, transno 17179874193 00000004:00080000:2.0:1746147266.799661:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b0c1f80, transno 17179874194 00000004:00080000:2.0:1746147266.799663:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb70e00, transno 17179874195 00000004:00080000:2.0:1746147266.799665:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cb480, transno 17179874196 00000004:00080000:2.0:1746147266.799667:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb71f80, transno 17179874197 00000004:00080000:2.0:1746147266.799668:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8380, transno 17179874198 00000100:00100000:2.0:1746147266.799674:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009e584700 x1830967467196160/t17179874205(17179874205) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147282 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746147266.799684:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584700/2, rc 0, transno 17179874205 00000100:00100000:2.0:1746147266.799687:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196160:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147266.799696:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584000/2, rc 0, transno 17179874206 00000100:00100000:2.0:1746147266.799698:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196672:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147266.799703:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584a80/2, rc 0, transno 17179874203 00000100:00100000:2.0:1746147266.799705:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196288:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147266.799709:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e587480/2, rc 0, transno 17179874204 00000100:00100000:2.0:1746147266.799711:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467196800:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147266.799871:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.799880:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.799887:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.799892:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147266.799897:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.799907:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.799931:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.799934:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147266.799955:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.799961:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09c00/0xb4b2209fbdad3669 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147266.800087:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467195008:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147266.800102:0:14094:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 63 done 00000100:00100000:3.0:1746147266.800114:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.800135:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195008 00000100:00100000:2.0:1746147266.800140:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195008 00000100:00100000:2.0:1746147266.800158:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16523 00000100:00100000:2.0:1746147266.800162:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1830967467195008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.800255:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3296:x1830967467195008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (139us total) trans 21474841544 rc 0/0 00000100:00100000:2.0:1746147266.800260:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16523 00000100:00100000:1.0:1746147266.800344:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467195392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147266.800367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147266.801052:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195392 00000100:00100000:1.0:1746147266.801057:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195392 00000100:00100000:3.0:1746147266.801073:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841532 gen 2 00000100:00100000:1.0:1746147266.801076:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16524 00000004:00080000:3.0:1746147266.801077:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb72d80, transno 21474841463 00000100:00100000:1.0:1746147266.801080:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1830967467195392:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147266.801084:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb71c00, transno 21474841464 00000004:00080000:3.0:1746147266.801086:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb71880, transno 21474841465 00000004:00080000:3.0:1746147266.801088:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb73100, transno 21474841466 00000004:00080000:3.0:1746147266.801091:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb70380, transno 21474841467 00000004:00080000:3.0:1746147266.801093:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb70700, transno 21474841468 00000004:00080000:3.0:1746147266.801095:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb72680, transno 21474841469 00000004:00080000:3.0:1746147266.801097:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb73b80, transno 21474841470 00000004:00080000:3.0:1746147266.801099:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4673b80, transno 21474841474 00000004:00080000:3.0:1746147266.801101:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc700, transno 21474841475 00000004:00080000:3.0:1746147266.801104:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4671880, transno 21474841476 00000004:00080000:3.0:1746147266.801106:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddc00, transno 21474841477 00000004:00080000:3.0:1746147266.801108:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddf80, transno 21474841478 00000004:00080000:3.0:1746147266.801110:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd500, transno 21474841479 00000004:00080000:3.0:1746147266.801113:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dea00, transno 21474841480 00000004:00080000:3.0:1746147266.801115:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4fae680, transno 21474841481 00000004:00080000:3.0:1746147266.801118:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f044000, transno 21474841482 00000004:00080000:3.0:1746147266.801120:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f733b80, transno 21474841483 00000004:00080000:3.0:1746147266.801122:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046680, transno 21474841484 00000004:00080000:3.0:1746147266.801125:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9f80, transno 21474841485 00000004:00080000:3.0:1746147266.801127:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047800, transno 21474841486 00000004:00080000:3.0:1746147266.801129:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8000, transno 21474841487 00000004:00080000:3.0:1746147266.801131:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046300, transno 21474841488 00000004:00080000:3.0:1746147266.801133:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9180, transno 21474841489 00000004:00080000:3.0:1746147266.801135:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9500, transno 21474841494 00000004:00080000:3.0:1746147266.801137:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f0700, transno 21474841495 00000004:00080000:3.0:1746147266.801139:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e682a00, transno 21474841496 00000004:00080000:3.0:1746147266.801141:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047480, transno 21474841497 00000004:00080000:3.0:1746147266.801143:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9880, transno 21474841498 00000004:00080000:3.0:1746147266.801145:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f0000, transno 21474841499 00000004:00080000:3.0:1746147266.801147:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9c00, transno 21474841500 00000004:00080000:3.0:1746147266.801149:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f0380, transno 21474841501 00000004:00080000:3.0:1746147266.801151:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ba1880, transno 21474841502 00000004:00080000:3.0:1746147266.801153:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f151180, transno 21474841503 00000004:00080000:3.0:1746147266.801155:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ba1c00, transno 21474841504 00000004:00080000:3.0:1746147266.801157:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f150000, transno 21474841505 00000004:00080000:3.0:1746147266.801159:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ba2d80, transno 21474841506 00000004:00080000:3.0:1746147266.801162:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f2680, transno 21474841507 00000004:00080000:3.0:1746147266.801164:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ba1f80, transno 21474841508 00000004:00080000:3.0:1746147266.801166:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3f2a00, transno 21474841509 00000004:00080000:3.0:1746147266.801168:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f68700, transno 21474841517 00000004:00080000:3.0:1746147266.801170:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f6b100, transno 21474841518 00000004:00080000:3.0:1746147266.801172:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134f84380, transno 21474841519 00000004:00080000:3.0:1746147266.801175:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f6b480, transno 21474841520 00000004:00080000:3.0:1746147266.801177:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f69880, transno 21474841521 00000004:00080000:3.0:1746147266.801179:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f69500, transno 21474841522 00000004:00080000:3.0:1746147266.801182:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f68a80, transno 21474841523 00000004:00080000:3.0:1746147266.801183:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099f6a680, transno 21474841524 00000004:00080000:3.0:1746147266.801186:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fd500, transno 21474841525 00000004:00080000:3.0:1746147266.801188:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed7b80, transno 21474841526 00000004:00080000:3.0:1746147266.801190:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed6680, transno 21474841527 00000004:00080000:3.0:1746147266.801192:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fca80, transno 21474841528 00000004:00080000:3.0:1746147266.801194:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed5880, transno 21474841529 00000004:00080000:3.0:1746147266.801196:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed5f80, transno 21474841530 00000004:00080000:3.0:1746147266.801198:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f9fe680, transno 21474841531 00000004:00080000:3.0:1746147266.801201:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134ed4700, transno 21474841532 00000100:00100000:3.0:1746147266.801205:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009050a680 x1830967467195008/t21474841544(21474841544) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147282 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:1.0:1746147266.801212:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3295:x1830967467195392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (845us total) trans 21474841545 rc 0/0 00000004:00080000:3.0:1746147266.801214:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050a680/2, rc 0, transno 21474841544 00000100:00100000:3.0:1746147266.801217:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467195008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147266.801218:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16524 00000100:00100000:3.0:1746147266.801223:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467195520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.801240:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746147266.801245:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147266.801248:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147266.801256:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467196032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147266.801260:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195520 00000100:00100000:1.0:1746147266.801262:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195520 00000100:00100000:3.0:1746147266.801270:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147266.801273:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196032 00000100:00100000:1.0:1746147266.801274:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196032 00000100:00100000:3.0:1746147266.801278:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467196544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147266.801286:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16525 00000100:00100000:1.0:1746147266.801290:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3296:x1830967467195520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.801291:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.801303:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467197056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147266.801316:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.801332:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196544 00000100:00100000:3.0:1746147266.801335:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196544 00000100:00100000:3.0:1746147266.801346:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467197056 00000100:00100000:3.0:1746147266.801347:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467197056 00000100:00100000:3.0:1746147266.801355:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16526 00000100:00100000:3.0:1746147266.801358:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3296:x1830967467196032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147266.801393:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467195520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (152us total) trans 21474841546 rc 0/0 00000100:00100000:1.0:1746147266.801399:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16525 00000100:00100000:1.0:1746147266.801408:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16527 00000100:00100000:1.0:1746147266.801412:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3296:x1830967467196544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147266.801436:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16528 00000100:00100000:3.0:1746147266.801440:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830967467197056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147266.801494:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967467196544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (202us total) trans 17179874207 rc 0/0 00000100:00100000:1.0:1746147266.801499:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16527 00000100:00100000:3.0:1746147266.801511:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467197056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (194us total) trans 17179874208 rc 0/0 00000100:00100000:3.0:1746147266.801516:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16528 00000100:00100000:3.0:1746147266.801578:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1830967467196032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (307us total) trans 17179874209 rc 0/0 00000100:00100000:3.0:1746147266.801582:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16526 00000004:00080000:3.0:1746147266.801602:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050aa00/2, rc 0, transno 21474841545 00000100:00100000:3.0:1746147266.801605:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467195392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.801610:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467195904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.801626:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.801637:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467196416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147266.801652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.801660:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467196928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147266.801672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.801688:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467195904 00000100:00100000:3.0:1746147266.801690:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467195904 00000100:00100000:3.0:1746147266.801714:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196416 00000100:00100000:3.0:1746147266.801716:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196416 00000100:00100000:3.0:1746147266.801724:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467196928 00000100:00100000:3.0:1746147266.801725:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467196928 00000100:00100000:3.0:1746147266.801734:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16529 00000100:00100000:3.0:1746147266.801737:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967467195904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.801818:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467195904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (191us total) trans 21474841547 rc 0/0 00000100:00100000:3.0:1746147266.801823:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16529 00000100:00100000:3.0:1746147266.801831:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16530 00000100:00100000:3.0:1746147266.801835:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467196416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147266.801918:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967467196416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (265us total) trans 17179874210 rc 0/0 00000100:00100000:3.0:1746147266.801922:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16530 00000100:00100000:3.0:1746147266.801930:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16531 00000100:00100000:3.0:1746147266.801933:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967467196928:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147266.802052:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050ad80/2, rc 0, transno 21474841542 00000100:00100000:0.0:1746147266.802056:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.802583:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967467196928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 641us (902us total) trans 17179874211 rc 0/0 00000100:00100000:3.0:1746147266.802594:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16531 00000004:00080000:3.0:1746147266.802658:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509c00/2, rc 0, transno 21474841547 00000100:00100000:3.0:1746147266.802663:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467195904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147266.802672:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584380/2, rc 0, transno 17179874210 00000100:00100000:3.0:1746147266.802675:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467196416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.802680:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e586680/2, rc 0, transno 17179874211 00000100:00100000:3.0:1746147266.802682:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467196928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.802699:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585f80/2, rc 0, transno 17179874208 00000100:00100000:3.0:1746147266.802701:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467197056:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.802708:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050a300/2, rc 0, transno 21474841546 00000100:00100000:3.0:1746147266.802711:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467195520:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147266.802720:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585880/2, rc 0, transno 17179874209 00000100:00100000:3.0:1746147266.802722:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467196032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.802728:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585500/2, rc 0, transno 17179874207 00000100:00100000:3.0:1746147266.802731:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467196544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147266.802745:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b480/2, rc 0, transno 21474841543 00000100:00100000:0.0:1746147266.802750:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195776:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147266.802759:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509180/2, rc 0, transno 21474841540 00000100:00100000:0.0:1746147266.802762:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147266.802769:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b800/2, rc 0, transno 21474841541 00000100:00100000:0.0:1746147266.802771:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467195648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147266.803227:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 56 done 00000100:00100000:1.0:1746147266.803250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.803315:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148864 00000100:00100000:3.0:1746147266.803321:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148864 00000100:00100000:3.0:1746147266.803346:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11668 00000100:00100000:3.0:1746147266.803351:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32424:x1830967466148864:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.803409:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.803425:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee144 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.803469:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.803481:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.803496:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.803498:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147266.803501:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aeba00, rc 0) 00000100:00100000:3.0:1746147266.803566:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32424:x1830967466148864:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 214us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.803570:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11668 00000100:00100000:2.0:1746147266.806280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.806326:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466148992 00000100:00100000:3.0:1746147266.806336:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466148992 00000100:00100000:3.0:1746147266.806388:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11669 00000100:00100000:3.0:1746147266.806396:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32424:x1830967466148992:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.806448:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.806465:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad3677 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee14b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.806548:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad367e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.806557:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad367e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.806564:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad367e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147266.806583:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x39b:0x0]: returning size 16777217 00000004:00200000:3.0:1746147266.806586:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147266.806597:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad367e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.806614:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeb200/0xb4b2209fbdad3677 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee14b expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.806623:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad367e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee14b expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.806628:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.806629:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147266.806632:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130aea400, rc 0) 00000100:00100000:3.0:1746147266.806677:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32424:x1830967466148992:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 281us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.806682:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11669 00000100:00100000:0.0:1746147266.808159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.808190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.808239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.808263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.808289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.808322:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466149120 00000100:00100000:3.0:1746147266.808328:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466149120 00000100:00100000:0.0:1746147266.808343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.808364:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466149376 00000100:00100000:3.0:1746147266.808366:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466149376 00000100:00100000:3.0:1746147266.808377:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466149248 00000100:00100000:3.0:1746147266.808379:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466149248 00000100:00100000:2.0:1746147266.808384:0:7558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466149504 00000100:00100000:2.0:1746147266.808386:0:7558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466149504 00000100:00100000:3.0:1746147266.808388:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466149632 00000100:00100000:3.0:1746147266.808389:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466149632 00000100:00100000:3.0:1746147266.808398:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466149760 00000100:00100000:3.0:1746147266.808399:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466149760 00000100:00100000:2.0:1746147266.808405:0:7558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16532 00000100:00100000:3.0:1746147266.808418:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16533 00000100:00100000:3.0:1746147266.808423:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967466149376:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.808435:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147266.808447:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16534 00010000:00010000:3.0:1746147266.808451:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee160 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.808453:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967466149248:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147266.808459:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147266.808466:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee159 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147266.808471:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 2097152, mtime: 0x681417c1, atime: 0x681417c1, ctime: 0x681417c1, blocks: 0x821 00002000:00010000:1.0:1746147266.808476:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 2097152, mtime: 0x681417c1, atime: 0x681417c0, ctime: 0x681417c0, blocks: 0x821 00010000:00010000:3.0:1746147266.808485:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.808485:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.808487:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.808487:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.808494:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147266.808494:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.808505:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147266.808505:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.808514:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864c00, rc 0) 00010000:00010000:1.0:1746147266.808514:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551ea00, rc 0) 00000100:00100000:2.0:1746147266.808539:0:7558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967466149120:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147266.808544:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967466149376:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 120us (353us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147266.808547:0:7558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147266.808548:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16533 00010000:00010000:2.0:1746147266.808558:0:7558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee152 expref: -99 pid: 7558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.808561:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16535 00000100:00100000:3.0:1746147266.808565:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967466149632:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.808569:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746147266.808573:0:7558:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 1048576, mtime: 0x681417bd, atime: 0x681417bd, ctime: 0x681417bd, blocks: 0x821 00010000:00010000:3.0:1746147266.808575:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee16e expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.808581:0:7558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.808582:0:7558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746147266.808584:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 4972704, mtime: 0x681417c1, atime: 0x681417c1, ctime: 0x681417c1, blocks: 0x163f 00010000:00010000:2.0:1746147266.808586:0:7558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 23 pid: 7558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.808590:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.808591:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.808593:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.808594:0:7558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.808600:0:7558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948d8400, rc 0) 00010000:00010000:3.0:1746147266.808601:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.808607:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864600, rc 0) 00000100:00100000:1.0:1746147266.808836:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466149248:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 381us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.808841:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16534 00000100:00100000:1.0:1746147266.808852:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16536 00000100:00100000:1.0:1746147266.808857:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466149504:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147266.808863:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147266.808871:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee167 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147266.808882:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 2097152, mtime: 0x681417c1, atime: 0x681417bf, ctime: 0x681417c1, blocks: 0x821 00010000:00010000:1.0:1746147266.808888:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.808890:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.808893:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147266.808902:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147266.808908:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a551e200, rc 0) 00000100:00100000:1.0:1746147266.808924:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466149504:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 66us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.808932:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16536 00000100:00100000:1.0:1746147266.808970:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16537 00000100:00100000:1.0:1746147266.808975:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967466149760:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147266.808981:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147266.808990:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee175 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147266.809002:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 4194304, mtime: 0x681417c1, atime: 0x681417c1, ctime: 0x681417c1, blocks: 0x102b 00010000:00010000:1.0:1746147266.809010:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.809011:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.809015:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147266.809023:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147266.809028:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e3200, rc 0) 00000100:00100000:1.0:1746147266.809057:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466149760:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 82us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.809062:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16537 00000100:00100000:2.0:1746147266.809470:0:7558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967466149120:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1057us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.809477:0:7558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16532 00000100:00100000:3.0:1746147266.810038:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466149632:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1470us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.810054:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16535 00000100:00100000:0.0:1746147266.819476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.819530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.820547:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466150016 00000100:00100000:3.0:1746147266.820557:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466150016 00000100:00100000:3.0:1746147266.820620:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466150272 00000100:00100000:3.0:1746147266.820622:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466150272 00000100:00100000:3.0:1746147266.820653:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7914 00000100:00100000:3.0:1746147266.820661:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466150016:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:1.0:1746147266.820674:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7915 00000100:00100000:1.0:1746147266.820683:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466150272:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147266.820699:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 3/1,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.820704:0:8486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.820718:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.820718:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.820721:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.820721:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.820725:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.820725:0:8486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.820736:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.820736:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.826275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.826703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.826749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.827248:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466150528 00000100:00100000:0.0:1746147266.827259:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466150528 00000100:00100000:0.0:1746147266.827448:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466150784 00000100:00100000:0.0:1746147266.827451:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466150784 00000100:00100000:1.0:1746147266.827452:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466151040 00000100:00100000:1.0:1746147266.827457:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466151040 00000100:00100000:0.0:1746147266.827473:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7916 00000100:00100000:0.0:1746147266.827480:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967466150528:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:1.0:1746147266.827489:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7917 00000100:00100000:1.0:1746147266.827495:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967466150784:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147266.827516:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.827516:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.827530:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.827530:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.827532:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.827532:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.827536:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.827536:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.827548:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.827548:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.827895:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7918 00000100:00100000:1.0:1746147266.827901:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967466151040:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147266.827916:0:26114:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.827928:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.827929:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.827932:0:26114:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.828868:0:26114:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.830172:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.831063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.831094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.831172:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466151296 00000100:00100000:3.0:1746147266.831181:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466151296 00000100:00100000:3.0:1746147266.831229:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466151552 00000100:00100000:3.0:1746147266.831232:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466151552 00000100:00100000:3.0:1746147266.831246:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466151808 00000100:00100000:3.0:1746147266.831247:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466151808 00000100:00100000:3.0:1746147266.831263:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7919 00000100:00100000:3.0:1746147266.831271:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466151296:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147266.831304:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.831318:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.831319:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.831323:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.831336:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.832299:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7920 00000100:00100000:1.0:1746147266.832309:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967466151552:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147266.832334:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.832344:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.832345:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.832349:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.832359:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.833194:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7921 00000100:00100000:0.0:1746147266.833202:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466151808:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147266.833223:0:21472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.833231:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.833233:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147266.833236:0:21472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147266.833244:0:21472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839443:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839481:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839488:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839494:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f864a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147266.839497:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839510:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839528:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.839533:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdad36af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.840853:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967466150016:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 20185us (21381us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147266.840864:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7914 00010000:00010000:1.0:1746147266.844808:0:8486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.844826:0:8486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.844834:0:8486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.844842:0:8486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485a800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147266.844846:0:8486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.844854:0:8486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.844877:0:8486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.844883:0:8486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdad36b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.846302:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466150272:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 25610us (26761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147266.846315:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7915 00010000:00010000:2.0:1746147266.855159:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.855177:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.855185:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.855191:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147266.855196:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.855204:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.855223:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.855229:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f08e00/0xb4b2209fbdad36bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.855341:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967466150784:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 27840us (28632us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147266.855352:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7917 00010000:00010000:3.0:1746147266.866461:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.866476:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.866488:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.866493:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f865800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147266.866497:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.866505:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.866521:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.866526:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdad36d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147266.866606:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967466151296:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 35333us (36436us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147266.866615:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7919 00010000:00010000:1.0:1746147266.867858:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.867873:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.867880:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.867886:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147266.867889:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.867896:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.867912:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.867919:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f08800/0xb4b2209fbdad36d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.868026:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967466151552:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 35715us (36961us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147266.868037:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7920 00010000:00010000:1.0:1746147266.871756:0:26114:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.871773:0:26114:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.871781:0:26114:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.871786:0:26114:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147266.871790:0:26114:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.871797:0:26114:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.871816:0:26114:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.871823:0:26114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f09200/0xb4b2209fbdad36cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.871902:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967466151040:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 43996us (45146us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147266.871911:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7918 00010000:00010000:2.0:1746147266.874716:0:21472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.874734:0:21472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.874742:0:21472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.874748:0:21472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a47b1e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147266.874752:0:21472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.874760:0:21472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.874777:0:21472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.874783:0:21472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1e00/0xb4b2209fbdad36e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.876080:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967466151808:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 42871us (44977us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147266.876092:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7921 00010000:00010000:2.0:1746147266.876983:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.876996:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.877003:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.877009:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a47b1a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147266.877013:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.877019:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.877034:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.877049:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdad36c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147266.877098:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967466150528:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 49616us (50830us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147266.877105:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7916 00000100:00100000:0.0:1746147266.885359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.885444:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152064 00000100:00100000:3.0:1746147266.885452:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152064 00000100:00100000:3.0:1746147266.885499:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11670 00000100:00100000:3.0:1746147266.885506:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32424:x1830967466152064:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147266.885544:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147266.885563:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aea400/0xb4b2209fbdad367e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x39b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee14b expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.885592:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.885595:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147266.885621:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.885630:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147266.886516:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00010000:3.0:1746147266.886991:0:14125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012bfe2680 reply state ffff880093b36000 transno 8589945729 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147266.886998:0:14125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147266.887455:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:32424:x1830967466152064:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 1946us (2099us total) trans 8589945729 rc 0/0 00000100:00100000:3.0:1746147266.887462:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11670 00010000:00010000:2.0:1746147266.892287:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147266.892299:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147266.892309:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147266.892314:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f864e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147266.892318:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147266.892323:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147266.892337:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:2.0:1746147266.892339:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147266.892342:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147266.892347:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f864e00/0xb4b2209fbdad36e7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147266.893381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.893464:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152192 00000100:00100000:2.0:1746147266.893472:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152192 00000100:00100000:2.0:1746147266.893508:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16538 00000100:00100000:2.0:1746147266.893515:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32424:x1830967466152192:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147266.893527:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147266.893542:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf400/0xb4b2209fbdad36ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee17c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.893565:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.893572:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.893573:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.893576:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf400/0xb4b2209fbdad36ee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee17c expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.893601:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.893611:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 753 lvb_type: 1 00000100:00100000:2.0:1746147266.893621:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467197184:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147266.893699:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.896697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.896884:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467197184:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147266.896904:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf400/0xb4b2209fbdad36ee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee17c expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.896917:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbf400, rc 0) 00000100:00100000:2.0:1746147266.896976:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32424:x1830967466152192:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3461us (3600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.896983:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16538 00000100:00100000:1.0:1746147266.897065:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152320 00000100:00100000:1.0:1746147266.897070:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152320 00010000:00010000:1.0:1746147266.897091:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.897110:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8478 00000100:00100000:1.0:1746147266.897115:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466152320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.897123:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.897140:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.897150:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.897169:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdad3693 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x423:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee152 expref: 24 pid: 7558 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.897328:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.897330:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.897337:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf400/0xb4b2209fbdad36ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee17c expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.897343:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf400/0xb4b2209fbdad36ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee17c expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.897368:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbf400/0xb4b2209fbdad36ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee17c expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.897377:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467197312:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147266.897433:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147266.899521:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467197312:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147266.899541:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.899571:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466152320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2455us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.899579:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8478 00000100:00100000:0.0:1746147266.900304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.900401:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152448 00000100:00100000:2.0:1746147266.900407:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152448 00000100:00100000:2.0:1746147266.900433:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16539 00000100:00100000:2.0:1746147266.900438:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:32424:x1830967466152448:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147266.900451:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147266.900464:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbe000/0xb4b2209fbdad36f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee183 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.900492:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.900498:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.900499:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147266.900502:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbe000/0xb4b2209fbdad36f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee183 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.900522:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147266.900531:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:2.0:1746147266.900540:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467197440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147266.900595:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.906103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.906264:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467197440:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147266.906288:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbe000/0xb4b2209fbdad36f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee183 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.906303:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbe000, rc 0) 00000100:00100000:2.0:1746147266.906338:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:32424:x1830967466152448:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5899us (6036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.906345:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16539 00000100:00100000:1.0:1746147266.906422:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152576 00000100:00100000:1.0:1746147266.906428:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152576 00010000:00010000:1.0:1746147266.906449:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.906478:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8479 00000100:00100000:1.0:1746147266.906484:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967466152576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.906496:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.906512:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.906521:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.906540:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a551ea00/0xb4b2209fbdad368c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee159 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.906564:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.906566:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.906571:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbe000/0xb4b2209fbdad36f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee183 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.906579:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbe000/0xb4b2209fbdad36f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee183 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.906602:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcbe000/0xb4b2209fbdad36f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee183 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.906613:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467197568:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147266.906658:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147266.908655:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467197568:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147266.908672:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.908700:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967466152576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2215us (2603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.908708:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8479 00000100:00100000:0.0:1746147266.908912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.909028:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152704 00000100:00100000:3.0:1746147266.909034:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152704 00000100:00100000:3.0:1746147266.909078:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16540 00000100:00100000:3.0:1746147266.909084:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:32424:x1830967466152704:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.909097:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.909110:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f864000/0xb4b2209fbdad36fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee18a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.909130:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.909140:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.909141:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.909144:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864000/0xb4b2209fbdad36fc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee18a expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.909164:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.909174:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 753 lvb_type: 1 00000100:00100000:3.0:1746147266.909183:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467197696:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.909235:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147266.912142:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467197696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147266.912166:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f864000/0xb4b2209fbdad36fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee18a expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.912180:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864000, rc 0) 00000100:00100000:2.0:1746147266.912224:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:32424:x1830967466152704:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3139us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147266.912231:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16540 00000100:00100000:0.0:1746147266.912682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.912807:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152832 00000100:00100000:1.0:1746147266.912812:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152832 00010000:00010000:1.0:1746147266.912832:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.912863:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8480 00000100:00100000:1.0:1746147266.912869:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967466152832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.912879:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.912896:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.912905:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.912921:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f864c00/0xb4b2209fbdad3685 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x421:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee160 expref: 20 pid: 11147 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.912963:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.912965:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.912971:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f864000/0xb4b2209fbdad36fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee18a expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.912978:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864000/0xb4b2209fbdad36fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee18a expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.913001:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f864000/0xb4b2209fbdad36fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee18a expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.913011:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467197824:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147266.913075:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147266.917960:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467197824:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147266.917983:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.918022:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967466152832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5153us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.918159:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8480 00000100:00100000:2.0:1746147266.918867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.918968:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466152960 00000100:00100000:3.0:1746147266.918974:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466152960 00000100:00100000:3.0:1746147266.919014:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16541 00000100:00100000:3.0:1746147266.919021:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32424:x1830967466152960:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.919034:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.919055:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f865200/0xb4b2209fbdad3703 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee191 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.919078:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.919084:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.919086:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.919089:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f865200/0xb4b2209fbdad3703 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee191 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.919112:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.919123:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 24 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:3.0:1746147266.919132:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467197952:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.919191:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.923839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.923887:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153088 00000100:00100000:1.0:1746147266.923894:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153088 00010000:00010000:1.0:1746147266.923922:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 25 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.923980:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8481 00000100:00100000:1.0:1746147266.923988:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466153088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.923999:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.924017:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 25 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.924028:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 25 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.924056:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.924058:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.924064:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f865200/0xb4b2209fbdad3703 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee191 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.924076:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f865200/0xb4b2209fbdad3703 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee191 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.924104:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f865200/0xb4b2209fbdad3703 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee191 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.924115:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467198080:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147266.924171:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e600 going to sleep for 11 seconds 00010000:00010000:3.0:1746147266.924976:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a551e200/0xb4b2209fbdad36a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x425:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee167 expref: 25 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:3.0:1746147266.925229:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467197952:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.925247:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f865200/0xb4b2209fbdad3703 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee191 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.925256:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865200, rc 0) 00000100:00100000:3.0:1746147266.925297:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32424:x1830967466152960:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6276us (6430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.925303:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16541 00000100:00100000:1.0:1746147266.926646:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467198080:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147266.926663:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.926698:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466153088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2711us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.926706:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8481 00000100:00100000:0.0:1746147266.927517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.927587:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153216 00000100:00100000:3.0:1746147266.927592:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153216 00000100:00100000:3.0:1746147266.927628:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16542 00000100:00100000:3.0:1746147266.927634:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:32424:x1830967466153216:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.927647:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.927659:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdad370a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee198 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.927680:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.927686:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.927688:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.927691:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdad370a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee198 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.927712:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.927722:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 24 pid: 11147 timeout: 753 lvb_type: 1 00000100:00100000:3.0:1746147266.927732:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467198208:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.928558:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.937353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.937959:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153344 00000100:00100000:1.0:1746147266.937966:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153344 00010000:00010000:1.0:1746147266.937995:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 25 pid: 11147 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.938030:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8482 00000100:00100000:1.0:1746147266.938037:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967466153344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.938060:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.938077:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 25 pid: 11147 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.938091:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 25 pid: 11147 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.938110:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.938112:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.938118:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdad370a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee198 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.938124:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdad370a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee198 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.938148:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f864600/0xb4b2209fbdad369a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x426:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee16e expref: 25 pid: 11147 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.938148:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdad370a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee198 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.938157:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467198336:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147266.938492:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147266.939403:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967467198208:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.939423:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdad370a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee198 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.939437:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864e00, rc 0) 00000100:00100000:3.0:1746147266.939468:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:32424:x1830967466153216:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 11834us (11952us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.939474:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16542 00000100:00100000:1.0:1746147266.942924:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967467198336:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147266.942974:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.943021:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967466153344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4984us (5675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.943029:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8482 00000100:00100000:0.0:1746147266.944161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.944231:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153472 00000100:00100000:3.0:1746147266.944237:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153472 00000100:00100000:3.0:1746147266.944270:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16543 00000100:00100000:3.0:1746147266.944275:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:32424:x1830967466153472:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.944289:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.944301:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f864400/0xb4b2209fbdad3711 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee19f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.944321:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.944327:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.944328:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147266.944332:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864400/0xb4b2209fbdad3711 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee19f expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.944351:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147266.944359:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:3.0:1746147266.944372:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467198464:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147266.944765:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147266.946608:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967467198464:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147266.946630:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f864400/0xb4b2209fbdad3711 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee19f expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.946643:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864400, rc 0) 00000100:00100000:3.0:1746147266.946685:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:32424:x1830967466153472:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2409us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.946692:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16543 00000100:00100000:0.0:1746147266.946896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.947201:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153600 00000100:00100000:1.0:1746147266.947206:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153600 00010000:00010000:1.0:1746147266.947226:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00000100:00100000:1.0:1746147266.947267:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8483 00000100:00100000:1.0:1746147266.947273:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967466153600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.947282:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.947299:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.947309:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.947326:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3200/0xb4b2209fbdad36a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x422:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee175 expref: 20 pid: 4444 timeout: 753 lvb_type: 1 00010000:00010000:1.0:1746147266.947348:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.947349:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147266.947355:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f864400/0xb4b2209fbdad3711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee19f expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.947363:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864400/0xb4b2209fbdad3711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee19f expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147266.947386:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f864400/0xb4b2209fbdad3711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee19f expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147266.947395:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467198592:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147266.947449:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147266.952492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.952537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147266.952815:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153728 00000100:00100000:1.0:1746147266.952823:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153728 00000100:00100000:1.0:1746147266.952869:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153984 00000100:00100000:1.0:1746147266.952871:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153984 00000100:00100000:1.0:1746147266.952888:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16544 00000100:00100000:1.0:1746147266.952893:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967466153728:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:2.0:1746147266.953076:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16545 00000100:00100000:2.0:1746147266.953084:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967466153984:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147266.953101:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147266.953104:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147261 -> 1746147265 00002000:00010000:1.0:1746147266.953106:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147261 -> 1746147265 00002000:00010000:1.0:1746147266.953107:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147261 -> 1746147266 00002000:00010000:1.0:1746147266.953109:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147266.953148:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967466153728:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 253us (663us total) trans 17179874212 rc 0/0 00000100:00100000:1.0:1746147266.953153:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16544 00002000:00010000:2.0:1746147266.953171:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147266.953173:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:2.0:1746147266.953176:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:2.0:1746147266.953177:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147265 -> 1746147266 00002000:00010000:2.0:1746147266.953179:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147266.953195:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967467198592:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147266.953198:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466153984:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 115us (660us total) trans 21474841548 rc 0/0 00000100:00100000:2.0:1746147266.953204:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16545 00010000:00010000:1.0:1746147266.953211:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147266.953227:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967466153600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5955us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.953233:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8483 00000100:00100000:0.0:1746147266.954632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.954662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.954681:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466154240 00000100:00100000:3.0:1746147266.954686:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466154240 00000100:00100000:0.0:1746147266.954687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147266.954707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147266.954828:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466153856 00000100:00100000:3.0:1746147266.954831:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466153856 00000100:00100000:3.0:1746147266.954838:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466154112 00000100:00100000:3.0:1746147266.954840:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466154112 00000100:00100000:3.0:1746147266.954851:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466154368 00000100:00100000:3.0:1746147266.954852:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466154368 00000100:00100000:3.0:1746147266.954864:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16546 00000100:00100000:3.0:1746147266.954868:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466154240:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:2.0:1746147266.954896:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16547 00000100:00100000:2.0:1746147266.954902:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967466154112:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147266.954993:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:3.0:1746147266.954996:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.954998:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:2.0:1746147266.954998:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147266.954999:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147265 -> 1746147266 00002000:00010000:2.0:1746147266.955000:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.955001:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00002000:00010000:2.0:1746147266.955002:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147263 -> 1746147265 00002000:00010000:2.0:1746147266.955004:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147265 -> 1746147266 00002000:00010000:2.0:1746147266.955006:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147266.955048:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967466154240:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 168us (409us total) trans 17179874213 rc 0/0 00000100:00100000:3.0:1746147266.955054:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16546 00000100:00100000:3.0:1746147266.955066:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16548 00000100:00100000:3.0:1746147266.955070:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466154368:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:2.0:1746147266.955137:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967466154112:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 234us (448us total) trans 17179874214 rc 0/0 00002000:00010000:3.0:1746147266.955139:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147266.955142:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.955143:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00000100:00100000:2.0:1746147266.955143:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16547 00002000:00010000:3.0:1746147266.955145:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147265 -> 1746147266 00002000:00010000:3.0:1746147266.955146:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746147266.955163:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466154368:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 92us (455us total) trans 21474841549 rc 0/0 00000100:00100000:3.0:1746147266.955167:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16548 00000100:00100000:3.0:1746147266.956701:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16549 00000100:00100000:3.0:1746147266.956707:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967466153856:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147266.956818:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147266.956821:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.956822:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147264 -> 1746147265 00002000:00010000:3.0:1746147266.956824:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147264 -> 1746147266 00002000:00010000:3.0:1746147266.956826:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147266.956864:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967466153856:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 157us (2200us total) trans 21474841550 rc 0/0 00000100:00100000:3.0:1746147266.956869:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16549 00000100:00100000:0.0:1746147266.958687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.958732:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466154624 00000100:00100000:2.0:1746147266.958739:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466154624 00000100:00100000:2.0:1746147266.958774:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4930 00000100:00100000:2.0:1746147266.958779:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:32424:x1830967466154624:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:2.0:1746147266.958818:0:16234:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x39b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdad3631 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee13d expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.958850:0:16234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16234 initiator: MDT0 00010000:00010000:2.0:1746147266.958860:0:16234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.958866:0:16234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16234 initiator: MDT0 00010000:00010000:2.0:1746147266.958886:0:16234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147266.958896:0:16234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 303 pid: 14125 timeout: 753 lvb_type: 0 00000100:00100000:2.0:1746147266.958912:0:16234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16234:1830967467198720:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147266.959189:0:16234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801308b7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147266.961623:0:16234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16234:1830967467198720:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147266.961623:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147266.961647:0:16234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00000100:00100000:1.0:1746147266.961696:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466154752 00000100:00100000:1.0:1746147266.961708:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466154752 00010000:00010000:1.0:1746147266.961743:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 304 pid: 14125 timeout: 753 lvb_type: 0 00000100:00100000:1.0:1746147266.961788:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8484 00000100:00100000:1.0:1746147266.961795:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967466154752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147266.961806:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147266.961812:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 304 pid: 14125 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.961822:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 304 pid: 14125 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.961839:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130aeba00/0xb4b2209fbdad3670 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee144 expref: 304 pid: 14125 timeout: 753 lvb_type: 0 00010000:00010000:1.0:1746147266.961870:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:1.0:1746147266.961874:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00010000:00010000:1.0:1746147266.961882:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16234 initiator: MDT0 00010000:00010000:1.0:1746147266.961888:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16234 initiator: MDT0 00010000:00010000:1.0:1746147266.961914:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147266.961978:0:16234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.961987:0:16234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00000100:00100000:1.0:1746147266.962006:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1957:x1830967466154752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 211us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147266.962012:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8484 00000040:00080000:3.0:1746147266.962383:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3532, 88 off296320 00000004:00080000:3.0:1746147266.962387:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949449270ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962427:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3515, 88 off294816 00000004:00080000:3.0:1746147266.962432:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949494418ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962470:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3517, 88 off295000 00000004:00080000:3.0:1746147266.962473:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949535735ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962482:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3533, 88 off296408 00000004:00080000:3.0:1746147266.962485:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949547380ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962499:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3534, 88 off296496 00000004:00080000:3.0:1746147266.962504:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949566368ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962510:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3518, 88 off295088 00000004:00080000:3.0:1746147266.962512:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949575195ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962517:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3519, 88 off295176 00000004:00080000:3.0:1746147266.962520:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949582325ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962525:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3520, 88 off295264 00000004:00080000:3.0:1746147266.962527:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949590105ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962533:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3535, 88 off296584 00000004:00080000:3.0:1746147266.962534:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949597342ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962540:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3521, 88 off295352 00000004:00080000:3.0:1746147266.962542:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949604867ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962547:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3536, 88 off296672 00000004:00080000:3.0:1746147266.962549:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949612090ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962554:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3522, 88 off295440 00000004:00080000:3.0:1746147266.962557:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949619577ns, next at 607576201812ns, rc = 0 00000040:00080000:3.0:1746147266.962562:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3537, 88 off296760 00000004:00080000:3.0:1746147266.962564:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949627308ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962570:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3538, 88 off296848 00000004:00080000:3.0:1746147266.962572:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949635287ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962578:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3539, 88 off296936 00000004:00080000:3.0:1746147266.962581:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949643702ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962586:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3540, 88 off297024 00000004:00080000:3.0:1746147266.962588:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 653949651098ns, next at 592568729900ns, rc = 0 00000040:00080000:3.0:1746147266.962594:0:16234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3523, 88 off295528 00000004:00080000:3.0:1746147266.962660:0:16234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653949722210ns, next at 607576201812ns, rc = 0 00000001:00080000:0.0:1746147266.985395:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945730 is committed 00000004:00080000:0.0:1746147266.985404:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2648 committed 00000004:00080000:0.0:1746147266.985412:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2661 committed 00000004:00010000:2.0:1746147266.985413:0:16234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f3f0700 reply state ffff88012c90a800 transno 8589945730 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16234 initiator: MDT0 00000004:00080000:0.0:1746147266.985417:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2660 committed 00000004:00080000:0.0:1746147266.985419:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2659 committed 00000004:00080000:0.0:1746147266.985420:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2658 committed 00000004:00080000:0.0:1746147266.985422:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2647 committed 00000004:00080000:0.0:1746147266.985423:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2657 committed 00000100:00100000:2.0:1746147266.985425:0:16234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746147266.985425:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2646 committed 00000004:00080000:0.0:1746147266.985426:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2656 committed 00000004:00080000:0.0:1746147266.985427:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2645 committed 00000004:00080000:0.0:1746147266.985428:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2644 committed 00000004:00080000:0.0:1746147266.985432:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2643 committed 00000004:00080000:0.0:1746147266.985433:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2655 committed 00010000:00010000:2.0:1746147266.985435:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00000004:00080000:0.0:1746147266.985435:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2654 committed 00000004:00080000:0.0:1746147266.985436:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2642 committed 00010000:00010000:2.0:1746147266.985437:0:16234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:0.0:1746147266.985438:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2641 committed 00000004:00080000:0.0:1746147266.985440:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2653 committed 00010000:00010000:2.0:1746147266.985446:0:16234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdad3631 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x39b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee13d expref: 301 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147266.985600:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467198848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.985658:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1746147266.985732:0:16234:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147266.985896:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467199360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147266.985901:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467198976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.985966:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32424:x1830967466154624:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 27184us (27281us total) trans 8589945730 rc 0/0 00000100:00100000:2.0:1746147266.985975:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4930 00000100:00100000:0.0:1746147266.985987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.986087:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467199872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.986109:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.986122:0:7558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467198848 00000100:00100000:2.0:1746147266.986123:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.986128:0:7558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467198848 00000100:00100000:2.0:1746147266.986135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147266.986145:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147266.986148:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f66a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.986154:0:7558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199360 00000100:00100000:0.0:1746147266.986156:0:7558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199360 00000100:00100000:2.0:1746147266.986160:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.986192:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467199104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.986583:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.986600:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.986719:0:7558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199872 00000100:00100000:0.0:1746147266.986723:0:7558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199872 00000100:00100000:0.0:1746147266.986741:0:7558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200384 00000100:00100000:0.0:1746147266.986743:0:7558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200384 00000100:00100000:2.0:1746147266.986744:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200000 00000100:00100000:2.0:1746147266.986747:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200000 00000100:00100000:0.0:1746147266.986751:0:7558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200512 00000100:00100000:0.0:1746147266.986752:0:7558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200512 00000100:00100000:0.0:1746147266.986760:0:7558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550 00000100:00100000:0.0:1746147266.986766:0:7558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967467198848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.986886:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16551 00000100:00100000:2.0:1746147266.986894:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967467199360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.987019:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3293:x1830967467199360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (1105us total) trans 21474841552 rc 0/0 00000100:00100000:2.0:1746147266.987025:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16551 00000100:00100000:2.0:1746147266.987053:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16552 00000100:00100000:2.0:1746147266.987058:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967467199872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147266.987160:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147266.987164:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:2.0:1746147266.987166:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:2.0:1746147266.987168:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb ctime from disk: 1746147266 -> 1746147266 00002000:00010000:2.0:1746147266.987169:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x423:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147266.987188:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3293:x1830967467199872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (1077us total) trans 17179874215 rc 0/0 00000100:00100000:2.0:1746147266.987194:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16552 00000100:00100000:2.0:1746147266.987204:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553 00000100:00100000:2.0:1746147266.987207:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967467200384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147266.987256:0:7558:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147266.987259:0:7558:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:0.0:1746147266.987260:0:7558:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:0.0:1746147266.987262:0:7558:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1746147266 -> 1746147266 00002000:00010000:0.0:1746147266.987264:0:7558:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147266.987567:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554 00000100:00100000:3.0:1746147266.987574:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3293:x1830967467200000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147266.987651:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147266.987653:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.987654:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.987656:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb ctime from disk: 1746147266 -> 1746147266 00002000:00010000:3.0:1746147266.987657:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x425:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147266.987684:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16555 00000100:00100000:1.0:1746147266.987691:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3293:x1830967467200512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.988095:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967467200384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 886us (1958us total) trans 17179874216 rc 0/0 00000100:00100000:2.0:1746147266.988100:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553 00000100:00100000:0.0:1746147266.988130:0:7558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3293:x1830967467198848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1357us (2465us total) trans 21474841551 rc 0/0 00000100:00100000:0.0:1746147266.988143:0:7558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550 00000004:00080000:2.0:1746147266.988144:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f668380/2, rc 0, transno 17179874215 00000100:00100000:2.0:1746147266.988152:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467199872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147266.988159:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecec380/2, rc 0, transno 17179874216 00000100:00100000:2.0:1746147266.988162:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147266.988172:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f85500/2, rc 0, transno 21474841552 00000100:00100000:2.0:1746147266.988176:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467199360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147266.988183:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f87800/2, rc 0, transno 21474841551 00000100:00100000:2.0:1746147266.988185:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467198848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.988224:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147266.988247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.988269:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200896 00000100:00100000:0.0:1746147266.988274:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200896 00000100:00100000:0.0:1746147266.988297:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16556 00000100:00100000:0.0:1746147266.988301:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967467200896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.988449:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967467200896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (202us total) trans 17179874219 rc 0/0 00000100:00100000:0.0:1746147266.988453:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16556 00000100:00100000:3.0:1746147266.988474:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967467200000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 900us (2311us total) trans 17179874217 rc 0/0 00000100:00100000:3.0:1746147266.988480:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554 00000100:00100000:3.0:1746147266.988499:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467199232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.988516:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.988528:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467199744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.988538:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.988546:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467200256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.988551:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199232 00000100:00100000:0.0:1746147266.988553:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199232 00000100:00100000:3.0:1746147266.988556:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.988566:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199744 00000100:00100000:3.0:1746147266.988567:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467200768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.988568:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199744 00000100:00100000:0.0:1746147266.988574:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200256 00000100:00100000:0.0:1746147266.988576:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200256 00000100:00100000:3.0:1746147266.988578:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.988585:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200768 00000100:00100000:0.0:1746147266.988586:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200768 00000100:00100000:0.0:1746147266.988592:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557 00000100:00100000:0.0:1746147266.988594:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1830967467199232:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147266.988605:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.988614:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.988620:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.988624:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147266.988628:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.988634:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.988647:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88012d8b9300) 00010000:00010000:3.0:1746147266.988649:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147266.988652:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16234 initiator: MDT0 00010000:00010000:3.0:1746147266.988656:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbea00/0xb4b2209fbdad3718 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16234 initiator: MDT0 00000100:00100000:0.0:1746147266.988675:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967467199232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (158us total) trans 21474841553 rc 0/0 00000100:00100000:0.0:1746147266.988678:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557 00000100:00100000:0.0:1746147266.988685:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558 00000100:00100000:0.0:1746147266.988688:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1830967467199744:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147266.988689:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f86300/2, rc 0, transno 21474841553 00000100:00100000:3.0:1746147266.988693:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467199232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.988707:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.988720:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467199616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.988736:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147266.988745:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467200128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.988746:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967467199744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (206us total) trans 21474841554 rc 0/0 00000100:00100000:0.0:1746147266.988750:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558 00000100:00100000:0.0:1746147266.988756:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199104 00000100:00100000:3.0:1746147266.988757:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.988758:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199104 00000100:00100000:0.0:1746147266.988763:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199616 00000100:00100000:3.0:1746147266.988764:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467200640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.988764:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199616 00000100:00100000:0.0:1746147266.988767:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200128 00000100:00100000:0.0:1746147266.988768:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200128 00000100:00100000:0.0:1746147266.988773:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16559 00000100:00100000:3.0:1746147266.988774:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.988776:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967467200256:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.988794:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f84380/2, rc 0, transno 21474841554 00000100:00100000:3.0:1746147266.988797:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467199744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.988805:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467200640 00000100:00100000:3.0:1746147266.988808:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467200640 00000100:00100000:3.0:1746147266.988822:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16560 00000100:00100000:3.0:1746147266.988827:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967467200768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.988834:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967467200256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (276us total) trans 17179874220 rc 0/0 00000100:00100000:0.0:1746147266.988838:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16559 00000100:00100000:0.0:1746147266.988845:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16561 00000100:00100000:0.0:1746147266.988848:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967467199104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147266.988893:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147266.988895:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:0.0:1746147266.988896:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:0.0:1746147266.988897:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb ctime from disk: 1746147266 -> 1746147266 00002000:00010000:0.0:1746147266.988898:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x422:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746147266.988914:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967467199104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (207us total) trans 21474841555 rc 0/0 00000100:00100000:0.0:1746147266.988917:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16561 00000100:00100000:3.0:1746147266.988922:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3296:x1830967467200768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (342us total) trans 17179874221 rc 0/0 00000100:00100000:0.0:1746147266.988924:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16562 00000100:00100000:0.0:1746147266.988926:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967467199616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147266.988928:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16560 00000100:00100000:3.0:1746147266.988958:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16563 00000100:00100000:3.0:1746147266.988964:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967467200128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147266.989027:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb size from disk: 4972704 -> 4972704 00002000:00010000:3.0:1746147266.989030:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.989032:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:3.0:1746147266.989033:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb ctime from disk: 1746147266 -> 1746147266 00002000:00010000:3.0:1746147266.989035:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x426:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:3.0:1746147266.989061:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967467200128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (303us total) trans 17179874222 rc 0/0 00000100:00100000:3.0:1746147266.989066:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16563 00000100:00100000:3.0:1746147266.989076:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16564 00000100:00100000:3.0:1746147266.989079:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967467200640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147266.989098:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967467199616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (361us total) trans 21474841556 rc 0/0 00000100:00100000:0.0:1746147266.989104:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16562 00000100:00100000:3.0:1746147266.989150:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967467200640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (374us total) trans 17179874223 rc 0/0 00000100:00100000:3.0:1746147266.989156:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16564 00000100:00100000:0.0:1746147266.989163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:3.0:1746147266.989178:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f668700/2, rc 0, transno 17179874220 00000100:00100000:3.0:1746147266.989181:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467200256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.989186:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090508000/2, rc 0, transno 17179874221 00000100:00100000:3.0:1746147266.989189:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967467200768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147266.989202:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466154880 00000100:00100000:3.0:1746147266.989204:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466154880 00000100:00100000:3.0:1746147266.989227:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11671 00000100:00100000:3.0:1746147266.989232:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+300:32424:x1830967466154880:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147266.989245:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147266.989258:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7a200/0xb4b2209fbdad371f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949ee1a6 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.989300:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7a200/0xb4b2209fbdad371f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee1a6 expref: 301 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.989311:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7a200/0xb4b2209fbdad371f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x39b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949ee1a6 expref: 301 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147266.989325:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x39b:0x0].0x0 (ffff88009e473400) 00010000:00010000:3.0:1746147266.989328:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147266.989330:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7a200, rc 0) 00000100:00100000:3.0:1746147266.989363:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32424:x1830967466154880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 131us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147266.989373:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11671 00000004:00080000:3.0:1746147266.989396:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f86680/2, rc 0, transno 21474841555 00000100:00100000:3.0:1746147266.989400:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467199104:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147266.989405:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090508380/2, rc 0, transno 17179874219 00000004:00080000:3.0:1746147266.989406:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f85f80/2, rc 0, transno 21474841556 00000100:00100000:3.0:1746147266.989408:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467199616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147266.989409:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.989413:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f669c00/2, rc 0, transno 17179874222 00000100:00100000:3.0:1746147266.989416:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467200128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147266.989421:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b100/2, rc 0, transno 17179874223 00000100:00100000:3.0:1746147266.989423:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967467200640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147266.989423:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f66a680/2, rc 0, transno 17179874217 00000100:00100000:2.0:1746147266.989426:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f66a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147266.989500:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967467200512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1810us (2898us total) trans 17179874218 rc 0/0 00000100:00100000:1.0:1746147266.989507:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16555 00000100:00100000:1.0:1746147266.989548:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147266.989569:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467198976 00000100:00100000:0.0:1746147266.989573:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467198976 00000100:00100000:1.0:1746147266.989576:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467199488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.989593:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16565 00000100:00100000:0.0:1746147266.989597:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967467198976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147266.989598:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147266.989620:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967467199488 00000100:00100000:1.0:1746147266.989623:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967467199488 00000100:00100000:1.0:1746147266.989640:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16566 00000100:00100000:1.0:1746147266.989644:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967467199488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147266.989668:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147266.989670:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb mtime from disk: 1746147265 -> 1746147265 00002000:00010000:0.0:1746147266.989672:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb atime from disk: 1746147265 -> 1746147265 00002000:00010000:0.0:1746147266.989673:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb ctime from disk: 1746147266 -> 1746147266 00002000:00010000:0.0:1746147266.989675:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x421:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147266.989701:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830967467198976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (152us total) trans 21474841557 rc 0/0 00000100:00100000:0.0:1746147266.989742:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16565 00000100:00100000:1.0:1746147266.989753:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1830967467199488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (154us total) trans 21474841558 rc 0/0 00000100:00100000:1.0:1746147266.989759:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16566 00000004:00080000:2.0:1746147266.989841:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090508700/2, rc 0, transno 17179874218 00000100:00100000:2.0:1746147266.989845:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967467200512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147266.989853:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f84700/2, rc 0, transno 21474841557 00000100:00100000:0.0:1746147266.989859:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467198976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147266.989868:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134f84e00/2, rc 0, transno 21474841558 00000100:00100000:0.0:1746147266.989870:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967467199488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147266.992842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147266.994224:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466155136 00000100:00100000:2.0:1746147266.994235:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466155136 00000100:00100000:2.0:1746147266.994283:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4931 00000100:00100000:2.0:1746147266.994290:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:32424:x1830967466155136:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147266.994530:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:32424:x1830967466155136:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 240us (1696us total) trans 8589945731 rc 0/0 00000100:00100000:2.0:1746147266.994537:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4931 00010000:00010000:3.0:1746147267.029423:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746147267.698003:0:7709:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746147268.042405:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69323 lines, 69323 kept, 0 dropped, 0 bad.